-- Logs begin at Mon 2021-11-08 10:22:51 UTC, end at Mon 2021-11-08 11:43:37 UTC. -- Nov 08 10:47:47.675933 dv-cinder-816184-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Nov 08 10:47:47.688044 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 08 10:47:47.691516 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 8 10:47:47 2021] *** Nov 08 10:47:47.691516 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 08 10:47:47.691516 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 08 10:47:47.691516 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: nodename: dv-cinder-816184-2-iscsi Nov 08 10:47:47.691516 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: machine: x86_64 Nov 08 10:47:47.691516 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: clock source: unix Nov 08 10:47:47.691516 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: pcre jit disabled Nov 08 10:47:47.691516 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: detected number of CPU cores: 4 Nov 08 10:47:47.691516 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: current working directory: / Nov 08 10:47:47.691516 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: detected binary path: /usr/bin/uwsgi-core Nov 08 10:47:47.692114 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: your processes number limit is 47680 Nov 08 10:47:47.692114 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: your memory page size is 4096 bytes Nov 08 10:47:47.692114 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: detected max file descriptor number: 2048 Nov 08 10:47:47.692114 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: lock engine: pthread robust mutexes Nov 08 10:47:47.692114 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: thunder lock: enabled Nov 08 10:47:47.692114 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 08 10:47:47.692114 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 08 10:47:47.752522 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: Python main interpreter initialized at 0x5555f75ac9c0 Nov 08 10:47:47.752522 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: python threads support enabled Nov 08 10:47:47.752522 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: your server socket listen backlog is limited to 100 connections Nov 08 10:47:47.752522 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: your mercy for graceful operations on workers is 90 seconds Nov 08 10:47:47.752879 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: mapped 403077 bytes (393 KB) for 2 cores Nov 08 10:47:47.752879 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: *** Operational MODE: preforking *** Nov 08 10:47:47.753247 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: *** uWSGI is running in multiple interpreter mode *** Nov 08 10:47:47.753247 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: spawned uWSGI master process (pid: 79191) Nov 08 10:47:47.753502 dv-cinder-816184-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Nov 08 10:47:47.755525 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: spawned uWSGI worker 1 (pid: 79200, cores: 1) Nov 08 10:47:47.756041 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: spawned uWSGI worker 2 (pid: 79201, cores: 1) Nov 08 10:47:47.756041 dv-cinder-816184-2-iscsi devstack@keystone.service[79191]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 08 10:47:52.836209 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 10:47:52.836209 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: from cryptography.utils import int_from_bytes Nov 08 10:47:52.837003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 10:47:52.837003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: from cryptography.utils import int_from_bytes Nov 08 10:47:52.837113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 10:47:52.837113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: from cryptography.utils import int_from_bytes Nov 08 10:47:52.837113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 10:47:52.837113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: from cryptography.utils import int_from_bytes Nov 08 10:47:52.885230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 10:47:52.885421 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 10:47:52.885505 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 10:47:52.885583 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 10:47:52.885654 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] command line args: [] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 10:47:52.885719 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] command line args: [] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 10:47:52.885856 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 10:47:52.885990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 10:47:52.886062 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ================================================================================ {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 10:47:52.886134 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ================================================================================ {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 10:47:52.886328 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] admin_token = **** {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.886458 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] admin_token = **** {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.886539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] config_dir = [] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.886604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] config_dir = [] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.886667 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.886883 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.887013 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] config_source = [] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.887094 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] config_source = [] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.887195 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] debug = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.887267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] debug = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.887340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.887595 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.887687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.887753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.887811 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.887880 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.888020 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.888099 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.888237 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.888322 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.888463 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] list_limit = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.888554 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] list_limit = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.888622 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] log_config_append = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.888684 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] log_config_append = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.888801 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.888874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.888973 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] log_dir = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.889053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] log_dir = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.889156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] log_file = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.889233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] log_file = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.889405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.889526 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.889598 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.889668 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.889881 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.890076 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.890166 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.890237 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.890302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.890454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.890539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.890680 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.890783 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.890982 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.891203 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.891308 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.891377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.891443 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.892002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.892121 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.892264 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.892387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.892479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.892729 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.892857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.892970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.893068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.893379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.893525 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.893615 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] publish_errors = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.893698 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.893846 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.894047 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.894217 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.894306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.894503 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.894635 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.894778 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] publish_errors = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.894883 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.894984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.895104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] standard_threads = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.895313 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.895428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.895538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.895657 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.895657 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.895873 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.895981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] use_journal = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.896094 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.896202 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] use_json = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.896322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] standard_threads = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.896425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] use_stderr = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.896425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] use_syslog = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.896632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.896742 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.896854 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.896854 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.897074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.897188 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] use_journal = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.897296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.897410 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] use_json = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.897410 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] use_stderr = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.897626 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.897741 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] use_syslog = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.897855 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.897964 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 10:47:52.898071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.898183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.898303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.898412 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.898526 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.898634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.898840 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.898956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.899169 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.899283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.899390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.899498 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.899612 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.899720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.899839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.899954 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.900063 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.900169 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.900276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.900388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.900507 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.900623 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.900737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.900847 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.900960 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.901070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.901185 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.901299 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.901408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.901514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.901627 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.901748 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.901868 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.901978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.902085 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.902195 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.902303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.902415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.902534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.902534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.902751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.902859 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.902965 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.903083 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.903277 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.903398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.903513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.903621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.903732 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.903849 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.903958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.904064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.904170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.904283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.904397 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.904585 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.904702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.904817 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.904925 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.905038 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.905146 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.905264 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.905372 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.905479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.905608 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.905721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.905859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.905981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.906092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.906208 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.906363 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.906516 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.906628 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.906745 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.906855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.906962 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.907069 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.907192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.907301 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.907421 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.907531 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.907637 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.907744 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.907850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.907850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.908059 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.908168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.908350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.908513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.908632 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.908817 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.908979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.909084 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.909284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.909432 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.909545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.909741 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.909952 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.909952 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.910186 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.910296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.910413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.910523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.910641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.910752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.910867 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.910984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.911102 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.911278 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.911398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.911515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.911626 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.911743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.911854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.912032 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.912199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.912340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.912499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.912621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.912737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.912999 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.913165 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.913303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.913425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.913538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.913684 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.913838 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.914082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.914260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.914425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.914576 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.914720 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.914720 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.914981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.915149 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.915289 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.915423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.915423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.915681 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.915811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.915956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.915956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.916220 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.916352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.916483 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.916612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.916754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.916884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.917025 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.917156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.917309 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.917440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.917650 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.917782 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.917913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.918045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.918193 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.918328 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.918473 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.918605 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] auth.external = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.918743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.918881 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.919012 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.919176 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.919325 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.919460 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.919600 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.919744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] auth.password = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.919875 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.920016 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] auth.token = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.920168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.920309 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.920451 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.920592 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.920592 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.920848 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.920981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.920981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.921308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.921553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.921553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.921806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.921806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.922077 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] credential.caching = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.922211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.922211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.922466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.922599 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.922730 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.922870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.923035 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.923196 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.923339 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.923471 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.923604 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.923743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.923875 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.924012 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.924147 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.924147 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.924395 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.924534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.924534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.924784 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.924941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.924941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.925190 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.925331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.925471 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.925633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.925633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.925907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] auth.external = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.926041 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] federation.caching = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.926173 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.926305 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.926454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.926594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.926728 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.926859 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.926992 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] auth.password = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.927157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.927429 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] auth.token = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.927566 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.927700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.927839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.927971 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.928106 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.928246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.928384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.928515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.928647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.928778 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.928912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.929051 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.929183 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.929314 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.929450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity.caching = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.929587 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] credential.caching = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.929721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.929972 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.930109 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.930241 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.930381 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.930513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.930645 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.930785 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.930918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.931050 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.931204 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.931339 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.931470 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.931618 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.931763 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.931905 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.932038 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.932177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.932315 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.932455 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.932596 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.932734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.932867 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.932998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.933142 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.933281 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.933421 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.933554 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.933686 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.933818 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.934027 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.934175 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] federation.caching = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.934308 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.934440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.934573 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.934705 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.934847 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.934979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.935112 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.935321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.935459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.935602 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.935745 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.935878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.936018 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.936151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.936284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.936415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.936558 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.936697 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.936870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.937214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.937368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.937368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.937641 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.937641 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity.caching = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.937892 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.937892 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.938149 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.938282 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.938427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.938561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.938708 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.938841 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.939012 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.939201 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.939350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.939490 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.939622 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.939754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.939886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.940028 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.940169 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.940307 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.940441 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.940441 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.940698 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.940830 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.940970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.941108 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.941240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.941376 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.941511 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.941643 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.941783 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.941915 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.942046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.942178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.942178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.942428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.942568 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.942701 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.942831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.942831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.943090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.943293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.943293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.943559 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.943690 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.943822 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.943953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.944084 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.944227 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.944363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.944494 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.944627 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.944759 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.944891 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.945145 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.945316 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.945450 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.945450 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.945702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.945843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.945843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.946095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.946229 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.946361 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.946494 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.946494 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.946755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.946892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.947024 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.947180 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.947321 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.947470 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.947608 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.947746 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.947746 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.948012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.948158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.948158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.948428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.948563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.948563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.948841 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.948980 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.948980 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.949254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.949392 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.949530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.949667 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.949667 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.949936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.950072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.950072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.950331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.950467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.950467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.950743 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.950886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.950886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.951200 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.951335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.951335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.951599 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.951731 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.951731 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.951981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.952113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.952245 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.952385 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.952557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.952557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.952839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.952972 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.953103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.953254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.953406 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.953536 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.953671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.953785 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.953897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.953897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.954126 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.954236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.954236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.954766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.954879 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.955006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.955116 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.955278 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.955386 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.955501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.955612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.955740 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.955849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.955970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.956080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.956194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.956350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.956490 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] resource.caching = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.956642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.956777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.956912 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.957046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.957046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.957322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.957457 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.957590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.957724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.957724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.957978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.958127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.958264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.958397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.958397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.958651 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.958792 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] role.caching = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.959029 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.959246 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] role.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.959246 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.959505 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.959638 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.959779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.959923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.960056 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.960194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.960194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.960446 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] resource.caching = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.960577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.960787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.960924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.960924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.961174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.961306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.961449 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.961583 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.961714 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.961845 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.961845 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.962102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.962244 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.962377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.962510 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.962642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.962642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.962891 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.963031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.963188 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.963328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] role.caching = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.963462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.963596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] role.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.963729 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.963879 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.964014 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.964148 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.964288 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.964420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.964556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.964706 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.964850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.964986 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.965130 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.965269 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.965406 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.965552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.965698 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.965837 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.965975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.966113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.966255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.966400 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.966539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.966677 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.966815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.966815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.967078 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.967342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.967477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.967616 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.967616 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.967874 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.968005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] token.caching = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.968005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.968292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.968425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.968425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.968727 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.968892 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.969026 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.969160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.969160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.969408 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.969546 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.969686 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.969821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.969821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.970070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.970205 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.970337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.970476 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.970476 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.970728 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.970871 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.971004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.971164 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.971164 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.971447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.971580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.971713 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.971852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.971987 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.972128 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.connection = **** {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.972262 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.972396 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.972529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.972662 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.972795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.972938 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.973072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.973211 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.973344 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.973478 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.973610 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.973752 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.973886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.974021 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.974154 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] token.caching = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.974288 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.974456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.974641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.974857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.975013 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.975199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.975344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.975491 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.975632 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.975765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.975904 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.975904 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.976155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.976287 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.976418 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.976560 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.976692 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.976824 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.976956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.977089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.977089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79201) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 10:47:52.977356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.977356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.977356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.977356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.977356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.977356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.977356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.978209 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.978209 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.connection = **** {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.978457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.978748 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.979110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.979536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.979907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.980319 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.980542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.980812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.981071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.981343 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.981565 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.981829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.982063 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.982329 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.982585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.982964 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.983251 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.983495 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 10:47:52.983637 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 10:47:53.006403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.006584 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.006850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.011923 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.012131 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.012380 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.015493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.021394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.044088 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.044314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.047808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.048046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.098317 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.098741 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.240959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.241161 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.241621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.241861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.305805 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.306011 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.306245 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.306371 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.306512 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.306593 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.306672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.306750 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.306872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.306944 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.307102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.307349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.331803 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.331961 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.332095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.332178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.332242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.332404 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.332529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.332659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.332743 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.332807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.332975 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.333101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.333237 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.333438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.344031 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.344274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.356922 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.357055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.357199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.357324 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.357422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.357538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.357628 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.357740 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.357821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.357884 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.357967 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.358043 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.358105 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79201) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.358266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79200) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 08 10:47:53.375462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.375629 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 08 10:47:53.375908 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.376022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.376090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 08 10:47:53.376154 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 08 10:47:53.376476 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.376613 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.376613 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 08 10:47:53.376760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.376899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.376980 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.377097 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.377190 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.377378 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.377634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.387916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.388127 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.388243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.388436 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.388563 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.388694 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.388778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.388964 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.396984 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.397610 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.400189 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.400469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.400752 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.400877 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.401016 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.401097 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.401293 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.401419 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.401572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.401656 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.401808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.401934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.402071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.402166 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.402398 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.402524 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.402663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.402744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.402923 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.403050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.403203 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.403473 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.428644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.429658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.430204 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.430479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.431254 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.431537 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.435731 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.436009 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.436284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.436773 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.437096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.437350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.443578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.443833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.444484 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.444764 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.448178 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.448462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.448738 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.449014 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.449139 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.449377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.449503 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.449654 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.449738 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.449914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.450039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.450177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.450271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.450454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.450716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.451097 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.468721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.469053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.469350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.469635 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.473648 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.474068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.477182 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.477490 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.477712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.478006 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.482396 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.482856 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.486122 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.486373 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.489673 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.489892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.490037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.490176 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.490297 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.490453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.490580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.490730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.490901 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.490996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.491157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.491248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.509680 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.509806 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.509931 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.510016 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.510219 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.510345 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.510501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.510587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.518724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.519381 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.520406 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.520654 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.521155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.521445 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.523697 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.523975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.524254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.524479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.524605 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.524744 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.524825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.525029 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.525314 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.525592 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.537949 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.538232 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.538507 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.538649 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.538789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.538871 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.539049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.539198 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.539355 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.539440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.539617 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.539743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.539982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.540262 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.556954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.557740 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.560931 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.561495 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.564933 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.565885 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.566496 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.567500 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.568120 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.568399 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.568688 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.569097 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.569373 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.569663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.575868 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.576767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.577429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.578502 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.580597 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.580886 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.581161 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.581429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.581791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.582085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.582371 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.582644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.590213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.590500 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.590775 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.591503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.591791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.592065 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.598627 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79201) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.598906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.599185 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.599484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.599751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.599875 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79200) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 08 10:47:53.600015 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.600136 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.600296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.600435 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.600580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.600707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.600831 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.600926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.601122 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.601270 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.601376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.601462 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.601655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.601813 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.601953 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.602075 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.602193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79201) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.602309 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.602494 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.602761 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.603038 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.603325 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79200) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 08 10:47:53.639339 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5555f75ac9c0 pid: 79201 (default app) Nov 08 10:47:53.640460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5555f75ac9c0 pid: 79200 (default app) Nov 08 10:47:53.642964 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ab0af-b7ff-4d13-9d53-23f5243dbacf None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:47:53.643286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ab0af-b7ff-4d13-9d53-23f5243dbacf None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:47:53.643551 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ab0af-b7ff-4d13-9d53-23f5243dbacf None None] PATH_INFO: `/v3` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:47:53.647885 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Mon Nov 8 10:47:53 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:01.375745 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbfd67-be40-4c42-ae99-b166dc9ed770 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:01.376582 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbfd67-be40-4c42-ae99-b166dc9ed770 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:01.376690 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbfd67-be40-4c42-ae99-b166dc9ed770 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:01.385509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:01 2021] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:01.394315 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4cf29-ee4a-4bb7-b46e-cd82ef5ce10e None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:01.394759 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4cf29-ee4a-4bb7-b46e-cd82ef5ce10e None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:01.394909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4cf29-ee4a-4bb7-b46e-cd82ef5ce10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:01.435635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG oslo_db.sqlalchemy.engines [None req-08c4cf29-ee4a-4bb7-b46e-cd82ef5ce10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79201) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 10:48:01.631926 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG passlib.handlers.bcrypt [None req-08c4cf29-ee4a-4bb7-b46e-cd82ef5ce10e None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79201) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 08 10:48:01.632304 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG passlib.handlers.bcrypt [None req-08c4cf29-ee4a-4bb7-b46e-cd82ef5ce10e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79201) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 08 10:48:01.688547 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-08c4cf29-ee4a-4bb7-b46e-cd82ef5ce10e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:01.690656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-08c4cf29-ee4a-4bb7-b46e-cd82ef5ce10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:01.832080 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:01.981935 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbfd67-be40-4c42-ae99-b166dc9ed770 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:02.019523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG oslo_db.sqlalchemy.engines [None req-40fbfd67-be40-4c42-ae99-b166dc9ed770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 10:48:02.164510 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbfd67-be40-4c42-ae99-b166dc9ed770 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:02.170058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce401c-8307-4466-8186-a9628968f955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:02.170722 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce401c-8307-4466-8186-a9628968f955 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:02.171011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce401c-8307-4466-8186-a9628968f955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:02.171521 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce401c-8307-4466-8186-a9628968f955 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:02.180052 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce401c-8307-4466-8186-a9628968f955 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:02.229906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f0ce401c-8307-4466-8186-a9628968f955 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 08 10:48:02.230224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce401c-8307-4466-8186-a9628968f955 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:02.240542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:01 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:02.251082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4cf29-ee4a-4bb7-b46e-cd82ef5ce10e None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:02.266276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4cf29-ee4a-4bb7-b46e-cd82ef5ce10e None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:02.272419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e01d0-6b67-44cf-b00e-030047b0f294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:02.273544 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e01d0-6b67-44cf-b00e-030047b0f294 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:02.273833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e01d0-6b67-44cf-b00e-030047b0f294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:02.274119 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e01d0-6b67-44cf-b00e-030047b0f294 admin admin] PATH_INFO: `/v3/projects/27515e2cec514f3da80e13fa65b719ab` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:02.275769 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e01d0-6b67-44cf-b00e-030047b0f294 admin admin] RBAC: Authorizing `identity:get_project(project_id=27515e2cec514f3da80e13fa65b719ab)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:02.328111 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.common.rbac_enforcer.enforcer [None req-530e01d0-6b67-44cf-b00e-030047b0f294 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 08 10:48:02.328449 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e01d0-6b67-44cf-b00e-030047b0f294 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:02.333142 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:02 2021] GET /identity/v3/projects/27515e2cec514f3da80e13fa65b719ab => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:04.551543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834645d6-f9c7-40d2-841d-84512abcc07d None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:04.552144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834645d6-f9c7-40d2-841d-84512abcc07d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:04.552144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834645d6-f9c7-40d2-841d-84512abcc07d None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:04.556654 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:04 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:04.564163 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4fdd4-049b-4ab4-8888-6b91306ade4d None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:04.564581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4fdd4-049b-4ab4-8888-6b91306ade4d None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:04.564792 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4fdd4-049b-4ab4-8888-6b91306ade4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:04.594631 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-46e4fdd4-049b-4ab4-8888-6b91306ade4d None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:04.596214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-46e4fdd4-049b-4ab4-8888-6b91306ade4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:04.606222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:04.630103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834645d6-f9c7-40d2-841d-84512abcc07d None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:04.652552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834645d6-f9c7-40d2-841d-84512abcc07d None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:04.659784 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc71c1-fd55-49cb-b877-369386984c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:04.660418 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc71c1-fd55-49cb-b877-369386984c2d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:04.660697 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc71c1-fd55-49cb-b877-369386984c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:04.660971 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc71c1-fd55-49cb-b877-369386984c2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:04.669173 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc71c1-fd55-49cb-b877-369386984c2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:04.671060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc71c1-fd55-49cb-b877-369386984c2d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:04.679903 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:04.686274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4fdd4-049b-4ab4-8888-6b91306ade4d None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:04.695554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4fdd4-049b-4ab4-8888-6b91306ade4d None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:04.701184 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd9433-8695-4e83-960f-61b32a75b7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:04.702053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd9433-8695-4e83-960f-61b32a75b7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:04.702359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd9433-8695-4e83-960f-61b32a75b7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:04.702638 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd9433-8695-4e83-960f-61b32a75b7f7 admin admin] PATH_INFO: `/v3/users/23015594a30b49b885e3a6236f3a6f37` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:04.704164 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd9433-8695-4e83-960f-61b32a75b7f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=23015594a30b49b885e3a6236f3a6f37)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:04.705996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd9433-8695-4e83-960f-61b32a75b7f7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:04.707583 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:04 2021] GET /identity/v3/users/23015594a30b49b885e3a6236f3a6f37 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:07.050781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddcc2f-af75-43a1-9fba-4b2efe501045 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:07.051334 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddcc2f-af75-43a1-9fba-4b2efe501045 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:07.051418 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddcc2f-af75-43a1-9fba-4b2efe501045 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:07.053691 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60d26-3a04-421e-a409-eb0ae761e032 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:07.054210 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:07.054306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60d26-3a04-421e-a409-eb0ae761e032 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:07.054306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60d26-3a04-421e-a409-eb0ae761e032 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:07.056329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:48:07.059764 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c329f-bc6c-45f8-9007-bdb5f7ac2b07 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:07.060053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c329f-bc6c-45f8-9007-bdb5f7ac2b07 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:07.060341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c329f-bc6c-45f8-9007-bdb5f7ac2b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:07.064581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce6c90-2ee9-421c-9900-5543d8cd42ad None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:07.064882 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce6c90-2ee9-421c-9900-5543d8cd42ad None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:07.065169 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce6c90-2ee9-421c-9900-5543d8cd42ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:07.087667 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-ebce6c90-2ee9-421c-9900-5543d8cd42ad None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:07.088908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-ebce6c90-2ee9-421c-9900-5543d8cd42ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:07.098650 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:07.105983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG passlib.handlers.bcrypt [None req-938c329f-bc6c-45f8-9007-bdb5f7ac2b07 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79200) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 08 10:48:07.106432 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG passlib.handlers.bcrypt [None req-938c329f-bc6c-45f8-9007-bdb5f7ac2b07 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79200) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 08 10:48:07.122637 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce6c90-2ee9-421c-9900-5543d8cd42ad None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:07.132379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce6c90-2ee9-421c-9900-5543d8cd42ad None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:07.138113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb1f99-76d3-4831-b4b5-94cfd6857c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:07.138751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1f99-76d3-4831-b4b5-94cfd6857c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:07.139034 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1f99-76d3-4831-b4b5-94cfd6857c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:07.139337 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1f99-76d3-4831-b4b5-94cfd6857c35 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:07.148582 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb1f99-76d3-4831-b4b5-94cfd6857c35 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:07.150403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb1f99-76d3-4831-b4b5-94cfd6857c35 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:07.152900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-938c329f-bc6c-45f8-9007-bdb5f7ac2b07 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:07.154536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-938c329f-bc6c-45f8-9007-bdb5f7ac2b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:07.161592 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 8/13] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:07.169660 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb1f99-76d3-4831-b4b5-94cfd6857c35 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:07.179777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb1f99-76d3-4831-b4b5-94cfd6857c35 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:07.182892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 6/14] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:07.184885 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19268e0-0ba5-4c5e-8368-0a4961f609a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:07.185679 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19268e0-0ba5-4c5e-8368-0a4961f609a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:07.185958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19268e0-0ba5-4c5e-8368-0a4961f609a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:07.186228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19268e0-0ba5-4c5e-8368-0a4961f609a2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:07.187668 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19268e0-0ba5-4c5e-8368-0a4961f609a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:07.189403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19268e0-0ba5-4c5e-8368-0a4961f609a2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:07.190959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 9/15] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:07 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:07.208606 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c329f-bc6c-45f8-9007-bdb5f7ac2b07 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:07.219240 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c329f-bc6c-45f8-9007-bdb5f7ac2b07 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:07.225212 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce3738-a50b-4425-ae39-052e900a974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:07.226423 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce3738-a50b-4425-ae39-052e900a974f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:07.226711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce3738-a50b-4425-ae39-052e900a974f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:07.226987 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce3738-a50b-4425-ae39-052e900a974f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:07.245842 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce3738-a50b-4425-ae39-052e900a974f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:07.253275 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-87ce3738-a50b-4425-ae39-052e900a974f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:48:07.254599 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 7/16] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:48:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:07.261425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19268e0-0ba5-4c5e-8368-0a4961f609a2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:07.272656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19268e0-0ba5-4c5e-8368-0a4961f609a2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:07.277554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b09348-3d79-4a5f-bda7-18e349049ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:07.278260 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b09348-3d79-4a5f-bda7-18e349049ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:07.278545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b09348-3d79-4a5f-bda7-18e349049ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:07.278821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b09348-3d79-4a5f-bda7-18e349049ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:07.279633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b09348-3d79-4a5f-bda7-18e349049ee1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:07.279946 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b09348-3d79-4a5f-bda7-18e349049ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:07.281850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-34b09348-3d79-4a5f-bda7-18e349049ee1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:07.281850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:48:07.281850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:48:07.282777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b09348-3d79-4a5f-bda7-18e349049ee1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:07.298760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 10/17] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:07.305613 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce3738-a50b-4425-ae39-052e900a974f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:07.316914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce3738-a50b-4425-ae39-052e900a974f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:07.323259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d1b4b-4868-450f-96ec-a3c0cd926008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:07.324154 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d1b4b-4868-450f-96ec-a3c0cd926008 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:07.324436 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d1b4b-4868-450f-96ec-a3c0cd926008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:07.324710 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d1b4b-4868-450f-96ec-a3c0cd926008 admin admin] PATH_INFO: `/v3/users/23015594a30b49b885e3a6236f3a6f37` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:07.326444 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d1b4b-4868-450f-96ec-a3c0cd926008 admin admin] RBAC: Authorizing `identity:get_user(user_id=23015594a30b49b885e3a6236f3a6f37)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:07.328767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d1b4b-4868-450f-96ec-a3c0cd926008 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:07.330689 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 8/18] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:07 2021] GET /identity/v3/users/23015594a30b49b885e3a6236f3a6f37 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:07.336951 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b09348-3d79-4a5f-bda7-18e349049ee1 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:07.348125 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b09348-3d79-4a5f-bda7-18e349049ee1 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:07.353590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b422980-253b-4d9a-b440-7bc0f7640ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:07.354419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b422980-253b-4d9a-b440-7bc0f7640ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:07.354701 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b422980-253b-4d9a-b440-7bc0f7640ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:07.354996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b422980-253b-4d9a-b440-7bc0f7640ed6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:07.356367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b422980-253b-4d9a-b440-7bc0f7640ed6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:07.358142 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b422980-253b-4d9a-b440-7bc0f7640ed6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:07.360566 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 11/19] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:07 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:07.367367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d1b4b-4868-450f-96ec-a3c0cd926008 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:07.379166 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d1b4b-4868-450f-96ec-a3c0cd926008 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:07.385095 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412c4dd-c227-4f34-bdbe-72fa5c4b09b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:07.385746 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412c4dd-c227-4f34-bdbe-72fa5c4b09b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:07.386033 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412c4dd-c227-4f34-bdbe-72fa5c4b09b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:07.386309 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412c4dd-c227-4f34-bdbe-72fa5c4b09b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:07.387349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412c4dd-c227-4f34-bdbe-72fa5c4b09b9 admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.domain.id=default, user.id=23015594a30b49b885e3a6236f3a6f37) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:07.387507 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412c4dd-c227-4f34-bdbe-72fa5c4b09b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:07.389326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-b412c4dd-c227-4f34-bdbe-72fa5c4b09b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:07.389326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:48:07.389326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:48:07.391334 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412c4dd-c227-4f34-bdbe-72fa5c4b09b9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:07.401653 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 9/20] 10.222.0.20 () {56 vars in 1343 bytes} [Mon Nov 8 10:48:07 2021] GET /identity/v3/role_assignments?user.id=23015594a30b49b885e3a6236f3a6f37&scope.domain.id=default&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 233 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:09.870268 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f8f13-e41e-4d3b-8afe-4a1fc527489d None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:09.871435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f8f13-e41e-4d3b-8afe-4a1fc527489d None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:09.871921 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f8f13-e41e-4d3b-8afe-4a1fc527489d None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:09.874413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 12/21] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:09.881675 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349233e-8cb9-4dfc-8e34-b41562a5d51e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:09.882667 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349233e-8cb9-4dfc-8e34-b41562a5d51e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:09.883156 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349233e-8cb9-4dfc-8e34-b41562a5d51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:09.903351 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-5349233e-8cb9-4dfc-8e34-b41562a5d51e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:09.903988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c641f-7ea7-40d9-a60a-4010f4c38a4e None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:09.904499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c641f-7ea7-40d9-a60a-4010f4c38a4e None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:09.904947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-5349233e-8cb9-4dfc-8e34-b41562a5d51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:09.905191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c641f-7ea7-40d9-a60a-4010f4c38a4e None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:09.908216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 13/22] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:09.914059 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685791a1-908e-4025-ab0a-f7afc6225237 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:09.914599 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685791a1-908e-4025-ab0a-f7afc6225237 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:09.915113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685791a1-908e-4025-ab0a-f7afc6225237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:09.919658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 10/23] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:09.944459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-685791a1-908e-4025-ab0a-f7afc6225237 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:09.946036 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-685791a1-908e-4025-ab0a-f7afc6225237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:09.958422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 14/24] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:09.976743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349233e-8cb9-4dfc-8e34-b41562a5d51e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:09.982911 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685791a1-908e-4025-ab0a-f7afc6225237 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:09.986661 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349233e-8cb9-4dfc-8e34-b41562a5d51e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:09.992361 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685791a1-908e-4025-ab0a-f7afc6225237 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:10.000950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f801a6b-a88f-4cd1-965a-4e02b379d30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:10.001958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801a6b-a88f-4cd1-965a-4e02b379d30c admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:10.002440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801a6b-a88f-4cd1-965a-4e02b379d30c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:10.002917 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801a6b-a88f-4cd1-965a-4e02b379d30c admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:10.003798 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31864c89-d262-461f-a7c3-35841a9fee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:10.004155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f801a6b-a88f-4cd1-965a-4e02b379d30c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:10.004609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31864c89-d262-461f-a7c3-35841a9fee65 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:10.004897 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31864c89-d262-461f-a7c3-35841a9fee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:10.005172 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31864c89-d262-461f-a7c3-35841a9fee65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:10.006028 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-0f801a6b-a88f-4cd1-965a-4e02b379d30c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:10.006028 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:48:10.006028 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:48:10.007337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f801a6b-a88f-4cd1-965a-4e02b379d30c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:10.029364 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31864c89-d262-461f-a7c3-35841a9fee65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:10.031636 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31864c89-d262-461f-a7c3-35841a9fee65 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:10.064570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-31864c89-d262-461f-a7c3-35841a9fee65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:10.064570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 15/25] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:10.069924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31864c89-d262-461f-a7c3-35841a9fee65 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:10.084430 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31864c89-d262-461f-a7c3-35841a9fee65 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:10.103898 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb416e-6666-43b9-8fb0-0d244bb9e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:10.104596 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb416e-6666-43b9-8fb0-0d244bb9e8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:10.105062 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb416e-6666-43b9-8fb0-0d244bb9e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:10.105341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb416e-6666-43b9-8fb0-0d244bb9e8b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:10.106121 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb416e-6666-43b9-8fb0-0d244bb9e8b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:10.106421 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb416e-6666-43b9-8fb0-0d244bb9e8b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:10.107707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-dacb416e-6666-43b9-8fb0-0d244bb9e8b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:10.107707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:48:10.107707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:48:10.108934 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb416e-6666-43b9-8fb0-0d244bb9e8b9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:10.137676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 16/26] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:10.144049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb416e-6666-43b9-8fb0-0d244bb9e8b9 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:10.165834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb416e-6666-43b9-8fb0-0d244bb9e8b9 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:10.188001 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ede8d-500c-4d42-b302-fd03d7d5a91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:10.188693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ede8d-500c-4d42-b302-fd03d7d5a91d admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:10.188977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ede8d-500c-4d42-b302-fd03d7d5a91d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:10.189255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ede8d-500c-4d42-b302-fd03d7d5a91d admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:10.190003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ede8d-500c-4d42-b302-fd03d7d5a91d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:10.191095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-f46ede8d-500c-4d42-b302-fd03d7d5a91d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:10.191095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:48:10.191095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:48:10.192354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ede8d-500c-4d42-b302-fd03d7d5a91d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:10.193158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 11/27] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 10:48:09 2021] POST /identity/v3/roles => generated 219 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:48:10.194938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897de88f-4ddd-4276-94d1-54906a3691db None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:10.195257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897de88f-4ddd-4276-94d1-54906a3691db None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:10.195543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897de88f-4ddd-4276-94d1-54906a3691db None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:10.197664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 12/28] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:10.205605 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7ed3-54fc-45c8-b921-93f8d8a5f19d None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:10.205899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7ed3-54fc-45c8-b921-93f8d8a5f19d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:10.206187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7ed3-54fc-45c8-b921-93f8d8a5f19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:10.237985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-658f7ed3-54fc-45c8-b921-93f8d8a5f19d None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:10.243972 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-658f7ed3-54fc-45c8-b921-93f8d8a5f19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:10.255778 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 13/29] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:10.295374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f7ed3-54fc-45c8-b921-93f8d8a5f19d None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:10.313918 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f7ed3-54fc-45c8-b921-93f8d8a5f19d None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:10.320965 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3250dce-8429-4f13-b9b6-6911fa08c254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:10.321818 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3250dce-8429-4f13-b9b6-6911fa08c254 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:10.322102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3250dce-8429-4f13-b9b6-6911fa08c254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:10.322433 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3250dce-8429-4f13-b9b6-6911fa08c254 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:10.364240 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3250dce-8429-4f13-b9b6-6911fa08c254 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:10.375964 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-b3250dce-8429-4f13-b9b6-6911fa08c254 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:48:10.377505 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 14/30] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:48:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:10.384426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3250dce-8429-4f13-b9b6-6911fa08c254 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:10.406055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3250dce-8429-4f13-b9b6-6911fa08c254 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:10.410972 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cafa5-1962-4b94-bff4-be9e7909f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:10.411860 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cafa5-1962-4b94-bff4-be9e7909f540 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:10.412257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cafa5-1962-4b94-bff4-be9e7909f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:10.412542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cafa5-1962-4b94-bff4-be9e7909f540 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:10.413365 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cafa5-1962-4b94-bff4-be9e7909f540 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:10.413680 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cafa5-1962-4b94-bff4-be9e7909f540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:10.414957 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-ec8cafa5-1962-4b94-bff4-be9e7909f540 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:10.414957 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:48:10.414957 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:48:10.415931 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cafa5-1962-4b94-bff4-be9e7909f540 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:10.417285 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 17/31] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Nov 8 10:48:10 2021] POST /identity/v3/projects => generated 301 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:48:10.433499 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 15/32] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:10.440474 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ede8d-500c-4d42-b302-fd03d7d5a91d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:10.554207 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ede8d-500c-4d42-b302-fd03d7d5a91d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:10.559228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fe43f-d1b1-4e3f-8819-6b754d7a038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:10.560158 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fe43f-d1b1-4e3f-8819-6b754d7a038d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:10.560446 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fe43f-d1b1-4e3f-8819-6b754d7a038d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:10.560732 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fe43f-d1b1-4e3f-8819-6b754d7a038d admin admin] PATH_INFO: `/v3/users/23015594a30b49b885e3a6236f3a6f37` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:10.562230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fe43f-d1b1-4e3f-8819-6b754d7a038d admin admin] RBAC: Authorizing `identity:get_user(user_id=23015594a30b49b885e3a6236f3a6f37)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:10.564375 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fe43f-d1b1-4e3f-8819-6b754d7a038d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:10.566468 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 18/33] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:10 2021] GET /identity/v3/users/23015594a30b49b885e3a6236f3a6f37 => generated 247 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:10.572591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cafa5-1962-4b94-bff4-be9e7909f540 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:10.583113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cafa5-1962-4b94-bff4-be9e7909f540 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:10.591049 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f4c9b-3822-4457-808c-7cea7aedacbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:10.591912 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f4c9b-3822-4457-808c-7cea7aedacbc admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:10.592205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f4c9b-3822-4457-808c-7cea7aedacbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:10.592482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f4c9b-3822-4457-808c-7cea7aedacbc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:10.593831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f4c9b-3822-4457-808c-7cea7aedacbc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:10.595653 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f4c9b-3822-4457-808c-7cea7aedacbc admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:10.597734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 16/34] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:10.603864 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fe43f-d1b1-4e3f-8819-6b754d7a038d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:10.614302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21534d5-1797-4659-8afe-764035a631bc None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:10.614606 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fe43f-d1b1-4e3f-8819-6b754d7a038d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:10.614701 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21534d5-1797-4659-8afe-764035a631bc None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:10.614907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21534d5-1797-4659-8afe-764035a631bc None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:10.617046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 17/35] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:48:10.623376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbfa9f-6c2d-4e30-85a2-d5013eff951e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:10.624222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bdbd8-4f30-45dc-9559-7156be0af26b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:10.624520 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bdbd8-4f30-45dc-9559-7156be0af26b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:10.624750 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbfa9f-6c2d-4e30-85a2-d5013eff951e admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:10.624891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bdbd8-4f30-45dc-9559-7156be0af26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:10.625103 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbfa9f-6c2d-4e30-85a2-d5013eff951e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:10.625330 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbfa9f-6c2d-4e30-85a2-d5013eff951e admin admin] PATH_INFO: `/v3/domains/default/users/23015594a30b49b885e3a6236f3a6f37/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:10.627618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fbfa9f-6c2d-4e30-85a2-d5013eff951e admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=23015594a30b49b885e3a6236f3a6f37, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:10.628767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-95fbfa9f-6c2d-4e30-85a2-d5013eff951e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:10.628767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:48:10.628767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:48:10.630787 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fbfa9f-6c2d-4e30-85a2-d5013eff951e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:10.658990 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 19/36] 10.222.0.20 () {58 vars in 1382 bytes} [Mon Nov 8 10:48:10 2021] PUT /identity/v3/domains/default/users/23015594a30b49b885e3a6236f3a6f37/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:48:10.660100 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-2f8bdbd8-4f30-45dc-9559-7156be0af26b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:10.661339 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-2f8bdbd8-4f30-45dc-9559-7156be0af26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:10.775425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 18/37] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:10.803569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbfa9f-6c2d-4e30-85a2-d5013eff951e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:10.814547 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbfa9f-6c2d-4e30-85a2-d5013eff951e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:10.819694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361fdc6-e2cf-4ce2-8a7b-ad31c3e6abf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:10.820392 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361fdc6-e2cf-4ce2-8a7b-ad31c3e6abf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:10.820687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361fdc6-e2cf-4ce2-8a7b-ad31c3e6abf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:10.820969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361fdc6-e2cf-4ce2-8a7b-ad31c3e6abf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:10.821767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361fdc6-e2cf-4ce2-8a7b-ad31c3e6abf3 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:10.822863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-4361fdc6-e2cf-4ce2-8a7b-ad31c3e6abf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:10.822863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:48:10.822863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:48:10.823879 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361fdc6-e2cf-4ce2-8a7b-ad31c3e6abf3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:10.852600 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 20/38] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 10:48:10 2021] POST /identity/v3/roles => generated 225 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:48:11.497169 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8ce14-eea5-4694-a526-3ae1e272f3be None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:11.498122 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8ce14-eea5-4694-a526-3ae1e272f3be None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:11.498627 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8ce14-eea5-4694-a526-3ae1e272f3be None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:11.500974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 19/39] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:11.506803 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbac31-9abc-4ce5-932b-4db21d33527a None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:11.507266 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbac31-9abc-4ce5-932b-4db21d33527a None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:11.507432 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbac31-9abc-4ce5-932b-4db21d33527a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:11.527771 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-02dbac31-9abc-4ce5-932b-4db21d33527a None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:11.529339 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-02dbac31-9abc-4ce5-932b-4db21d33527a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:11.538568 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 21/40] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:11.562367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8ce14-eea5-4694-a526-3ae1e272f3be None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:11.575380 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8ce14-eea5-4694-a526-3ae1e272f3be None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:11.580262 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec0202-7bce-43b4-8bfe-d2bdca237734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:11.580947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec0202-7bce-43b4-8bfe-d2bdca237734 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:11.581231 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec0202-7bce-43b4-8bfe-d2bdca237734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:11.581514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec0202-7bce-43b4-8bfe-d2bdca237734 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:11.582303 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec0202-7bce-43b4-8bfe-d2bdca237734 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:11.583999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec0202-7bce-43b4-8bfe-d2bdca237734 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:11.600116 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 10:48:11 2021] POST /identity/v3/roles => generated 223 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 10:48:11.743962 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5ebab-9072-4176-86c6-4b4519404efb None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:11.744265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5ebab-9072-4176-86c6-4b4519404efb None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:11.744448 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5ebab-9072-4176-86c6-4b4519404efb None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:11.746352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 22/42] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:11.753458 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422bd7a-8d2a-4209-b7f0-80dd94c43575 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:11.753792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422bd7a-8d2a-4209-b7f0-80dd94c43575 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:11.753974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422bd7a-8d2a-4209-b7f0-80dd94c43575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:11.773832 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-a422bd7a-8d2a-4209-b7f0-80dd94c43575 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:11.775068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a422bd7a-8d2a-4209-b7f0-80dd94c43575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:11.783831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 21/43] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:11.807764 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5ebab-9072-4176-86c6-4b4519404efb None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:11.820923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5ebab-9072-4176-86c6-4b4519404efb None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:11.825803 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40899060-3fb4-4ee0-9290-0f4379c57f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:11.826625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40899060-3fb4-4ee0-9290-0f4379c57f06 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:11.826910 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40899060-3fb4-4ee0-9290-0f4379c57f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:11.827280 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40899060-3fb4-4ee0-9290-0f4379c57f06 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:11.828502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40899060-3fb4-4ee0-9290-0f4379c57f06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:11.830425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40899060-3fb4-4ee0-9290-0f4379c57f06 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:11.832186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 23/44] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:11.838481 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422bd7a-8d2a-4209-b7f0-80dd94c43575 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:11.847992 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422bd7a-8d2a-4209-b7f0-80dd94c43575 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:11.852899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76c593-36f8-49d9-be8e-bce6217da8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:11.853577 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c593-36f8-49d9-be8e-bce6217da8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:11.853870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c593-36f8-49d9-be8e-bce6217da8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:11.854150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c593-36f8-49d9-be8e-bce6217da8f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:11.854902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76c593-36f8-49d9-be8e-bce6217da8f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:11.855982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-8d76c593-36f8-49d9-be8e-bce6217da8f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:11.855982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:48:11.855982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:48:11.857225 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76c593-36f8-49d9-be8e-bce6217da8f3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:11.887200 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Nov 8 10:48:11 2021] POST /identity/v3/projects => generated 312 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:48:13.005206 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40280620-3185-415a-a2ce-18b6009b1724 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:13.005731 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40280620-3185-415a-a2ce-18b6009b1724 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:13.005731 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40280620-3185-415a-a2ce-18b6009b1724 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:13.007632 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 24/46] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:13.013712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a72cf-d3e6-4779-b602-5b451f900145 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:13.014141 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a72cf-d3e6-4779-b602-5b451f900145 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:13.014225 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a72cf-d3e6-4779-b602-5b451f900145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:13.034051 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-6e2a72cf-d3e6-4779-b602-5b451f900145 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:13.035325 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6e2a72cf-d3e6-4779-b602-5b451f900145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:13.097437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 23/47] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:13.121680 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40280620-3185-415a-a2ce-18b6009b1724 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:13.135616 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40280620-3185-415a-a2ce-18b6009b1724 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:13.140634 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226f9de-c24d-4bd7-bd22-44d929884ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:13.141408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226f9de-c24d-4bd7-bd22-44d929884ecf admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:13.142032 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226f9de-c24d-4bd7-bd22-44d929884ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:13.142306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226f9de-c24d-4bd7-bd22-44d929884ecf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:13.153774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226f9de-c24d-4bd7-bd22-44d929884ecf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:13.160503 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-4226f9de-c24d-4bd7-bd22-44d929884ecf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:48:13.161694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:48:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:13.168494 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a72cf-d3e6-4779-b602-5b451f900145 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:13.178309 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a72cf-d3e6-4779-b602-5b451f900145 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:13.184062 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25628ad6-126e-485a-a554-5820780acf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:13.184738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25628ad6-126e-485a-a554-5820780acf3c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:13.185022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25628ad6-126e-485a-a554-5820780acf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:13.185293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25628ad6-126e-485a-a554-5820780acf3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:13.186063 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25628ad6-126e-485a-a554-5820780acf3c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:13.186370 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25628ad6-126e-485a-a554-5820780acf3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:13.188206 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25628ad6-126e-485a-a554-5820780acf3c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:13.197074 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 24/49] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:13.203745 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226f9de-c24d-4bd7-bd22-44d929884ecf admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:13.214395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226f9de-c24d-4bd7-bd22-44d929884ecf admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:13.219484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5450-9ff7-44c7-a868-a30d6f47a875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:13.220346 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5450-9ff7-44c7-a868-a30d6f47a875 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:13.220632 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5450-9ff7-44c7-a868-a30d6f47a875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:13.220907 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5450-9ff7-44c7-a868-a30d6f47a875 admin admin] PATH_INFO: `/v3/users/23015594a30b49b885e3a6236f3a6f37` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:13.222138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf5450-9ff7-44c7-a868-a30d6f47a875 admin admin] RBAC: Authorizing `identity:get_user(user_id=23015594a30b49b885e3a6236f3a6f37)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:13.224047 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf5450-9ff7-44c7-a868-a30d6f47a875 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:13.225632 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 26/50] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:13 2021] GET /identity/v3/users/23015594a30b49b885e3a6236f3a6f37 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:13.231582 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25628ad6-126e-485a-a554-5820780acf3c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:13.241501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25628ad6-126e-485a-a554-5820780acf3c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:13.247501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988dc2c-db0d-41ae-baee-e1ffb230e481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:13.248314 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988dc2c-db0d-41ae-baee-e1ffb230e481 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:13.248601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988dc2c-db0d-41ae-baee-e1ffb230e481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:13.248878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988dc2c-db0d-41ae-baee-e1ffb230e481 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:13.250432 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988dc2c-db0d-41ae-baee-e1ffb230e481 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:13.252206 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988dc2c-db0d-41ae-baee-e1ffb230e481 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:13.253832 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 25/51] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:13.260219 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5450-9ff7-44c7-a868-a30d6f47a875 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:13.271082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5450-9ff7-44c7-a868-a30d6f47a875 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:13.275608 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5f775-a943-4948-afd6-5813b52d61a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:13.276262 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5f775-a943-4948-afd6-5813b52d61a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:13.276555 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5f775-a943-4948-afd6-5813b52d61a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:13.276839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5f775-a943-4948-afd6-5813b52d61a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:13.277702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5f775-a943-4948-afd6-5813b52d61a9 admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.domain.id=default, user.id=23015594a30b49b885e3a6236f3a6f37) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:13.278017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5f775-a943-4948-afd6-5813b52d61a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:13.279037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-e7e5f775-a943-4948-afd6-5813b52d61a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:13.279037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:48:13.279037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:48:13.280306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5f775-a943-4948-afd6-5813b52d61a9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:13.288093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 27/52] 10.222.0.20 () {56 vars in 1343 bytes} [Mon Nov 8 10:48:13 2021] GET /identity/v3/role_assignments?user.id=23015594a30b49b885e3a6236f3a6f37&scope.domain.id=default&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 530 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:14.153034 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0b9a2-84a3-4dfb-bd84-22f295300629 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:14.154203 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0b9a2-84a3-4dfb-bd84-22f295300629 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:14.154498 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0b9a2-84a3-4dfb-bd84-22f295300629 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:14.156343 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 26/53] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:48:14.163366 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0666ed9-07bc-421a-b330-2c5e2dbe5347 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:14.164045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0666ed9-07bc-421a-b330-2c5e2dbe5347 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:14.164311 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0666ed9-07bc-421a-b330-2c5e2dbe5347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:14.185848 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-b0666ed9-07bc-421a-b330-2c5e2dbe5347 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:14.187047 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b0666ed9-07bc-421a-b330-2c5e2dbe5347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:14.195418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 28/54] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:14.219437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0b9a2-84a3-4dfb-bd84-22f295300629 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:14.232573 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0b9a2-84a3-4dfb-bd84-22f295300629 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:14.237491 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e638f-4a90-462c-86bc-800e59f9e349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:14.238279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e638f-4a90-462c-86bc-800e59f9e349 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:14.238567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e638f-4a90-462c-86bc-800e59f9e349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:14.238844 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e638f-4a90-462c-86bc-800e59f9e349 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:14.240121 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e638f-4a90-462c-86bc-800e59f9e349 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:14.241838 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e638f-4a90-462c-86bc-800e59f9e349 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:14.243461 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:14.249408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0666ed9-07bc-421a-b330-2c5e2dbe5347 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:14.258641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0666ed9-07bc-421a-b330-2c5e2dbe5347 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:14.263385 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14e95b-70ae-49ce-8378-b510e1a6aa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:14.264037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14e95b-70ae-49ce-8378-b510e1a6aa41 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:14.264326 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14e95b-70ae-49ce-8378-b510e1a6aa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:14.264609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14e95b-70ae-49ce-8378-b510e1a6aa41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:14.265347 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14e95b-70ae-49ce-8378-b510e1a6aa41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:14.267688 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14e95b-70ae-49ce-8378-b510e1a6aa41 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:14.294568 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 29/56] 10.222.0.20 () {60 vars in 1161 bytes} [Mon Nov 8 10:48:14 2021] POST /identity/v3/projects => generated 298 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:48:16.520649 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2e346-a713-4595-a4f2-22df80af488f None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:16.521434 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2e346-a713-4595-a4f2-22df80af488f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:16.521625 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2e346-a713-4595-a4f2-22df80af488f None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:16.524427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 28/57] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:16 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:16.533514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4c10-6058-45d0-834d-9fc6fcdd9b9a None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:16.533943 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4c10-6058-45d0-834d-9fc6fcdd9b9a None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:16.534026 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4c10-6058-45d0-834d-9fc6fcdd9b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:16.552152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-288e4c10-6058-45d0-834d-9fc6fcdd9b9a None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:16.553342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-288e4c10-6058-45d0-834d-9fc6fcdd9b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:16.609917 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 30/58] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:16.635358 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2e346-a713-4595-a4f2-22df80af488f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:16.650590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2e346-a713-4595-a4f2-22df80af488f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:16.656517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc24a3-deb2-42ab-bc40-15abc1b10ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:16.657354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc24a3-deb2-42ab-bc40-15abc1b10ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:16.657636 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc24a3-deb2-42ab-bc40-15abc1b10ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:16.657914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc24a3-deb2-42ab-bc40-15abc1b10ee4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:16.659171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc24a3-deb2-42ab-bc40-15abc1b10ee4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:16.660930 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc24a3-deb2-42ab-bc40-15abc1b10ee4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:16.662498 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:16.668798 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e4c10-6058-45d0-834d-9fc6fcdd9b9a None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:16.683816 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e4c10-6058-45d0-834d-9fc6fcdd9b9a None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:16.691847 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ffa5a-c2be-4ca9-a394-230bd124b805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:16.692691 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ffa5a-c2be-4ca9-a394-230bd124b805 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:16.692997 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ffa5a-c2be-4ca9-a394-230bd124b805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:16.693269 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ffa5a-c2be-4ca9-a394-230bd124b805 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:16.694020 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ffa5a-c2be-4ca9-a394-230bd124b805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:16.695054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-317ffa5a-c2be-4ca9-a394-230bd124b805 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:16.695054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:48:16.695054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:48:16.696535 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ffa5a-c2be-4ca9-a394-230bd124b805 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:16.724781 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 31/60] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Nov 8 10:48:16 2021] POST /identity/v3/users => generated 275 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 10:48:20.132286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd1e65-f3f2-45e3-a1f3-f6f7a72babf1 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.133312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd1e65-f3f2-45e3-a1f3-f6f7a72babf1 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.133821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd1e65-f3f2-45e3-a1f3-f6f7a72babf1 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.136152 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 30/61] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:20.142483 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514bb2b-4046-4f4c-a58c-9d32356b0948 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.142948 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514bb2b-4046-4f4c-a58c-9d32356b0948 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.143023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514bb2b-4046-4f4c-a58c-9d32356b0948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.172261 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-d514bb2b-4046-4f4c-a58c-9d32356b0948 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:20.173488 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d514bb2b-4046-4f4c-a58c-9d32356b0948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:20.182230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 32/62] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:20.222305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd1e65-f3f2-45e3-a1f3-f6f7a72babf1 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.240815 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd1e65-f3f2-45e3-a1f3-f6f7a72babf1 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.245306 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd02a2-39b8-4d6a-ab8a-48794688abde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.246107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd02a2-39b8-4d6a-ab8a-48794688abde admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.246388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd02a2-39b8-4d6a-ab8a-48794688abde admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.246662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd02a2-39b8-4d6a-ab8a-48794688abde admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.251595 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715903a7-428b-4c8f-bb9d-a44ee684376d None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.252146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715903a7-428b-4c8f-bb9d-a44ee684376d None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.252617 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715903a7-428b-4c8f-bb9d-a44ee684376d None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.254771 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 33/63] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:20.263291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd02a2-39b8-4d6a-ab8a-48794688abde admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:20.270661 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-d7fd02a2-39b8-4d6a-ab8a-48794688abde admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:20.276521 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 31/64] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:20.278415 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f04c5-9080-46e3-bcc7-0fd6d0ccc47d None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.278706 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f04c5-9080-46e3-bcc7-0fd6d0ccc47d None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.278988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f04c5-9080-46e3-bcc7-0fd6d0ccc47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.282813 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd02a2-39b8-4d6a-ab8a-48794688abde admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.294922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd02a2-39b8-4d6a-ab8a-48794688abde admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.299524 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02e31b-4542-472d-af11-e4a293d7dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.300475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02e31b-4542-472d-af11-e4a293d7dee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.301111 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02e31b-4542-472d-af11-e4a293d7dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.301561 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02e31b-4542-472d-af11-e4a293d7dee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.302491 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02e31b-4542-472d-af11-e4a293d7dee6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:20.302957 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02e31b-4542-472d-af11-e4a293d7dee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.304780 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02e31b-4542-472d-af11-e4a293d7dee6 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.314246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 32/65] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:20.318248 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-629f04c5-9080-46e3-bcc7-0fd6d0ccc47d None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:20.318248 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-629f04c5-9080-46e3-bcc7-0fd6d0ccc47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:20.323440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02e31b-4542-472d-af11-e4a293d7dee6 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.336661 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 34/66] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:20.346914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02e31b-4542-472d-af11-e4a293d7dee6 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.351902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec20d99-5f7d-4df2-a9ec-f66edd244766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.352988 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20d99-5f7d-4df2-a9ec-f66edd244766 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.353447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20d99-5f7d-4df2-a9ec-f66edd244766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.353895 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20d99-5f7d-4df2-a9ec-f66edd244766 admin admin] PATH_INFO: `/v3/users/d269fd97a1de43ec94f4736b3f123e1c` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.374947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec20d99-5f7d-4df2-a9ec-f66edd244766 admin admin] RBAC: Authorizing `identity:get_user(user_id=d269fd97a1de43ec94f4736b3f123e1c)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.377449 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec20d99-5f7d-4df2-a9ec-f66edd244766 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.379652 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 33/67] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/users/d269fd97a1de43ec94f4736b3f123e1c => generated 275 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:20.385916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f04c5-9080-46e3-bcc7-0fd6d0ccc47d None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.401418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f04c5-9080-46e3-bcc7-0fd6d0ccc47d None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.406564 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d3024-dcdf-4f5b-9311-85f3a56b3461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.407637 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d3024-dcdf-4f5b-9311-85f3a56b3461 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.408129 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d3024-dcdf-4f5b-9311-85f3a56b3461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.408585 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d3024-dcdf-4f5b-9311-85f3a56b3461 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.421126 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec20d99-5f7d-4df2-a9ec-f66edd244766 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.434870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec20d99-5f7d-4df2-a9ec-f66edd244766 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.436493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d3024-dcdf-4f5b-9311-85f3a56b3461 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.438397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d3024-dcdf-4f5b-9311-85f3a56b3461 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.440469 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e1f02-f7b8-41df-8564-23b9d50b4fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.441632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e1f02-f7b8-41df-8564-23b9d50b4fbd admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.442113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e1f02-f7b8-41df-8564-23b9d50b4fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.442624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e1f02-f7b8-41df-8564-23b9d50b4fbd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.456396 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e1f02-f7b8-41df-8564-23b9d50b4fbd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:20.459002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 35/68] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:20.464415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-859e1f02-f7b8-41df-8564-23b9d50b4fbd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:48:20.472538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:20.475864 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d3024-dcdf-4f5b-9311-85f3a56b3461 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.475994 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e1f02-f7b8-41df-8564-23b9d50b4fbd admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.487993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e1f02-f7b8-41df-8564-23b9d50b4fbd admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.494268 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30d3d7-3a74-417c-b952-f230397c3b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.495230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30d3d7-3a74-417c-b952-f230397c3b2f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.495656 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30d3d7-3a74-417c-b952-f230397c3b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.496073 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30d3d7-3a74-417c-b952-f230397c3b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.496985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30d3d7-3a74-417c-b952-f230397c3b2f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:20.497452 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30d3d7-3a74-417c-b952-f230397c3b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.497633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d3024-dcdf-4f5b-9311-85f3a56b3461 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.499493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30d3d7-3a74-417c-b952-f230397c3b2f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.514461 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 35/70] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:20.515513 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7cb1f-f8f8-4355-ac72-90d8795b5455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.516128 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30d3d7-3a74-417c-b952-f230397c3b2f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.516410 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7cb1f-f8f8-4355-ac72-90d8795b5455 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.517071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7cb1f-f8f8-4355-ac72-90d8795b5455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.517352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7cb1f-f8f8-4355-ac72-90d8795b5455 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.518655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7cb1f-f8f8-4355-ac72-90d8795b5455 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.520792 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7cb1f-f8f8-4355-ac72-90d8795b5455 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.522491 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:20.527686 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30d3d7-3a74-417c-b952-f230397c3b2f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.528970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7cb1f-f8f8-4355-ac72-90d8795b5455 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.532614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c410506-6ea7-41b0-88a1-c5df4cf213f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.533674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c410506-6ea7-41b0-88a1-c5df4cf213f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.534102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c410506-6ea7-41b0-88a1-c5df4cf213f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.534550 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c410506-6ea7-41b0-88a1-c5df4cf213f0 admin admin] PATH_INFO: `/v3/users/23015594a30b49b885e3a6236f3a6f37` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.536044 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c410506-6ea7-41b0-88a1-c5df4cf213f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=23015594a30b49b885e3a6236f3a6f37)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.538073 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c410506-6ea7-41b0-88a1-c5df4cf213f0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.539866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 36/72] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/users/23015594a30b49b885e3a6236f3a6f37 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:20.545973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c410506-6ea7-41b0-88a1-c5df4cf213f0 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.549613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7cb1f-f8f8-4355-ac72-90d8795b5455 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.557004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c410506-6ea7-41b0-88a1-c5df4cf213f0 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.562026 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eeee39-07c9-4b83-8ff8-b2f14d5fc245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.562913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeee39-07c9-4b83-8ff8-b2f14d5fc245 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.563427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeee39-07c9-4b83-8ff8-b2f14d5fc245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.563998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeee39-07c9-4b83-8ff8-b2f14d5fc245 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.564381 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d981671-aa2c-42b5-97ac-45fdd92a90df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.565061 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981671-aa2c-42b5-97ac-45fdd92a90df admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.565355 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981671-aa2c-42b5-97ac-45fdd92a90df admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.565778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981671-aa2c-42b5-97ac-45fdd92a90df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.566632 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d981671-aa2c-42b5-97ac-45fdd92a90df admin admin] RBAC: Adding query filter params (role.id=2dce671f5a1a43da869724374e62098b, scope.project.id=d6453f0e70ff411fbd16c7407a3e8446, user.id=d269fd97a1de43ec94f4736b3f123e1c) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:20.566952 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d981671-aa2c-42b5-97ac-45fdd92a90df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.568881 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d981671-aa2c-42b5-97ac-45fdd92a90df admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.574202 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eeee39-07c9-4b83-8ff8-b2f14d5fc245 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.576251 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eeee39-07c9-4b83-8ff8-b2f14d5fc245 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.585707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 37/73] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 08 10:48:20.589308 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 37/74] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/role_assignments?user.id=d269fd97a1de43ec94f4736b3f123e1c&scope.project.id=d6453f0e70ff411fbd16c7407a3e8446&role.id=2dce671f5a1a43da869724374e62098b => generated 259 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:20.592651 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d981671-aa2c-42b5-97ac-45fdd92a90df admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.604880 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d981671-aa2c-42b5-97ac-45fdd92a90df admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.612395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fbebe-ed10-4568-b4db-468d18692784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.613965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fbebe-ed10-4568-b4db-468d18692784 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.614484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fbebe-ed10-4568-b4db-468d18692784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.614958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fbebe-ed10-4568-b4db-468d18692784 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.621904 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf926bf-ef1a-4a3c-b28a-82ce2112df1f None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.622604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf926bf-ef1a-4a3c-b28a-82ce2112df1f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.623081 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf926bf-ef1a-4a3c-b28a-82ce2112df1f None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.625216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 38/75] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:20.626475 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fbebe-ed10-4568-b4db-468d18692784 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.629434 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fbebe-ed10-4568-b4db-468d18692784 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.632305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cf70a-2eba-43f5-90a7-a185178f66db None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.632840 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cf70a-2eba-43f5-90a7-a185178f66db None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.632942 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 38/76] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:20.637091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93a1e9-fcbd-4a3e-af92-856e0669c8d1 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.637091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93a1e9-fcbd-4a3e-af92-856e0669c8d1 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.637091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93a1e9-fcbd-4a3e-af92-856e0669c8d1 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.637091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 39/77] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:20.637371 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cf70a-2eba-43f5-90a7-a185178f66db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.644862 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93a1e9-fcbd-4a3e-af92-856e0669c8d1 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.658968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-415cf70a-2eba-43f5-90a7-a185178f66db None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:20.659930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93a1e9-fcbd-4a3e-af92-856e0669c8d1 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.660405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-415cf70a-2eba-43f5-90a7-a185178f66db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:20.665811 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef699e-3c1c-4a4a-9cec-e2622db344af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.667095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef699e-3c1c-4a4a-9cec-e2622db344af admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.667677 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef699e-3c1c-4a4a-9cec-e2622db344af admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.668157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef699e-3c1c-4a4a-9cec-e2622db344af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.669246 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef699e-3c1c-4a4a-9cec-e2622db344af admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=d6453f0e70ff411fbd16c7407a3e8446, user.id=23015594a30b49b885e3a6236f3a6f37) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:20.669890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef699e-3c1c-4a4a-9cec-e2622db344af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.672227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef699e-3c1c-4a4a-9cec-e2622db344af admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.675358 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 39/78] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:20.677501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f28aa-3bf0-4177-99f6-43de15d985e7 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.677802 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f28aa-3bf0-4177-99f6-43de15d985e7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.678087 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f28aa-3bf0-4177-99f6-43de15d985e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.685578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 40/79] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/role_assignments?user.id=23015594a30b49b885e3a6236f3a6f37&scope.project.id=d6453f0e70ff411fbd16c7407a3e8446&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:20.694245 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef699e-3c1c-4a4a-9cec-e2622db344af admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.708857 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef699e-3c1c-4a4a-9cec-e2622db344af admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.710279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-6f8f28aa-3bf0-4177-99f6-43de15d985e7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:20.711765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6f8f28aa-3bf0-4177-99f6-43de15d985e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:20.716568 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4428-88f8-484f-b82f-08f2c010b1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.717535 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4428-88f8-484f-b82f-08f2c010b1db admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.717826 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4428-88f8-484f-b82f-08f2c010b1db admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.718108 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4428-88f8-484f-b82f-08f2c010b1db admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.721611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 40/80] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:20.744473 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd4428-88f8-484f-b82f-08f2c010b1db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:20.747774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f28aa-3bf0-4177-99f6-43de15d985e7 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.752580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-a7dd4428-88f8-484f-b82f-08f2c010b1db admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 08 10:48:20.754012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 41/81] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:20.759487 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f28aa-3bf0-4177-99f6-43de15d985e7 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.761122 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4428-88f8-484f-b82f-08f2c010b1db admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.765242 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad97813-0d1e-46d4-84e9-173761c66ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.766442 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad97813-0d1e-46d4-84e9-173761c66ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.767351 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad97813-0d1e-46d4-84e9-173761c66ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.767894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad97813-0d1e-46d4-84e9-173761c66ad0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.773337 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4428-88f8-484f-b82f-08f2c010b1db admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.779252 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389f7b2-b404-4cf1-a04b-5481e47641fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.780077 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389f7b2-b404-4cf1-a04b-5481e47641fc admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.780433 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389f7b2-b404-4cf1-a04b-5481e47641fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.780799 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389f7b2-b404-4cf1-a04b-5481e47641fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.781985 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389f7b2-b404-4cf1-a04b-5481e47641fc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:20.782302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389f7b2-b404-4cf1-a04b-5481e47641fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.782402 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad97813-0d1e-46d4-84e9-173761c66ad0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:20.784104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389f7b2-b404-4cf1-a04b-5481e47641fc admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.790719 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-7ad97813-0d1e-46d4-84e9-173761c66ad0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:20.792208 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 41/82] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:20.797484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 42/83] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:20.799176 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad97813-0d1e-46d4-84e9-173761c66ad0 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.801760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389f7b2-b404-4cf1-a04b-5481e47641fc admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.809602 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad97813-0d1e-46d4-84e9-173761c66ad0 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.814131 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389f7b2-b404-4cf1-a04b-5481e47641fc admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.814663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7a595-0dd8-4ef8-96d4-eb8fe0dd8e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.815631 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7a595-0dd8-4ef8-96d4-eb8fe0dd8e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.815968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7a595-0dd8-4ef8-96d4-eb8fe0dd8e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.816407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7a595-0dd8-4ef8-96d4-eb8fe0dd8e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.817312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7a595-0dd8-4ef8-96d4-eb8fe0dd8e2c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:20.817707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7a595-0dd8-4ef8-96d4-eb8fe0dd8e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.819633 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7a595-0dd8-4ef8-96d4-eb8fe0dd8e2c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.820104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b0c6d-099d-4202-9308-22c2c056e351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.821197 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b0c6d-099d-4202-9308-22c2c056e351 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.821904 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b0c6d-099d-4202-9308-22c2c056e351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.822331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b0c6d-099d-4202-9308-22c2c056e351 admin admin] PATH_INFO: `/v3/users/d269fd97a1de43ec94f4736b3f123e1c` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.824348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b0c6d-099d-4202-9308-22c2c056e351 admin admin] RBAC: Authorizing `identity:get_user(user_id=d269fd97a1de43ec94f4736b3f123e1c)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.826777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b0c6d-099d-4202-9308-22c2c056e351 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.834527 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 42/85] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:20.834527 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b0e40-0fe0-44c1-930e-e76fd7672d1f None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.834527 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b0e40-0fe0-44c1-930e-e76fd7672d1f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.834527 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b0e40-0fe0-44c1-930e-e76fd7672d1f None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.834973 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 43/85] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/users/d269fd97a1de43ec94f4736b3f123e1c => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:20.837445 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b0c6d-099d-4202-9308-22c2c056e351 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.840857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 43/86] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:20 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:20.841906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b0e40-0fe0-44c1-930e-e76fd7672d1f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.849953 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b0c6d-099d-4202-9308-22c2c056e351 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.856060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b0e40-0fe0-44c1-930e-e76fd7672d1f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.856666 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c282c-7aba-4645-a12c-5dc46779a8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.857708 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c282c-7aba-4645-a12c-5dc46779a8dd admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.858224 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c282c-7aba-4645-a12c-5dc46779a8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.858712 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c282c-7aba-4645-a12c-5dc46779a8dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.861593 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfe559-fe3f-454d-af5c-021ca2aa2640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.862982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfe559-fe3f-454d-af5c-021ca2aa2640 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.863468 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfe559-fe3f-454d-af5c-021ca2aa2640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.863886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfe559-fe3f-454d-af5c-021ca2aa2640 admin admin] PATH_INFO: `/v3/users/d269fd97a1de43ec94f4736b3f123e1c` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.865431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfe559-fe3f-454d-af5c-021ca2aa2640 admin admin] RBAC: Authorizing `identity:get_user(user_id=d269fd97a1de43ec94f4736b3f123e1c)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.868630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfe559-fe3f-454d-af5c-021ca2aa2640 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.870633 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 44/87] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/users/d269fd97a1de43ec94f4736b3f123e1c => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:20.870860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c282c-7aba-4645-a12c-5dc46779a8dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.872784 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c282c-7aba-4645-a12c-5dc46779a8dd admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.876243 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dc7d4-65a0-4a16-b8e9-db33a187542c None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.876767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dc7d4-65a0-4a16-b8e9-db33a187542c None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.877059 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dc7d4-65a0-4a16-b8e9-db33a187542c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.884066 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 44/88] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 08 10:48:20.884798 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c282c-7aba-4645-a12c-5dc46779a8dd admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.897572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c282c-7aba-4645-a12c-5dc46779a8dd admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.903017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19031542-299e-4c33-a460-76d7ceb22ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.903649 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-964dc7d4-65a0-4a16-b8e9-db33a187542c None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:20.904399 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19031542-299e-4c33-a460-76d7ceb22ada admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.904900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-964dc7d4-65a0-4a16-b8e9-db33a187542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:20.905124 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19031542-299e-4c33-a460-76d7ceb22ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.905672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19031542-299e-4c33-a460-76d7ceb22ada admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.913321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 45/89] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:20.914001 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dc7d4-65a0-4a16-b8e9-db33a187542c None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.917795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19031542-299e-4c33-a460-76d7ceb22ada admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.920170 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19031542-299e-4c33-a460-76d7ceb22ada admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.931454 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 45/90] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:20.940331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19031542-299e-4c33-a460-76d7ceb22ada admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.946938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dc7d4-65a0-4a16-b8e9-db33a187542c None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.954702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19031542-299e-4c33-a460-76d7ceb22ada admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.957724 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4704e3f-b3f8-46a4-9f7d-bf7c5f0efb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.959257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4704e3f-b3f8-46a4-9f7d-bf7c5f0efb97 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.959490 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b88682-6c80-4fa7-b7ee-db6e93e102b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.959989 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4704e3f-b3f8-46a4-9f7d-bf7c5f0efb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.960368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b88682-6c80-4fa7-b7ee-db6e93e102b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.960656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b88682-6c80-4fa7-b7ee-db6e93e102b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.960907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4704e3f-b3f8-46a4-9f7d-bf7c5f0efb97 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.961001 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b88682-6c80-4fa7-b7ee-db6e93e102b5 admin admin] PATH_INFO: `/v3/projects/46af80d1a68f413e90039caa63e95d3d` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.962161 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b88682-6c80-4fa7-b7ee-db6e93e102b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=46af80d1a68f413e90039caa63e95d3d)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.962946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4704e3f-b3f8-46a4-9f7d-bf7c5f0efb97 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.964323 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b88682-6c80-4fa7-b7ee-db6e93e102b5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.965686 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4704e3f-b3f8-46a4-9f7d-bf7c5f0efb97 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.966068 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 46/91] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/projects/46af80d1a68f413e90039caa63e95d3d => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:20.966852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b88682-6c80-4fa7-b7ee-db6e93e102b5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.968267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 46/92] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:20.978969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4704e3f-b3f8-46a4-9f7d-bf7c5f0efb97 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.982601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b88682-6c80-4fa7-b7ee-db6e93e102b5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.987814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5820295-e01e-4ecb-b7ff-b9088e0c9c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.989739 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5820295-e01e-4ecb-b7ff-b9088e0c9c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:20.989739 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5820295-e01e-4ecb-b7ff-b9088e0c9c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:20.989901 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5820295-e01e-4ecb-b7ff-b9088e0c9c3a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:20.990282 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4704e3f-b3f8-46a4-9f7d-bf7c5f0efb97 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:20.991866 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5820295-e01e-4ecb-b7ff-b9088e0c9c3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:20.993408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5820295-e01e-4ecb-b7ff-b9088e0c9c3a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:20.995033 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 47/93] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:20.995822 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5820295-e01e-4ecb-b7ff-b9088e0c9c3a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:20.998826 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf8716-e835-4e68-ab06-c278bcbcf8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:20.999778 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf8716-e835-4e68-ab06-c278bcbcf8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:21.000403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf8716-e835-4e68-ab06-c278bcbcf8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:21.000872 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf8716-e835-4e68-ab06-c278bcbcf8f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:21.002743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf8716-e835-4e68-ab06-c278bcbcf8f1 admin admin] RBAC: Adding query filter params (role.id=2dce671f5a1a43da869724374e62098b, scope.project.id=46af80d1a68f413e90039caa63e95d3d, user.id=d269fd97a1de43ec94f4736b3f123e1c) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:21.003626 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf8716-e835-4e68-ab06-c278bcbcf8f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:21.006065 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf8716-e835-4e68-ab06-c278bcbcf8f1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:21.006375 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5820295-e01e-4ecb-b7ff-b9088e0c9c3a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:21.010980 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4277e-283a-4fdf-881b-0f73bee0ce0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:21.011754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4277e-283a-4fdf-881b-0f73bee0ce0f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:21.012037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4277e-283a-4fdf-881b-0f73bee0ce0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:21.012311 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4277e-283a-4fdf-881b-0f73bee0ce0f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:21.013312 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4277e-283a-4fdf-881b-0f73bee0ce0f admin admin] RBAC: Adding query filter params (role.id=a4a3a42f23b2463ebc5e198fe56ac656, scope.project.id=d6453f0e70ff411fbd16c7407a3e8446, user.id=d269fd97a1de43ec94f4736b3f123e1c) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:21.013621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4277e-283a-4fdf-881b-0f73bee0ce0f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:21.013858 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 47/94] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/role_assignments?user.id=d269fd97a1de43ec94f4736b3f123e1c&scope.project.id=46af80d1a68f413e90039caa63e95d3d&role.id=2dce671f5a1a43da869724374e62098b => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:21.014893 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf8716-e835-4e68-ab06-c278bcbcf8f1 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:21.020495 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4277e-283a-4fdf-881b-0f73bee0ce0f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:21.038868 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf8716-e835-4e68-ab06-c278bcbcf8f1 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:21.043292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 48/95] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:20 2021] GET /identity/v3/role_assignments?user.id=d269fd97a1de43ec94f4736b3f123e1c&scope.project.id=d6453f0e70ff411fbd16c7407a3e8446&role.id=a4a3a42f23b2463ebc5e198fe56ac656 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:21.051824 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095413b-b667-43d0-a22d-66485903951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:21.052899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095413b-b667-43d0-a22d-66485903951d admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:21.053384 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095413b-b667-43d0-a22d-66485903951d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:21.053856 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095413b-b667-43d0-a22d-66485903951d admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:21.054808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095413b-b667-43d0-a22d-66485903951d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:21.057080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095413b-b667-43d0-a22d-66485903951d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:21.103367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 48/96] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Nov 8 10:48:21 2021] POST /identity/v3/projects => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:48:23.322352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327aeea-f7a3-4695-b425-1facf778b498 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.322947 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327aeea-f7a3-4695-b425-1facf778b498 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.323249 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327aeea-f7a3-4695-b425-1facf778b498 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.325306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 49/97] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:23.331768 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cb79e-a33a-49ea-84a0-9f09e9ef315d None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.332373 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cb79e-a33a-49ea-84a0-9f09e9ef315d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.332501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cb79e-a33a-49ea-84a0-9f09e9ef315d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.359160 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-d89cb79e-a33a-49ea-84a0-9f09e9ef315d None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:23.360395 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d89cb79e-a33a-49ea-84a0-9f09e9ef315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:23.438924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 49/98] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:23.486466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327aeea-f7a3-4695-b425-1facf778b498 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:23.508757 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327aeea-f7a3-4695-b425-1facf778b498 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:23.518349 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb8527-7dc5-40db-83fd-6a6a0f35d5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:23.519234 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb8527-7dc5-40db-83fd-6a6a0f35d5fd admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.519527 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb8527-7dc5-40db-83fd-6a6a0f35d5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.519809 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb8527-7dc5-40db-83fd-6a6a0f35d5fd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.540780 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb8527-7dc5-40db-83fd-6a6a0f35d5fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:23.547652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-aedb8527-7dc5-40db-83fd-6a6a0f35d5fd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:48:23.548889 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 50/99] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:48:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:23.555573 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cb79e-a33a-49ea-84a0-9f09e9ef315d None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:23.568580 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cb79e-a33a-49ea-84a0-9f09e9ef315d None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:23.579883 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826911af-c289-40a5-b83b-8ec8ff25781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:23.580510 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826911af-c289-40a5-b83b-8ec8ff25781e admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.580798 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826911af-c289-40a5-b83b-8ec8ff25781e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.581128 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826911af-c289-40a5-b83b-8ec8ff25781e admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.581916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826911af-c289-40a5-b83b-8ec8ff25781e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:23.582228 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826911af-c289-40a5-b83b-8ec8ff25781e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:23.583936 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826911af-c289-40a5-b83b-8ec8ff25781e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:23.593363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c58d9-9368-42ad-a899-922cb0a2bd74 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.593363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c58d9-9368-42ad-a899-922cb0a2bd74 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.593363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c58d9-9368-42ad-a899-922cb0a2bd74 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.593649 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 50/100] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:23.594702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 51/101] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:23.599639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826911af-c289-40a5-b83b-8ec8ff25781e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:23.601434 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3d18b-b40d-4337-9cf0-dc26d70c3b23 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.601730 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3d18b-b40d-4337-9cf0-dc26d70c3b23 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.602015 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3d18b-b40d-4337-9cf0-dc26d70c3b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.615515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826911af-c289-40a5-b83b-8ec8ff25781e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:23.625987 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834a4f0-d6e4-44b0-bb13-12f582c220d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:23.627324 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834a4f0-d6e4-44b0-bb13-12f582c220d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.629251 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834a4f0-d6e4-44b0-bb13-12f582c220d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.629798 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834a4f0-d6e4-44b0-bb13-12f582c220d0 admin admin] PATH_INFO: `/v3/users/23015594a30b49b885e3a6236f3a6f37` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.631454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834a4f0-d6e4-44b0-bb13-12f582c220d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=23015594a30b49b885e3a6236f3a6f37)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:23.633608 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834a4f0-d6e4-44b0-bb13-12f582c220d0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:23.635668 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 51/102] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:23 2021] GET /identity/v3/users/23015594a30b49b885e3a6236f3a6f37 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:23.640219 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-cfd3d18b-b40d-4337-9cf0-dc26d70c3b23 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:23.642128 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-cfd3d18b-b40d-4337-9cf0-dc26d70c3b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:23.643345 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834a4f0-d6e4-44b0-bb13-12f582c220d0 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:23.659817 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834a4f0-d6e4-44b0-bb13-12f582c220d0 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:23.661606 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 52/103] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:23.666272 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f304aa-064d-40d9-90a2-a276efa4f08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:23.667445 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f304aa-064d-40d9-90a2-a276efa4f08a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.667935 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f304aa-064d-40d9-90a2-a276efa4f08a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.668408 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f304aa-064d-40d9-90a2-a276efa4f08a admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.669790 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f304aa-064d-40d9-90a2-a276efa4f08a admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:23.672090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f304aa-064d-40d9-90a2-a276efa4f08a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:23.674274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 52/104] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:23 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:23.680831 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3d18b-b40d-4337-9cf0-dc26d70c3b23 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:23.692084 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3d18b-b40d-4337-9cf0-dc26d70c3b23 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:23.693335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f304aa-064d-40d9-90a2-a276efa4f08a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:23.702631 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36546c4-d56f-4d3d-9d12-96c23c06c5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:23.703844 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36546c4-d56f-4d3d-9d12-96c23c06c5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.705375 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36546c4-d56f-4d3d-9d12-96c23c06c5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.705859 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36546c4-d56f-4d3d-9d12-96c23c06c5b0 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446/users/23015594a30b49b885e3a6236f3a6f37/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.709168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36546c4-d56f-4d3d-9d12-96c23c06c5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6453f0e70ff411fbd16c7407a3e8446, user_id=23015594a30b49b885e3a6236f3a6f37, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:23.712335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36546c4-d56f-4d3d-9d12-96c23c06c5b0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:23.714693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f304aa-064d-40d9-90a2-a276efa4f08a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:23.722633 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569aba46-4794-420a-86f4-a52ccb185f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:23.724308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569aba46-4794-420a-86f4-a52ccb185f46 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.724799 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569aba46-4794-420a-86f4-a52ccb185f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.725287 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569aba46-4794-420a-86f4-a52ccb185f46 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.744129 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 53/105] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:48:23 2021] PUT /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446/users/23015594a30b49b885e3a6236f3a6f37/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:48:23.744615 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569aba46-4794-420a-86f4-a52ccb185f46 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:23.753304 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-569aba46-4794-420a-86f4-a52ccb185f46 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:23.755156 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 53/106] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:23.762729 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36546c4-d56f-4d3d-9d12-96c23c06c5b0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:23.764834 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3686c-c624-4b71-8d64-133b27c9b98d None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.765362 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3686c-c624-4b71-8d64-133b27c9b98d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.766020 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3686c-c624-4b71-8d64-133b27c9b98d None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.768729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 54/107] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:23.777603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dec83-da12-4b06-9e37-42f6aaa723cb None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.778531 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dec83-da12-4b06-9e37-42f6aaa723cb None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.779151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dec83-da12-4b06-9e37-42f6aaa723cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.802301 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-464dec83-da12-4b06-9e37-42f6aaa723cb None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:23.804037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-464dec83-da12-4b06-9e37-42f6aaa723cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:23.877809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 55/108] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:23.904806 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36546c4-d56f-4d3d-9d12-96c23c06c5b0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:23.915676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150353b-1c87-4131-bf96-782c4a46ffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:23.916366 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150353b-1c87-4131-bf96-782c4a46ffd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.916657 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150353b-1c87-4131-bf96-782c4a46ffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.916940 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150353b-1c87-4131-bf96-782c4a46ffd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.917740 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150353b-1c87-4131-bf96-782c4a46ffd6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:23.918054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150353b-1c87-4131-bf96-782c4a46ffd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:23.923991 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150353b-1c87-4131-bf96-782c4a46ffd6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:23.934104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 54/109] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:23.936959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dec83-da12-4b06-9e37-42f6aaa723cb None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:23.941298 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150353b-1c87-4131-bf96-782c4a46ffd6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:23.950969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dec83-da12-4b06-9e37-42f6aaa723cb None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:23.955907 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150353b-1c87-4131-bf96-782c4a46ffd6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:23.962349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432551de-51ed-436c-8c25-186fb2d1ec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:23.963231 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432551de-51ed-436c-8c25-186fb2d1ec3d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.963519 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432551de-51ed-436c-8c25-186fb2d1ec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.963797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432551de-51ed-436c-8c25-186fb2d1ec3d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.964999 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df75ac-c552-47d8-8bc2-b45f6145a799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:23.965953 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df75ac-c552-47d8-8bc2-b45f6145a799 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:23.966231 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df75ac-c552-47d8-8bc2-b45f6145a799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:23.966521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df75ac-c552-47d8-8bc2-b45f6145a799 admin admin] PATH_INFO: `/v3/users/d269fd97a1de43ec94f4736b3f123e1c` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:23.968142 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df75ac-c552-47d8-8bc2-b45f6145a799 admin admin] RBAC: Authorizing `identity:get_user(user_id=d269fd97a1de43ec94f4736b3f123e1c)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:23.970422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df75ac-c552-47d8-8bc2-b45f6145a799 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:23.976795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 55/110] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:23 2021] GET /identity/v3/users/d269fd97a1de43ec94f4736b3f123e1c => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:23.980183 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df75ac-c552-47d8-8bc2-b45f6145a799 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:23.995117 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432551de-51ed-436c-8c25-186fb2d1ec3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:24.002173 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-432551de-51ed-436c-8c25-186fb2d1ec3d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:24.003922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 56/111] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:24.004863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df75ac-c552-47d8-8bc2-b45f6145a799 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:24.010331 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432551de-51ed-436c-8c25-186fb2d1ec3d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:24.014074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bbbd3-2154-4258-9c65-2228982e6a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:24.015066 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bbbd3-2154-4258-9c65-2228982e6a9f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.015408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bbbd3-2154-4258-9c65-2228982e6a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.015690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bbbd3-2154-4258-9c65-2228982e6a9f admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.017905 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bbbd3-2154-4258-9c65-2228982e6a9f admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:24.020819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bbbd3-2154-4258-9c65-2228982e6a9f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:24.021236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432551de-51ed-436c-8c25-186fb2d1ec3d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:24.023189 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 56/112] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:23 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:24.024709 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf901-0f00-4d79-9f11-3fee1ecb75eb None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.025217 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf901-0f00-4d79-9f11-3fee1ecb75eb None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.025663 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf901-0f00-4d79-9f11-3fee1ecb75eb None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.026481 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a8174-cb33-4adb-a085-dd04214ed781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:24.027185 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a8174-cb33-4adb-a085-dd04214ed781 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.027482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a8174-cb33-4adb-a085-dd04214ed781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.027764 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a8174-cb33-4adb-a085-dd04214ed781 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.028564 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 57/113] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:24.028671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a8174-cb33-4adb-a085-dd04214ed781 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:24.028969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a8174-cb33-4adb-a085-dd04214ed781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:24.029695 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf901-0f00-4d79-9f11-3fee1ecb75eb None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:24.034725 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a8174-cb33-4adb-a085-dd04214ed781 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:24.041149 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 57/114] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:24.042569 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a407-6dd1-4581-a11a-ee577946322e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.042869 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a407-6dd1-4581-a11a-ee577946322e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.043183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a407-6dd1-4581-a11a-ee577946322e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.048305 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf901-0f00-4d79-9f11-3fee1ecb75eb None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:24.053209 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61ba16-19f5-46db-8626-eb7625a9782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:24.054474 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61ba16-19f5-46db-8626-eb7625a9782c admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.054971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61ba16-19f5-46db-8626-eb7625a9782c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.055473 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61ba16-19f5-46db-8626-eb7625a9782c admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446/users/d269fd97a1de43ec94f4736b3f123e1c/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.057750 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61ba16-19f5-46db-8626-eb7625a9782c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6453f0e70ff411fbd16c7407a3e8446, user_id=d269fd97a1de43ec94f4736b3f123e1c, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:24.061096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61ba16-19f5-46db-8626-eb7625a9782c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:24.061478 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-43b1a407-6dd1-4581-a11a-ee577946322e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:24.062696 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-43b1a407-6dd1-4581-a11a-ee577946322e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:24.072627 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 58/115] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:24.073804 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1a407-6dd1-4581-a11a-ee577946322e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:24.083489 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 58/116] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:48:24 2021] PUT /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446/users/d269fd97a1de43ec94f4736b3f123e1c/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:48:24.084924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1a407-6dd1-4581-a11a-ee577946322e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:24.104610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61ba16-19f5-46db-8626-eb7625a9782c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:24.146600 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa188d17-ce78-435c-83e4-975cf893777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:24.147615 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa188d17-ce78-435c-83e4-975cf893777a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.147980 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa188d17-ce78-435c-83e4-975cf893777a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.148357 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa188d17-ce78-435c-83e4-975cf893777a admin admin] PATH_INFO: `/v3/users/d269fd97a1de43ec94f4736b3f123e1c` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.149750 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa188d17-ce78-435c-83e4-975cf893777a admin admin] RBAC: Authorizing `identity:get_user(user_id=d269fd97a1de43ec94f4736b3f123e1c)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:24.152094 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa188d17-ce78-435c-83e4-975cf893777a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:24.153912 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 59/117] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:24 2021] GET /identity/v3/users/d269fd97a1de43ec94f4736b3f123e1c => generated 275 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:24.155484 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec236a-9a0d-4a34-b50e-bded45bc4dc4 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.155862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec236a-9a0d-4a34-b50e-bded45bc4dc4 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.156187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec236a-9a0d-4a34-b50e-bded45bc4dc4 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.157953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 60/118] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:24.164014 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec236a-9a0d-4a34-b50e-bded45bc4dc4 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:24.178472 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec236a-9a0d-4a34-b50e-bded45bc4dc4 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:24.183226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61ba16-19f5-46db-8626-eb7625a9782c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:24.183496 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c187580-c46c-43d3-a1c5-6ede1146222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:24.184699 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c187580-c46c-43d3-a1c5-6ede1146222b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.185062 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c187580-c46c-43d3-a1c5-6ede1146222b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.185342 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c187580-c46c-43d3-a1c5-6ede1146222b admin admin] PATH_INFO: `/v3/projects/46af80d1a68f413e90039caa63e95d3d` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.186789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c187580-c46c-43d3-a1c5-6ede1146222b admin admin] RBAC: Authorizing `identity:get_project(project_id=46af80d1a68f413e90039caa63e95d3d)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:24.189160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0ed2c-9a33-4fab-a63c-b1688d2988c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:24.189491 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c187580-c46c-43d3-a1c5-6ede1146222b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:24.190640 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0ed2c-9a33-4fab-a63c-b1688d2988c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.191163 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0ed2c-9a33-4fab-a63c-b1688d2988c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.191630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0ed2c-9a33-4fab-a63c-b1688d2988c8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.191727 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 61/119] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:24 2021] GET /identity/v3/projects/46af80d1a68f413e90039caa63e95d3d => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:24.193264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccb532-6ed9-42ad-b07e-9bba9a3f40bd None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.193548 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccb532-6ed9-42ad-b07e-9bba9a3f40bd None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.193830 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccb532-6ed9-42ad-b07e-9bba9a3f40bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.204756 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0ed2c-9a33-4fab-a63c-b1688d2988c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:24.212609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-2be0ed2c-9a33-4fab-a63c-b1688d2988c8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 08 10:48:24.214244 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 59/120] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:48:24 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:24.214734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-43ccb532-6ed9-42ad-b07e-9bba9a3f40bd None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:24.220640 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-43ccb532-6ed9-42ad-b07e-9bba9a3f40bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:24.220812 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0ed2c-9a33-4fab-a63c-b1688d2988c8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:24.229334 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 62/121] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:24.233116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0ed2c-9a33-4fab-a63c-b1688d2988c8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:24.235007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccb532-6ed9-42ad-b07e-9bba9a3f40bd None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:24.238899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eebd98-674a-4e1b-aced-ec060fe8e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:24.240234 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eebd98-674a-4e1b-aced-ec060fe8e811 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.240779 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eebd98-674a-4e1b-aced-ec060fe8e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.241287 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eebd98-674a-4e1b-aced-ec060fe8e811 admin admin] PATH_INFO: `/v3/projects/46af80d1a68f413e90039caa63e95d3d/users/d269fd97a1de43ec94f4736b3f123e1c/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.243806 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eebd98-674a-4e1b-aced-ec060fe8e811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46af80d1a68f413e90039caa63e95d3d, user_id=d269fd97a1de43ec94f4736b3f123e1c, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:24.247240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eebd98-674a-4e1b-aced-ec060fe8e811 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:24.256078 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccb532-6ed9-42ad-b07e-9bba9a3f40bd None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:24.264789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b83cd-a771-42ea-b6aa-c4efeb961fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:24.265545 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b83cd-a771-42ea-b6aa-c4efeb961fdf admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.265836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b83cd-a771-42ea-b6aa-c4efeb961fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.266114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b83cd-a771-42ea-b6aa-c4efeb961fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.267301 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b83cd-a771-42ea-b6aa-c4efeb961fdf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:24.267658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 60/122] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:48:24 2021] PUT /identity/v3/projects/46af80d1a68f413e90039caa63e95d3d/users/d269fd97a1de43ec94f4736b3f123e1c/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:48:24.268818 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b83cd-a771-42ea-b6aa-c4efeb961fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:24.270574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b83cd-a771-42ea-b6aa-c4efeb961fdf admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:24.289721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 63/123] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:24 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:24.291290 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eebd98-674a-4e1b-aced-ec060fe8e811 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:24.306399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b83cd-a771-42ea-b6aa-c4efeb961fdf admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:24.322586 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b83cd-a771-42ea-b6aa-c4efeb961fdf admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:24.368446 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eebd98-674a-4e1b-aced-ec060fe8e811 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:24.384021 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67d884-578b-4a05-978f-6db771e45a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:24.387412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67d884-578b-4a05-978f-6db771e45a49 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.387990 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67d884-578b-4a05-978f-6db771e45a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.390431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67d884-578b-4a05-978f-6db771e45a49 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.392623 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67d884-578b-4a05-978f-6db771e45a49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:24.397114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67d884-578b-4a05-978f-6db771e45a49 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:24.402613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 61/124] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:24.412326 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67d884-578b-4a05-978f-6db771e45a49 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:24.426645 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67d884-578b-4a05-978f-6db771e45a49 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:24.431625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f57a3-57a3-4a97-818b-ec71cde99eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:24.432427 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f57a3-57a3-4a97-818b-ec71cde99eab admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.432764 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f57a3-57a3-4a97-818b-ec71cde99eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.433048 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f57a3-57a3-4a97-818b-ec71cde99eab admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.433868 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f57a3-57a3-4a97-818b-ec71cde99eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:24.434512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4b615-45d5-4da6-8195-f1e0eb12cd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:24.436016 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f57a3-57a3-4a97-818b-ec71cde99eab admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:24.436131 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4b615-45d5-4da6-8195-f1e0eb12cd4e admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.436604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4b615-45d5-4da6-8195-f1e0eb12cd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.437095 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4b615-45d5-4da6-8195-f1e0eb12cd4e admin admin] PATH_INFO: `/v3/users/d269fd97a1de43ec94f4736b3f123e1c` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.438743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4b615-45d5-4da6-8195-f1e0eb12cd4e admin admin] RBAC: Authorizing `identity:get_user(user_id=d269fd97a1de43ec94f4736b3f123e1c)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:24.441391 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4b615-45d5-4da6-8195-f1e0eb12cd4e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:24.444221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 64/125] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:24 2021] GET /identity/v3/users/d269fd97a1de43ec94f4736b3f123e1c => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:24.454072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4b615-45d5-4da6-8195-f1e0eb12cd4e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:24.466241 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 62/126] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Nov 8 10:48:24 2021] POST /identity/v3/users => generated 283 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:48:24.474034 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4b615-45d5-4da6-8195-f1e0eb12cd4e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:24.479795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a28a0-2383-4569-b80f-88c175c36f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:24.481177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a28a0-2383-4569-b80f-88c175c36f05 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.481819 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a28a0-2383-4569-b80f-88c175c36f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.482294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a28a0-2383-4569-b80f-88c175c36f05 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.484415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a28a0-2383-4569-b80f-88c175c36f05 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:24.487349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a28a0-2383-4569-b80f-88c175c36f05 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:24.489654 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 65/127] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:24 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:24.496445 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f57a3-57a3-4a97-818b-ec71cde99eab admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:24.514394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f57a3-57a3-4a97-818b-ec71cde99eab admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:24.521137 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9f26c-af9f-42a4-b076-9cadf011fe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:24.522069 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9f26c-af9f-42a4-b076-9cadf011fe55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:24.522358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9f26c-af9f-42a4-b076-9cadf011fe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:24.522636 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9f26c-af9f-42a4-b076-9cadf011fe55 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446/users/d269fd97a1de43ec94f4736b3f123e1c/roles/a4a3a42f23b2463ebc5e198fe56ac656` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:24.525026 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9f26c-af9f-42a4-b076-9cadf011fe55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6453f0e70ff411fbd16c7407a3e8446, user_id=d269fd97a1de43ec94f4736b3f123e1c, role_id=a4a3a42f23b2463ebc5e198fe56ac656)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:24.527886 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9f26c-af9f-42a4-b076-9cadf011fe55 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:24.544269 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 63/128] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:48:24 2021] PUT /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446/users/d269fd97a1de43ec94f4736b3f123e1c/roles/a4a3a42f23b2463ebc5e198fe56ac656 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:48:26.736496 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e73908-e2aa-4e45-a952-329dd7578cf5 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:26.736988 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e73908-e2aa-4e45-a952-329dd7578cf5 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:26.736988 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e73908-e2aa-4e45-a952-329dd7578cf5 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:26.739264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 66/129] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:26.745619 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e3ae4-5515-4499-b6a5-cbf092fdcbf4 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:26.746464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e3ae4-5515-4499-b6a5-cbf092fdcbf4 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:26.746938 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e3ae4-5515-4499-b6a5-cbf092fdcbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:26.772959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-9f9e3ae4-5515-4499-b6a5-cbf092fdcbf4 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:26.774519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9f9e3ae4-5515-4499-b6a5-cbf092fdcbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:26.846475 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 64/130] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:26.891442 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e73908-e2aa-4e45-a952-329dd7578cf5 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:26.910041 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e73908-e2aa-4e45-a952-329dd7578cf5 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:26.914439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b40556-3654-45f3-bb5a-1b56743ba671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:26.915313 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b40556-3654-45f3-bb5a-1b56743ba671 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:26.915601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b40556-3654-45f3-bb5a-1b56743ba671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:26.915878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b40556-3654-45f3-bb5a-1b56743ba671 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:26.931563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b40556-3654-45f3-bb5a-1b56743ba671 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:26.938317 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-a1b40556-3654-45f3-bb5a-1b56743ba671 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:48:26.939600 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 67/131] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:48:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:26.946849 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e3ae4-5515-4499-b6a5-cbf092fdcbf4 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:26.961206 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e3ae4-5515-4499-b6a5-cbf092fdcbf4 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:26.971156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c1dca-bb65-454f-a92f-a61e66563128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:26.972333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c1dca-bb65-454f-a92f-a61e66563128 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:26.972951 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c1dca-bb65-454f-a92f-a61e66563128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:26.973444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c1dca-bb65-454f-a92f-a61e66563128 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:26.974445 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c1dca-bb65-454f-a92f-a61e66563128 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:26.974948 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c1dca-bb65-454f-a92f-a61e66563128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:26.976839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c1dca-bb65-454f-a92f-a61e66563128 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:26.991688 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 65/132] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:26.998189 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b40556-3654-45f3-bb5a-1b56743ba671 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.012778 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b40556-3654-45f3-bb5a-1b56743ba671 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.017527 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5b62e-a251-4df6-836c-9d89c8a9b1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.018767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5b62e-a251-4df6-836c-9d89c8a9b1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.019054 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5b62e-a251-4df6-836c-9d89c8a9b1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.019415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5b62e-a251-4df6-836c-9d89c8a9b1a9 admin admin] PATH_INFO: `/v3/users/23015594a30b49b885e3a6236f3a6f37` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.020672 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5b62e-a251-4df6-836c-9d89c8a9b1a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=23015594a30b49b885e3a6236f3a6f37)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:27.022524 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5b62e-a251-4df6-836c-9d89c8a9b1a9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:27.028307 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 68/133] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:26 2021] GET /identity/v3/users/23015594a30b49b885e3a6236f3a6f37 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:27.033015 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ee9b0-bfc3-4cf6-98bf-ac58e2b7bdbc None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.033561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ee9b0-bfc3-4cf6-98bf-ac58e2b7bdbc None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.034070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ee9b0-bfc3-4cf6-98bf-ac58e2b7bdbc None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.036540 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 66/134] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:27.042797 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ee9b0-bfc3-4cf6-98bf-ac58e2b7bdbc None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.042926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9c2ae-280a-4412-a40d-b52393974798 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.043168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9c2ae-280a-4412-a40d-b52393974798 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.043422 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9c2ae-280a-4412-a40d-b52393974798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.064040 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ee9b0-bfc3-4cf6-98bf-ac58e2b7bdbc None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.069682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-afd9c2ae-280a-4412-a40d-b52393974798 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:27.071118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-afd9c2ae-280a-4412-a40d-b52393974798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:27.074953 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33f2e2-774c-46c5-821a-37bb074233f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.075939 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33f2e2-774c-46c5-821a-37bb074233f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.076419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33f2e2-774c-46c5-821a-37bb074233f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.076941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33f2e2-774c-46c5-821a-37bb074233f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.079525 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 69/135] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:27.094895 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33f2e2-774c-46c5-821a-37bb074233f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:27.097643 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33f2e2-774c-46c5-821a-37bb074233f3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:27.111393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9c2ae-280a-4412-a40d-b52393974798 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.113959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 67/136] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 08 10:48:27.120468 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33f2e2-774c-46c5-821a-37bb074233f3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.125156 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9c2ae-280a-4412-a40d-b52393974798 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.136558 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33f2e2-774c-46c5-821a-37bb074233f3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.136925 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed0517-3f8f-4e46-9206-0fe99b2580ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.138984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0517-3f8f-4e46-9206-0fe99b2580ac admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.138984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0517-3f8f-4e46-9206-0fe99b2580ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.138984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0517-3f8f-4e46-9206-0fe99b2580ac admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.144889 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dadc2-79aa-4a08-9a6e-78dd073b76b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.146124 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dadc2-79aa-4a08-9a6e-78dd073b76b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.146658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dadc2-79aa-4a08-9a6e-78dd073b76b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.147167 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dadc2-79aa-4a08-9a6e-78dd073b76b4 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.149934 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dadc2-79aa-4a08-9a6e-78dd073b76b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:27.152429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dadc2-79aa-4a08-9a6e-78dd073b76b4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:27.154398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 68/137] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:27.160038 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed0517-3f8f-4e46-9206-0fe99b2580ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:27.161308 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dadc2-79aa-4a08-9a6e-78dd073b76b4 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.167194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-eaed0517-3f8f-4e46-9206-0fe99b2580ac admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:27.168796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 70/138] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:27.175006 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed0517-3f8f-4e46-9206-0fe99b2580ac admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.175822 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dadc2-79aa-4a08-9a6e-78dd073b76b4 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.184866 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81e7cd-2d1c-4507-beae-6a34f715d7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.185913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81e7cd-2d1c-4507-beae-6a34f715d7ae admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.186397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81e7cd-2d1c-4507-beae-6a34f715d7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.186919 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81e7cd-2d1c-4507-beae-6a34f715d7ae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.188010 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81e7cd-2d1c-4507-beae-6a34f715d7ae admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=d6453f0e70ff411fbd16c7407a3e8446, user.id=23015594a30b49b885e3a6236f3a6f37) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:27.188563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed0517-3f8f-4e46-9206-0fe99b2580ac admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.188868 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81e7cd-2d1c-4507-beae-6a34f715d7ae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:27.191605 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81e7cd-2d1c-4507-beae-6a34f715d7ae admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:27.193053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10990a15-5a82-4449-9f5a-8c76c34ac6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.193739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10990a15-5a82-4449-9f5a-8c76c34ac6be admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.194009 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10990a15-5a82-4449-9f5a-8c76c34ac6be admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.194284 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10990a15-5a82-4449-9f5a-8c76c34ac6be admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.199164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10990a15-5a82-4449-9f5a-8c76c34ac6be admin admin] RBAC: Adding query filter params (name=member) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:27.199164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10990a15-5a82-4449-9f5a-8c76c34ac6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:27.199164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10990a15-5a82-4449-9f5a-8c76c34ac6be admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:27.207485 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 69/139] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/role_assignments?user.id=23015594a30b49b885e3a6236f3a6f37&scope.project.id=d6453f0e70ff411fbd16c7407a3e8446&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:27.213824 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 71/140] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:27.220288 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81e7cd-2d1c-4507-beae-6a34f715d7ae admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.236833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81e7cd-2d1c-4507-beae-6a34f715d7ae admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.246295 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de0f8f-598d-415d-9580-7e5feeb14be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.248286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de0f8f-598d-415d-9580-7e5feeb14be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.248814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de0f8f-598d-415d-9580-7e5feeb14be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.249333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de0f8f-598d-415d-9580-7e5feeb14be4 admin admin] PATH_INFO: `/v3/users/d269fd97a1de43ec94f4736b3f123e1c` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.251160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de0f8f-598d-415d-9580-7e5feeb14be4 admin admin] RBAC: Authorizing `identity:get_user(user_id=d269fd97a1de43ec94f4736b3f123e1c)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:27.254405 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de0f8f-598d-415d-9580-7e5feeb14be4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:27.258615 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 70/141] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/users/d269fd97a1de43ec94f4736b3f123e1c => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:27.264963 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10990a15-5a82-4449-9f5a-8c76c34ac6be admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.280074 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10990a15-5a82-4449-9f5a-8c76c34ac6be admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.289204 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dfae4-3570-46f5-b6cc-618c0dd5423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.289890 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dfae4-3570-46f5-b6cc-618c0dd5423f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.290200 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dfae4-3570-46f5-b6cc-618c0dd5423f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.290455 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dfae4-3570-46f5-b6cc-618c0dd5423f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.299502 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dfae4-3570-46f5-b6cc-618c0dd5423f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:27.301476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dfae4-3570-46f5-b6cc-618c0dd5423f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:27.313321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 72/142] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:27.319493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de0f8f-598d-415d-9580-7e5feeb14be4 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.331696 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de0f8f-598d-415d-9580-7e5feeb14be4 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.338299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76471146-9354-4fe1-a629-be4a09e0b2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.339787 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76471146-9354-4fe1-a629-be4a09e0b2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.340359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76471146-9354-4fe1-a629-be4a09e0b2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.340853 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76471146-9354-4fe1-a629-be4a09e0b2f8 admin admin] PATH_INFO: `/v3/projects/46af80d1a68f413e90039caa63e95d3d` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.343556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76471146-9354-4fe1-a629-be4a09e0b2f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=46af80d1a68f413e90039caa63e95d3d)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:27.346185 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76471146-9354-4fe1-a629-be4a09e0b2f8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:27.348714 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 71/143] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/projects/46af80d1a68f413e90039caa63e95d3d => generated 312 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:27.355431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dfae4-3570-46f5-b6cc-618c0dd5423f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.368358 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dfae4-3570-46f5-b6cc-618c0dd5423f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.372942 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8ba24-b099-4bc7-8d6c-365456410a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.373617 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8ba24-b099-4bc7-8d6c-365456410a41 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.373901 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8ba24-b099-4bc7-8d6c-365456410a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.374178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8ba24-b099-4bc7-8d6c-365456410a41 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.375046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8ba24-b099-4bc7-8d6c-365456410a41 admin admin] RBAC: Adding query filter params (role.id=2dce671f5a1a43da869724374e62098b, scope.project.id=46af80d1a68f413e90039caa63e95d3d, user.id=d269fd97a1de43ec94f4736b3f123e1c) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:27.375388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8ba24-b099-4bc7-8d6c-365456410a41 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:27.377338 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8ba24-b099-4bc7-8d6c-365456410a41 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:27.393356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 73/144] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/role_assignments?user.id=d269fd97a1de43ec94f4736b3f123e1c&scope.project.id=46af80d1a68f413e90039caa63e95d3d&role.id=2dce671f5a1a43da869724374e62098b => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:27.607275 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301fcc4-ea01-4d73-8436-55d907ae1d19 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.607894 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301fcc4-ea01-4d73-8436-55d907ae1d19 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.608395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301fcc4-ea01-4d73-8436-55d907ae1d19 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.610464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 72/145] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:27.621955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb92263-9cda-4040-9525-04ed1fd59a10 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.622281 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb92263-9cda-4040-9525-04ed1fd59a10 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.622531 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb92263-9cda-4040-9525-04ed1fd59a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.644345 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-cfb92263-9cda-4040-9525-04ed1fd59a10 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:27.645570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-cfb92263-9cda-4040-9525-04ed1fd59a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:27.653264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 74/146] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:27.694398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301fcc4-ea01-4d73-8436-55d907ae1d19 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.709872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301fcc4-ea01-4d73-8436-55d907ae1d19 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.718918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d4fc-ee7d-41a6-b8cf-a63a59840d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.720222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d4fc-ee7d-41a6-b8cf-a63a59840d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.720704 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d4fc-ee7d-41a6-b8cf-a63a59840d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.721198 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d4fc-ee7d-41a6-b8cf-a63a59840d97 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.738929 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1d4fc-ee7d-41a6-b8cf-a63a59840d97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:27.748112 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-37f1d4fc-ee7d-41a6-b8cf-a63a59840d97 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:27.750028 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 73/147] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:27.757289 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb92263-9cda-4040-9525-04ed1fd59a10 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.769742 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb92263-9cda-4040-9525-04ed1fd59a10 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.774327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3d731-82a5-47eb-a956-8070d371be39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.775038 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d731-82a5-47eb-a956-8070d371be39 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.777349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d731-82a5-47eb-a956-8070d371be39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.777646 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d731-82a5-47eb-a956-8070d371be39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.778446 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3d731-82a5-47eb-a956-8070d371be39 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:27.778759 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3d731-82a5-47eb-a956-8070d371be39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:27.780441 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3d731-82a5-47eb-a956-8070d371be39 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:27.795758 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 75/148] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:27.802738 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d4fc-ee7d-41a6-b8cf-a63a59840d97 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.816803 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d4fc-ee7d-41a6-b8cf-a63a59840d97 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.824136 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e0cdf-1406-405c-9009-e9c729614170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.825444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e0cdf-1406-405c-9009-e9c729614170 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.825929 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e0cdf-1406-405c-9009-e9c729614170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.826397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e0cdf-1406-405c-9009-e9c729614170 admin admin] PATH_INFO: `/v3/users/d269fd97a1de43ec94f4736b3f123e1c` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.828728 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e0cdf-1406-405c-9009-e9c729614170 admin admin] RBAC: Authorizing `identity:get_user(user_id=d269fd97a1de43ec94f4736b3f123e1c)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:27.830485 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b28ff5-a346-4cb7-95db-e221378f2390 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.830787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b28ff5-a346-4cb7-95db-e221378f2390 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.831098 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b28ff5-a346-4cb7-95db-e221378f2390 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.832379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e0cdf-1406-405c-9009-e9c729614170 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:27.832928 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 76/149] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:48:27.834576 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 74/150] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/users/d269fd97a1de43ec94f4736b3f123e1c => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:27.839487 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bb04-4712-4bfe-b424-7558431667c5 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.839779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bb04-4712-4bfe-b424-7558431667c5 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.840059 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bb04-4712-4bfe-b424-7558431667c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.841700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e0cdf-1406-405c-9009-e9c729614170 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.856717 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e0cdf-1406-405c-9009-e9c729614170 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.867610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd5a02-99ad-4c45-bb37-b27707a04d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.868711 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5a02-99ad-4c45-bb37-b27707a04d02 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.869255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5a02-99ad-4c45-bb37-b27707a04d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.869379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-f052bb04-4712-4bfe-b424-7558431667c5 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:27.869883 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5a02-99ad-4c45-bb37-b27707a04d02 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.870472 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f052bb04-4712-4bfe-b424-7558431667c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:27.885776 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 77/151] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:27.887377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd5a02-99ad-4c45-bb37-b27707a04d02 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:27.889485 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd5a02-99ad-4c45-bb37-b27707a04d02 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:27.907542 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 75/152] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 08 10:48:27.914762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052bb04-4712-4bfe-b424-7558431667c5 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.931065 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052bb04-4712-4bfe-b424-7558431667c5 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.931873 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd5a02-99ad-4c45-bb37-b27707a04d02 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.935504 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3df323-7f1b-43f6-85f5-a63cf5b14374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.936377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3df323-7f1b-43f6-85f5-a63cf5b14374 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.936657 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3df323-7f1b-43f6-85f5-a63cf5b14374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.936922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3df323-7f1b-43f6-85f5-a63cf5b14374 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.940769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3df323-7f1b-43f6-85f5-a63cf5b14374 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:27.940769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3df323-7f1b-43f6-85f5-a63cf5b14374 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:27.942246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 78/153] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:27.950560 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3df323-7f1b-43f6-85f5-a63cf5b14374 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:27.952000 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd5a02-99ad-4c45-bb37-b27707a04d02 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.959592 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804f266-079b-4964-af49-f837118f100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.960749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804f266-079b-4964-af49-f837118f100e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.961332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804f266-079b-4964-af49-f837118f100e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.961848 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804f266-079b-4964-af49-f837118f100e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.965158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3df323-7f1b-43f6-85f5-a63cf5b14374 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:27.970348 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb61e26-9267-4814-b51e-a5bc1311ef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:27.970854 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61e26-9267-4814-b51e-a5bc1311ef21 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:27.971267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61e26-9267-4814-b51e-a5bc1311ef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:27.971584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61e26-9267-4814-b51e-a5bc1311ef21 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:27.974256 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb61e26-9267-4814-b51e-a5bc1311ef21 admin admin] RBAC: Adding query filter params (role.id=2dce671f5a1a43da869724374e62098b, scope.project.id=d6453f0e70ff411fbd16c7407a3e8446, user.id=d269fd97a1de43ec94f4736b3f123e1c) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:27.974256 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb61e26-9267-4814-b51e-a5bc1311ef21 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:27.974924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb61e26-9267-4814-b51e-a5bc1311ef21 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:27.988298 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804f266-079b-4964-af49-f837118f100e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:27.992030 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 79/154] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/role_assignments?user.id=d269fd97a1de43ec94f4736b3f123e1c&scope.project.id=d6453f0e70ff411fbd16c7407a3e8446&role.id=2dce671f5a1a43da869724374e62098b => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:27.999150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-f804f266-079b-4964-af49-f837118f100e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 08 10:48:28.000728 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 76/155] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:48:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:28.008459 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb61e26-9267-4814-b51e-a5bc1311ef21 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:28.021891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb61e26-9267-4814-b51e-a5bc1311ef21 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:28.028937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2950cc8-ec7a-41d4-a16f-8c8a7de82b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:28.029898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2950cc8-ec7a-41d4-a16f-8c8a7de82b1d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:28.030443 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2950cc8-ec7a-41d4-a16f-8c8a7de82b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:28.030912 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2950cc8-ec7a-41d4-a16f-8c8a7de82b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:28.031974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2950cc8-ec7a-41d4-a16f-8c8a7de82b1d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:28.032555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2950cc8-ec7a-41d4-a16f-8c8a7de82b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:28.034598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2950cc8-ec7a-41d4-a16f-8c8a7de82b1d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:28.047247 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 80/156] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:28.053822 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804f266-079b-4964-af49-f837118f100e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:28.066604 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804f266-079b-4964-af49-f837118f100e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:28.072589 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33f67-797b-447c-9487-c674e038a271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:28.073822 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33f67-797b-447c-9487-c674e038a271 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:28.074354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33f67-797b-447c-9487-c674e038a271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:28.074821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33f67-797b-447c-9487-c674e038a271 admin admin] PATH_INFO: `/v3/users/d269fd97a1de43ec94f4736b3f123e1c` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:28.077857 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd33f67-797b-447c-9487-c674e038a271 admin admin] RBAC: Authorizing `identity:get_user(user_id=d269fd97a1de43ec94f4736b3f123e1c)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:28.080484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd33f67-797b-447c-9487-c674e038a271 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:28.082940 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 77/157] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:28 2021] GET /identity/v3/users/d269fd97a1de43ec94f4736b3f123e1c => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:28.089330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2950cc8-ec7a-41d4-a16f-8c8a7de82b1d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:28.101511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2950cc8-ec7a-41d4-a16f-8c8a7de82b1d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:28.107088 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20ad9f-cb02-4687-90c4-62a4b99db5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:28.108198 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ad9f-cb02-4687-90c4-62a4b99db5ca admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:28.108726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ad9f-cb02-4687-90c4-62a4b99db5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:28.109227 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ad9f-cb02-4687-90c4-62a4b99db5ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:28.124599 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20ad9f-cb02-4687-90c4-62a4b99db5ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:28.126985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20ad9f-cb02-4687-90c4-62a4b99db5ca admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:28.141518 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 81/158] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:28.148795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33f67-797b-447c-9487-c674e038a271 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:28.160734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33f67-797b-447c-9487-c674e038a271 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:28.168848 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2aa029-c77d-4972-acf0-dc128bacaa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:28.170127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2aa029-c77d-4972-acf0-dc128bacaa1e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:28.170698 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2aa029-c77d-4972-acf0-dc128bacaa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:28.171194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2aa029-c77d-4972-acf0-dc128bacaa1e admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:28.173130 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2aa029-c77d-4972-acf0-dc128bacaa1e admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:28.176133 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2aa029-c77d-4972-acf0-dc128bacaa1e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:28.178174 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 78/159] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:28 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:28.186469 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20ad9f-cb02-4687-90c4-62a4b99db5ca admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:28.196605 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20ad9f-cb02-4687-90c4-62a4b99db5ca admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:28.202994 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a336f9a-34ac-4a59-8951-b49deee9eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:28.204111 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a336f9a-34ac-4a59-8951-b49deee9eb01 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:28.204647 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a336f9a-34ac-4a59-8951-b49deee9eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:28.205164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a336f9a-34ac-4a59-8951-b49deee9eb01 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:28.206374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a336f9a-34ac-4a59-8951-b49deee9eb01 admin admin] RBAC: Adding query filter params (role.id=a4a3a42f23b2463ebc5e198fe56ac656, scope.project.id=d6453f0e70ff411fbd16c7407a3e8446, user.id=d269fd97a1de43ec94f4736b3f123e1c) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:28.207146 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a336f9a-34ac-4a59-8951-b49deee9eb01 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:28.209454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a336f9a-34ac-4a59-8951-b49deee9eb01 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:28.218558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 82/160] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:28 2021] GET /identity/v3/role_assignments?user.id=d269fd97a1de43ec94f4736b3f123e1c&scope.project.id=d6453f0e70ff411fbd16c7407a3e8446&role.id=a4a3a42f23b2463ebc5e198fe56ac656 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:28.972382 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a465-4eb7-4891-a8bd-cfc44a7bd520 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:28.973361 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a465-4eb7-4891-a8bd-cfc44a7bd520 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:28.973863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a465-4eb7-4891-a8bd-cfc44a7bd520 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:28.976150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 79/161] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:28.982732 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311f014-48a2-428e-bae4-58db5751298b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:28.983667 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311f014-48a2-428e-bae4-58db5751298b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:28.984136 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311f014-48a2-428e-bae4-58db5751298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.006117 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-e311f014-48a2-428e-bae4-58db5751298b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:29.007689 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e311f014-48a2-428e-bae4-58db5751298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:29.021714 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 83/162] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:29.046513 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160a465-4eb7-4891-a8bd-cfc44a7bd520 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:29.061303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160a465-4eb7-4891-a8bd-cfc44a7bd520 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:29.068590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e3da3-7447-4177-ba86-09f2cb3de6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:29.069665 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e3da3-7447-4177-ba86-09f2cb3de6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.070153 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e3da3-7447-4177-ba86-09f2cb3de6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.070619 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e3da3-7447-4177-ba86-09f2cb3de6f3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.083028 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e3da3-7447-4177-ba86-09f2cb3de6f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:29.090012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-7c7e3da3-7447-4177-ba86-09f2cb3de6f3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:29.091372 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 80/163] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:29.103165 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311f014-48a2-428e-bae4-58db5751298b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:29.107302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311f014-48a2-428e-bae4-58db5751298b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:29.111867 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c30b2f-cddd-44a2-9f3f-5f0f80d9b149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:29.112889 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c30b2f-cddd-44a2-9f3f-5f0f80d9b149 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.113259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c30b2f-cddd-44a2-9f3f-5f0f80d9b149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.113627 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c30b2f-cddd-44a2-9f3f-5f0f80d9b149 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.114493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c30b2f-cddd-44a2-9f3f-5f0f80d9b149 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:29.114894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c30b2f-cddd-44a2-9f3f-5f0f80d9b149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:29.116635 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c30b2f-cddd-44a2-9f3f-5f0f80d9b149 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:29.125447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 84/164] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:29.131672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e3da3-7447-4177-ba86-09f2cb3de6f3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:29.141556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e3da3-7447-4177-ba86-09f2cb3de6f3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:29.146974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dc26e-a165-49fe-859a-3468106c6f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:29.148127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dc26e-a165-49fe-859a-3468106c6f48 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.148605 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dc26e-a165-49fe-859a-3468106c6f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.149071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dc26e-a165-49fe-859a-3468106c6f48 admin admin] PATH_INFO: `/v3/users/d1c4f01bf6464c349a0eb731c3535142` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.163505 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dc26e-a165-49fe-859a-3468106c6f48 admin admin] RBAC: Authorizing `identity:get_user(user_id=d1c4f01bf6464c349a0eb731c3535142)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:29.165974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dc26e-a165-49fe-859a-3468106c6f48 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:29.168002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 81/165] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:29 2021] GET /identity/v3/users/d1c4f01bf6464c349a0eb731c3535142 => generated 283 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:29.175959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c30b2f-cddd-44a2-9f3f-5f0f80d9b149 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:29.185042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c30b2f-cddd-44a2-9f3f-5f0f80d9b149 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:29.189670 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3417-f110-45ec-9da3-3de4859d0630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:29.190528 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3417-f110-45ec-9da3-3de4859d0630 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.190970 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3417-f110-45ec-9da3-3de4859d0630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.191321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3417-f110-45ec-9da3-3de4859d0630 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.200408 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb3417-f110-45ec-9da3-3de4859d0630 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:29.202232 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb3417-f110-45ec-9da3-3de4859d0630 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:29.212750 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 85/166] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:29.219007 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dc26e-a165-49fe-859a-3468106c6f48 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:29.232889 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dc26e-a165-49fe-859a-3468106c6f48 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:29.237634 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a6802-d6a2-4e1e-bd61-7847cb42a94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:29.238728 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a6802-d6a2-4e1e-bd61-7847cb42a94a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.239206 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a6802-d6a2-4e1e-bd61-7847cb42a94a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.239794 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a6802-d6a2-4e1e-bd61-7847cb42a94a admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.241214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a6802-d6a2-4e1e-bd61-7847cb42a94a admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:29.243614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a6802-d6a2-4e1e-bd61-7847cb42a94a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:29.245801 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 82/167] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:29 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:29.252424 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3417-f110-45ec-9da3-3de4859d0630 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:29.262290 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3417-f110-45ec-9da3-3de4859d0630 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:29.267384 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30acd8-ee6d-4844-aea6-fec3d260ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:29.268241 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30acd8-ee6d-4844-aea6-fec3d260ee0d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.268749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30acd8-ee6d-4844-aea6-fec3d260ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.269431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30acd8-ee6d-4844-aea6-fec3d260ee0d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.270459 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30acd8-ee6d-4844-aea6-fec3d260ee0d admin admin] RBAC: Adding query filter params (role.id=2dce671f5a1a43da869724374e62098b, scope.project.id=9dec779bc5f842f88b59b29d486b4aa2, user.id=d1c4f01bf6464c349a0eb731c3535142) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:29.270932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30acd8-ee6d-4844-aea6-fec3d260ee0d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:29.273106 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30acd8-ee6d-4844-aea6-fec3d260ee0d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:29.279802 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 86/168] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:29 2021] GET /identity/v3/role_assignments?user.id=d1c4f01bf6464c349a0eb731c3535142&scope.project.id=9dec779bc5f842f88b59b29d486b4aa2&role.id=2dce671f5a1a43da869724374e62098b => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:29.332139 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2412ae-4c42-453c-b944-858a48d37216 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.332434 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2412ae-4c42-453c-b944-858a48d37216 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.332692 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2412ae-4c42-453c-b944-858a48d37216 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.334530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 83/169] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:29.341115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc12ed-fac6-46a7-816e-2a8858e16001 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.341403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc12ed-fac6-46a7-816e-2a8858e16001 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.341681 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc12ed-fac6-46a7-816e-2a8858e16001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.361161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-e2bc12ed-fac6-46a7-816e-2a8858e16001 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:29.362475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e2bc12ed-fac6-46a7-816e-2a8858e16001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:29.370618 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 87/170] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:29.396242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2412ae-4c42-453c-b944-858a48d37216 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:29.412201 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2412ae-4c42-453c-b944-858a48d37216 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:29.416960 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d78d45-b275-4d06-8427-bf24c09e1c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:29.418081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d78d45-b275-4d06-8427-bf24c09e1c75 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.418537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d78d45-b275-4d06-8427-bf24c09e1c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.418978 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d78d45-b275-4d06-8427-bf24c09e1c75 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.431675 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d78d45-b275-4d06-8427-bf24c09e1c75 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:29.439170 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-87d78d45-b275-4d06-8427-bf24c09e1c75 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:48:29.440793 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 84/171] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:48:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:29.447818 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc12ed-fac6-46a7-816e-2a8858e16001 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:29.457747 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc12ed-fac6-46a7-816e-2a8858e16001 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:29.462671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96050f-2a31-4123-87e6-3b432e9b74e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:29.463830 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96050f-2a31-4123-87e6-3b432e9b74e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.464294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96050f-2a31-4123-87e6-3b432e9b74e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.464732 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96050f-2a31-4123-87e6-3b432e9b74e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.465785 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96050f-2a31-4123-87e6-3b432e9b74e7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:29.469567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96050f-2a31-4123-87e6-3b432e9b74e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:29.469567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96050f-2a31-4123-87e6-3b432e9b74e7 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:29.479238 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 88/172] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:29.485571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d78d45-b275-4d06-8427-bf24c09e1c75 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:29.496113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d78d45-b275-4d06-8427-bf24c09e1c75 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:29.500521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb5e84-ce95-43bf-b378-cf27155d2a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:29.501544 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5e84-ce95-43bf-b378-cf27155d2a32 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.501827 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5e84-ce95-43bf-b378-cf27155d2a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.502104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5e84-ce95-43bf-b378-cf27155d2a32 admin admin] PATH_INFO: `/v3/users/23015594a30b49b885e3a6236f3a6f37` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.503424 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb5e84-ce95-43bf-b378-cf27155d2a32 admin admin] RBAC: Authorizing `identity:get_user(user_id=23015594a30b49b885e3a6236f3a6f37)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:29.505273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb5e84-ce95-43bf-b378-cf27155d2a32 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:29.506914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 85/173] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:29 2021] GET /identity/v3/users/23015594a30b49b885e3a6236f3a6f37 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:29.513158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96050f-2a31-4123-87e6-3b432e9b74e7 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:29.523891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96050f-2a31-4123-87e6-3b432e9b74e7 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:29.528390 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1d5c8-ee11-47fe-9d61-43cb9a3eab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:29.529039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1d5c8-ee11-47fe-9d61-43cb9a3eab01 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.529369 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1d5c8-ee11-47fe-9d61-43cb9a3eab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.529642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1d5c8-ee11-47fe-9d61-43cb9a3eab01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.539096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1d5c8-ee11-47fe-9d61-43cb9a3eab01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:29.541000 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1d5c8-ee11-47fe-9d61-43cb9a3eab01 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:29.551791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 89/174] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 08 10:48:29.557819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb5e84-ce95-43bf-b378-cf27155d2a32 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:29.569714 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb5e84-ce95-43bf-b378-cf27155d2a32 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:29.574249 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6b573-68c2-41f0-a342-58cd8656c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:29.575104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b573-68c2-41f0-a342-58cd8656c1ec admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.575437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b573-68c2-41f0-a342-58cd8656c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.575704 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b573-68c2-41f0-a342-58cd8656c1ec admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.576972 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6b573-68c2-41f0-a342-58cd8656c1ec admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:29.579164 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6b573-68c2-41f0-a342-58cd8656c1ec admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:29.580952 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 86/175] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:29 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:29.587831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1d5c8-ee11-47fe-9d61-43cb9a3eab01 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:29.597216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1d5c8-ee11-47fe-9d61-43cb9a3eab01 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:29.601718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ff7f2-3ca8-4fbe-8f80-2e8a16cca3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:29.602368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ff7f2-3ca8-4fbe-8f80-2e8a16cca3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.602697 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ff7f2-3ca8-4fbe-8f80-2e8a16cca3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.602974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ff7f2-3ca8-4fbe-8f80-2e8a16cca3b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.603891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ff7f2-3ca8-4fbe-8f80-2e8a16cca3b1 admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=9dec779bc5f842f88b59b29d486b4aa2, user.id=23015594a30b49b885e3a6236f3a6f37) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:29.604249 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ff7f2-3ca8-4fbe-8f80-2e8a16cca3b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:29.606125 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ff7f2-3ca8-4fbe-8f80-2e8a16cca3b1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:29.612364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 90/176] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:29 2021] GET /identity/v3/role_assignments?user.id=23015594a30b49b885e3a6236f3a6f37&scope.project.id=9dec779bc5f842f88b59b29d486b4aa2&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:29.922956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe3109-c7b7-401d-8d50-1588a26d2e82 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.923337 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe3109-c7b7-401d-8d50-1588a26d2e82 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.923539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe3109-c7b7-401d-8d50-1588a26d2e82 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.925903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 87/177] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:29.932831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bf5af-f774-49e0-9e81-378beab675ba None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.933120 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bf5af-f774-49e0-9e81-378beab675ba None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.933394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bf5af-f774-49e0-9e81-378beab675ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.951640 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-547bf5af-f774-49e0-9e81-378beab675ba None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:29.952892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-547bf5af-f774-49e0-9e81-378beab675ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:29.961124 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 91/178] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:29.977765 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa0c28-7baf-4a53-b409-a020c3716536 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.978244 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa0c28-7baf-4a53-b409-a020c3716536 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.978313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa0c28-7baf-4a53-b409-a020c3716536 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.980097 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 88/179] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:29.984627 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bf5af-f774-49e0-9e81-378beab675ba None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:29.985704 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5d222-d56b-4018-bd23-4c529451c369 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:29.985992 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5d222-d56b-4018-bd23-4c529451c369 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:29.986266 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5d222-d56b-4018-bd23-4c529451c369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:29.995530 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bf5af-f774-49e0-9e81-378beab675ba None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:30.000552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1da627-7535-4c69-adea-52f1d5b513bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:30.001842 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1da627-7535-4c69-adea-52f1d5b513bf admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:30.002132 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1da627-7535-4c69-adea-52f1d5b513bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:30.002405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1da627-7535-4c69-adea-52f1d5b513bf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:30.003737 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1da627-7535-4c69-adea-52f1d5b513bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:30.005002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-6de5d222-d56b-4018-bd23-4c529451c369 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:30.005621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1da627-7535-4c69-adea-52f1d5b513bf admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:30.006194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6de5d222-d56b-4018-bd23-4c529451c369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:30.007431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 92/180] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:30.013742 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1da627-7535-4c69-adea-52f1d5b513bf admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:30.018564 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 89/181] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:30.023996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1da627-7535-4c69-adea-52f1d5b513bf admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:30.028293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e563e8f-3261-4686-94f8-2f2c6d190d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:30.028946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e563e8f-3261-4686-94f8-2f2c6d190d05 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:30.029233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e563e8f-3261-4686-94f8-2f2c6d190d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:30.029506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e563e8f-3261-4686-94f8-2f2c6d190d05 admin admin] PATH_INFO: `/v3/groups` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:30.030207 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e563e8f-3261-4686-94f8-2f2c6d190d05 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:30.031235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-3e563e8f-3261-4686-94f8-2f2c6d190d05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:30.031235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:48:30.031235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:48:30.032447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e563e8f-3261-4686-94f8-2f2c6d190d05 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:30.045839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5d222-d56b-4018-bd23-4c529451c369 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:30.049080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 93/182] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Nov 8 10:48:30 2021] POST /identity/v3/groups => generated 229 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:48:30.061547 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5d222-d56b-4018-bd23-4c529451c369 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:30.067289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbc76c-805c-480f-b27a-4cdff0dfa4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:30.068265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbc76c-805c-480f-b27a-4cdff0dfa4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:30.068659 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbc76c-805c-480f-b27a-4cdff0dfa4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:30.069020 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbc76c-805c-480f-b27a-4cdff0dfa4d4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:30.082629 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbc76c-805c-480f-b27a-4cdff0dfa4d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:30.090446 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-63cbc76c-805c-480f-b27a-4cdff0dfa4d4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 08 10:48:30.092262 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 90/183] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:48:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:30.099283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e563e8f-3261-4686-94f8-2f2c6d190d05 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:30.109851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e563e8f-3261-4686-94f8-2f2c6d190d05 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:30.115355 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744e640-fd1c-4667-9051-9d5f72c52c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:30.116114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744e640-fd1c-4667-9051-9d5f72c52c31 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:30.116404 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744e640-fd1c-4667-9051-9d5f72c52c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:30.116682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744e640-fd1c-4667-9051-9d5f72c52c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:30.117525 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744e640-fd1c-4667-9051-9d5f72c52c31 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:30.117836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744e640-fd1c-4667-9051-9d5f72c52c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:30.119639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744e640-fd1c-4667-9051-9d5f72c52c31 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:30.130123 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 94/184] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:30.136625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbc76c-805c-480f-b27a-4cdff0dfa4d4 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:30.148452 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbc76c-805c-480f-b27a-4cdff0dfa4d4 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:30.153292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600edd3d-549b-4b4d-963c-d3eb09668031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:30.154247 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600edd3d-549b-4b4d-963c-d3eb09668031 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:30.154634 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600edd3d-549b-4b4d-963c-d3eb09668031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:30.154910 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600edd3d-549b-4b4d-963c-d3eb09668031 admin admin] PATH_INFO: `/v3/users/d1c4f01bf6464c349a0eb731c3535142` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:30.156368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600edd3d-549b-4b4d-963c-d3eb09668031 admin admin] RBAC: Authorizing `identity:get_user(user_id=d1c4f01bf6464c349a0eb731c3535142)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:30.158764 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600edd3d-549b-4b4d-963c-d3eb09668031 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:30.161484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 91/185] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:30 2021] GET /identity/v3/users/d1c4f01bf6464c349a0eb731c3535142 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:30.167609 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744e640-fd1c-4667-9051-9d5f72c52c31 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:30.178960 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744e640-fd1c-4667-9051-9d5f72c52c31 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:30.183754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c962041-7099-4747-8bd7-4dc2022f1782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:30.184526 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c962041-7099-4747-8bd7-4dc2022f1782 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:30.184809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c962041-7099-4747-8bd7-4dc2022f1782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:30.185081 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c962041-7099-4747-8bd7-4dc2022f1782 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:30.195159 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c962041-7099-4747-8bd7-4dc2022f1782 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:30.197119 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c962041-7099-4747-8bd7-4dc2022f1782 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:30.208186 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 95/186] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:30 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:30.214530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600edd3d-549b-4b4d-963c-d3eb09668031 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:30.226647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600edd3d-549b-4b4d-963c-d3eb09668031 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:30.231367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cf590-a6bb-4adf-a2a3-b8db2c992d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:30.232311 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf590-a6bb-4adf-a2a3-b8db2c992d7a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:30.232592 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf590-a6bb-4adf-a2a3-b8db2c992d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:30.232899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf590-a6bb-4adf-a2a3-b8db2c992d7a admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:30.234243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cf590-a6bb-4adf-a2a3-b8db2c992d7a admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:30.236789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cf590-a6bb-4adf-a2a3-b8db2c992d7a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:30.239408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 92/187] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:30 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:30.250641 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c962041-7099-4747-8bd7-4dc2022f1782 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:30.260708 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c962041-7099-4747-8bd7-4dc2022f1782 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:30.265419 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7de359-3ce8-4730-94b4-ca0b085b3a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:30.266092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de359-3ce8-4730-94b4-ca0b085b3a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:30.266425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de359-3ce8-4730-94b4-ca0b085b3a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:30.267100 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de359-3ce8-4730-94b4-ca0b085b3a00 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:30.268097 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7de359-3ce8-4730-94b4-ca0b085b3a00 admin admin] RBAC: Adding query filter params (role.id=a4a3a42f23b2463ebc5e198fe56ac656, scope.project.id=9dec779bc5f842f88b59b29d486b4aa2, user.id=d1c4f01bf6464c349a0eb731c3535142) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:30.268509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7de359-3ce8-4730-94b4-ca0b085b3a00 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:30.270939 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7de359-3ce8-4730-94b4-ca0b085b3a00 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:30.277635 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 96/188] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:30 2021] GET /identity/v3/role_assignments?user.id=d1c4f01bf6464c349a0eb731c3535142&scope.project.id=9dec779bc5f842f88b59b29d486b4aa2&role.id=a4a3a42f23b2463ebc5e198fe56ac656 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:31.562556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399f4ea-68ea-484c-b2ab-37fa9a4bc2ae None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:31.563075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399f4ea-68ea-484c-b2ab-37fa9a4bc2ae None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:31.563075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399f4ea-68ea-484c-b2ab-37fa9a4bc2ae None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:31.564919 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 93/189] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:31.571474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af45fe4-641b-4c6b-bd93-439803c7b0c7 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:31.571965 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af45fe4-641b-4c6b-bd93-439803c7b0c7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:31.572041 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af45fe4-641b-4c6b-bd93-439803c7b0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:31.593415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-7af45fe4-641b-4c6b-bd93-439803c7b0c7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:31.594624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7af45fe4-641b-4c6b-bd93-439803c7b0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:31.607234 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 97/190] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:31.626593 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399f4ea-68ea-484c-b2ab-37fa9a4bc2ae None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:31.638965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399f4ea-68ea-484c-b2ab-37fa9a4bc2ae None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:31.643677 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb93fbf-53e9-4855-a323-8df1b7e3bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:31.644454 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb93fbf-53e9-4855-a323-8df1b7e3bf05 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:31.644739 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb93fbf-53e9-4855-a323-8df1b7e3bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:31.645013 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb93fbf-53e9-4855-a323-8df1b7e3bf05 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:31.655426 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb93fbf-53e9-4855-a323-8df1b7e3bf05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:31.662392 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-2cb93fbf-53e9-4855-a323-8df1b7e3bf05 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:31.663647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 94/191] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:31.670275 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af45fe4-641b-4c6b-bd93-439803c7b0c7 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:31.679388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af45fe4-641b-4c6b-bd93-439803c7b0c7 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:31.683864 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816c0e9-6c48-4a23-b2b5-d2a4f12fed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:31.684536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816c0e9-6c48-4a23-b2b5-d2a4f12fed84 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:31.684817 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816c0e9-6c48-4a23-b2b5-d2a4f12fed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:31.685090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816c0e9-6c48-4a23-b2b5-d2a4f12fed84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:31.685860 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816c0e9-6c48-4a23-b2b5-d2a4f12fed84 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:31.686166 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816c0e9-6c48-4a23-b2b5-d2a4f12fed84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:31.687844 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816c0e9-6c48-4a23-b2b5-d2a4f12fed84 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:31.696545 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 98/192] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:31.702963 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb93fbf-53e9-4855-a323-8df1b7e3bf05 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:31.712791 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb93fbf-53e9-4855-a323-8df1b7e3bf05 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:31.717216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042f6c8-988c-4255-a886-8a6ed6d77d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:31.718028 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042f6c8-988c-4255-a886-8a6ed6d77d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:31.718296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042f6c8-988c-4255-a886-8a6ed6d77d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:31.718567 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042f6c8-988c-4255-a886-8a6ed6d77d47 admin admin] PATH_INFO: `/v3/users/d1c4f01bf6464c349a0eb731c3535142` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:31.719797 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042f6c8-988c-4255-a886-8a6ed6d77d47 admin admin] RBAC: Authorizing `identity:get_user(user_id=d1c4f01bf6464c349a0eb731c3535142)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:31.722005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042f6c8-988c-4255-a886-8a6ed6d77d47 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:31.723630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 95/193] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:31 2021] GET /identity/v3/users/d1c4f01bf6464c349a0eb731c3535142 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:31.729829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816c0e9-6c48-4a23-b2b5-d2a4f12fed84 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:31.739480 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816c0e9-6c48-4a23-b2b5-d2a4f12fed84 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:31.743842 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bcd0b-dec1-4acf-af94-4284c7e23332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:31.744695 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bcd0b-dec1-4acf-af94-4284c7e23332 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:31.744970 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bcd0b-dec1-4acf-af94-4284c7e23332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:31.745242 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bcd0b-dec1-4acf-af94-4284c7e23332 admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:31.746452 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bcd0b-dec1-4acf-af94-4284c7e23332 admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:31.748610 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bcd0b-dec1-4acf-af94-4284c7e23332 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:31.750397 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 99/194] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:31 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:31.757350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042f6c8-988c-4255-a886-8a6ed6d77d47 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:31.768841 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042f6c8-988c-4255-a886-8a6ed6d77d47 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:31.773443 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7dc50-feca-4dac-a8ed-d5eaf08123b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:31.774367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7dc50-feca-4dac-a8ed-d5eaf08123b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:31.774649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7dc50-feca-4dac-a8ed-d5eaf08123b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:31.774922 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7dc50-feca-4dac-a8ed-d5eaf08123b2 admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2/users/d1c4f01bf6464c349a0eb731c3535142/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:31.777085 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7dc50-feca-4dac-a8ed-d5eaf08123b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dec779bc5f842f88b59b29d486b4aa2, user_id=d1c4f01bf6464c349a0eb731c3535142, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:31.779857 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7dc50-feca-4dac-a8ed-d5eaf08123b2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:31.797908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 96/195] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:48:31 2021] PUT /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2/users/d1c4f01bf6464c349a0eb731c3535142/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:48:31.904260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da174ae-a33b-4a2a-b7dd-5ee8c034d167 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:31.904590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da174ae-a33b-4a2a-b7dd-5ee8c034d167 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:31.904812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da174ae-a33b-4a2a-b7dd-5ee8c034d167 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:31.906722 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 100/196] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:31.913239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07750-f967-463f-8694-bc43775bc2cb None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:31.913521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07750-f967-463f-8694-bc43775bc2cb None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:31.913795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07750-f967-463f-8694-bc43775bc2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:31.932740 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-09b07750-f967-463f-8694-bc43775bc2cb None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:31.933971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-09b07750-f967-463f-8694-bc43775bc2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:31.997333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 97/197] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:32.022644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da174ae-a33b-4a2a-b7dd-5ee8c034d167 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:32.035473 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da174ae-a33b-4a2a-b7dd-5ee8c034d167 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:32.041389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22634fe1-ee64-410e-b418-aae059a05c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:32.042235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22634fe1-ee64-410e-b418-aae059a05c27 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.042566 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22634fe1-ee64-410e-b418-aae059a05c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.042841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22634fe1-ee64-410e-b418-aae059a05c27 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.054137 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22634fe1-ee64-410e-b418-aae059a05c27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:32.061174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-22634fe1-ee64-410e-b418-aae059a05c27 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:48:32.062442 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 101/198] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:48:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:32.069293 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b07750-f967-463f-8694-bc43775bc2cb None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:32.078412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b07750-f967-463f-8694-bc43775bc2cb None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:32.083595 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6bb31-7656-4907-b2ee-f6cae12a8be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:32.084286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6bb31-7656-4907-b2ee-f6cae12a8be6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.084566 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6bb31-7656-4907-b2ee-f6cae12a8be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.084835 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6bb31-7656-4907-b2ee-f6cae12a8be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.085673 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6bb31-7656-4907-b2ee-f6cae12a8be6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:32.085979 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6bb31-7656-4907-b2ee-f6cae12a8be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:32.087621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6bb31-7656-4907-b2ee-f6cae12a8be6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:32.096965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 98/199] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:32.103437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22634fe1-ee64-410e-b418-aae059a05c27 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:32.114335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22634fe1-ee64-410e-b418-aae059a05c27 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:32.118997 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425d66a-f3f4-4a6c-85d6-1ab21ee32ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:32.119945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425d66a-f3f4-4a6c-85d6-1ab21ee32ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.120222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425d66a-f3f4-4a6c-85d6-1ab21ee32ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.120499 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425d66a-f3f4-4a6c-85d6-1ab21ee32ae8 admin admin] PATH_INFO: `/v3/users/23015594a30b49b885e3a6236f3a6f37` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.121752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425d66a-f3f4-4a6c-85d6-1ab21ee32ae8 admin admin] RBAC: Authorizing `identity:get_user(user_id=23015594a30b49b885e3a6236f3a6f37)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:32.123830 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425d66a-f3f4-4a6c-85d6-1ab21ee32ae8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:32.125724 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 102/200] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:32 2021] GET /identity/v3/users/23015594a30b49b885e3a6236f3a6f37 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:32.132071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6bb31-7656-4907-b2ee-f6cae12a8be6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:32.144777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6bb31-7656-4907-b2ee-f6cae12a8be6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:32.149396 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346e9d6-9d7a-424d-acf9-98603cda5eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:32.150264 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e9d6-9d7a-424d-acf9-98603cda5eec admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.150589 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e9d6-9d7a-424d-acf9-98603cda5eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.150867 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e9d6-9d7a-424d-acf9-98603cda5eec admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.152146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346e9d6-9d7a-424d-acf9-98603cda5eec admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:32.154341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346e9d6-9d7a-424d-acf9-98603cda5eec admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:32.156440 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 99/201] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:32 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:32.162845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425d66a-f3f4-4a6c-85d6-1ab21ee32ae8 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:32.172781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425d66a-f3f4-4a6c-85d6-1ab21ee32ae8 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:32.177421 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed570353-fe5c-4f6f-b774-541f7856d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:32.178348 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed570353-fe5c-4f6f-b774-541f7856d7df admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.178631 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed570353-fe5c-4f6f-b774-541f7856d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.178901 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed570353-fe5c-4f6f-b774-541f7856d7df admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2/users/23015594a30b49b885e3a6236f3a6f37/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.181032 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed570353-fe5c-4f6f-b774-541f7856d7df admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dec779bc5f842f88b59b29d486b4aa2, user_id=23015594a30b49b885e3a6236f3a6f37, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:32.182101 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-ed570353-fe5c-4f6f-b774-541f7856d7df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:32.182101 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:48:32.182101 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:48:32.184190 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed570353-fe5c-4f6f-b774-541f7856d7df admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:32.201970 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 103/202] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:48:32 2021] PUT /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2/users/23015594a30b49b885e3a6236f3a6f37/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:48:32.429716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f298cc-23cf-45e7-b0b5-2553b390acda None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.430069 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f298cc-23cf-45e7-b0b5-2553b390acda None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.430271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f298cc-23cf-45e7-b0b5-2553b390acda None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.432222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 100/203] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:32.438418 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2f34f-e0df-4917-9c17-e165fed87bb0 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.438709 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2f34f-e0df-4917-9c17-e165fed87bb0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.438981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2f34f-e0df-4917-9c17-e165fed87bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.460316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-e8d2f34f-e0df-4917-9c17-e165fed87bb0 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:32.461510 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e8d2f34f-e0df-4917-9c17-e165fed87bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:32.521632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 104/204] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:32.546342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f298cc-23cf-45e7-b0b5-2553b390acda None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:32.559589 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f298cc-23cf-45e7-b0b5-2553b390acda None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:32.564390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d3538-a526-48da-b0aa-5028017382f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:32.565297 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d3538-a526-48da-b0aa-5028017382f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.565580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d3538-a526-48da-b0aa-5028017382f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.565907 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d3538-a526-48da-b0aa-5028017382f3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.567380 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d3538-a526-48da-b0aa-5028017382f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:32.569177 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d3538-a526-48da-b0aa-5028017382f3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:32.570829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 101/205] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:32.577271 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2f34f-e0df-4917-9c17-e165fed87bb0 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:32.586895 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2f34f-e0df-4917-9c17-e165fed87bb0 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:32.591546 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f94832-6665-4af7-8706-cf504a8d3910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:32.592259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f94832-6665-4af7-8706-cf504a8d3910 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.592591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f94832-6665-4af7-8706-cf504a8d3910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.592866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f94832-6665-4af7-8706-cf504a8d3910 admin admin] PATH_INFO: `/v3/groups` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.593588 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f94832-6665-4af7-8706-cf504a8d3910 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:32.595634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f94832-6665-4af7-8706-cf504a8d3910 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:32.613046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 105/206] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Nov 8 10:48:32 2021] POST /identity/v3/groups => generated 226 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 10:48:32.677949 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0514071-3dac-47da-8a68-c06fcc51a7e4 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.678303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0514071-3dac-47da-8a68-c06fcc51a7e4 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.678495 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0514071-3dac-47da-8a68-c06fcc51a7e4 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.680450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 102/207] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:32.687141 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0965c5-2e07-4c37-9b65-98e06629d4ee None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.687467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0965c5-2e07-4c37-9b65-98e06629d4ee None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.687855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0965c5-2e07-4c37-9b65-98e06629d4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.708108 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-fd0965c5-2e07-4c37-9b65-98e06629d4ee None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:32.709399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-fd0965c5-2e07-4c37-9b65-98e06629d4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:32.717335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 106/208] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:32.742149 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0514071-3dac-47da-8a68-c06fcc51a7e4 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:32.755360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0514071-3dac-47da-8a68-c06fcc51a7e4 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:32.760036 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3eee7-1959-42df-80f5-599b3f3623ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:32.760917 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3eee7-1959-42df-80f5-599b3f3623ff admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.761200 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3eee7-1959-42df-80f5-599b3f3623ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.761555 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3eee7-1959-42df-80f5-599b3f3623ff admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.774698 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3eee7-1959-42df-80f5-599b3f3623ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:32.782447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-40d3eee7-1959-42df-80f5-599b3f3623ff admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 08 10:48:32.783878 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 103/209] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:48:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:32.790701 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0965c5-2e07-4c37-9b65-98e06629d4ee None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:32.800475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0965c5-2e07-4c37-9b65-98e06629d4ee None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:32.805071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630004a4-fa82-4ea0-b666-2f7f3b1fff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:32.805769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630004a4-fa82-4ea0-b666-2f7f3b1fff18 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.806074 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630004a4-fa82-4ea0-b666-2f7f3b1fff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.806348 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630004a4-fa82-4ea0-b666-2f7f3b1fff18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.807321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630004a4-fa82-4ea0-b666-2f7f3b1fff18 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:32.807625 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630004a4-fa82-4ea0-b666-2f7f3b1fff18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:32.809292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630004a4-fa82-4ea0-b666-2f7f3b1fff18 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:32.819003 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 107/210] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:32.825395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3eee7-1959-42df-80f5-599b3f3623ff admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:32.836141 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3eee7-1959-42df-80f5-599b3f3623ff admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:32.840387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea5fe7-7b4d-4935-873e-ef0817fa2fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:32.841254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea5fe7-7b4d-4935-873e-ef0817fa2fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.841534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea5fe7-7b4d-4935-873e-ef0817fa2fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.841807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea5fe7-7b4d-4935-873e-ef0817fa2fa2 admin admin] PATH_INFO: `/v3/users/d1c4f01bf6464c349a0eb731c3535142` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.843004 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea5fe7-7b4d-4935-873e-ef0817fa2fa2 admin admin] RBAC: Authorizing `identity:get_user(user_id=d1c4f01bf6464c349a0eb731c3535142)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:32.845158 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea5fe7-7b4d-4935-873e-ef0817fa2fa2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:32.846788 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 104/211] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:32 2021] GET /identity/v3/users/d1c4f01bf6464c349a0eb731c3535142 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:32.852919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630004a4-fa82-4ea0-b666-2f7f3b1fff18 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:32.863314 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630004a4-fa82-4ea0-b666-2f7f3b1fff18 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:32.867919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee326a-d8ea-4202-9d30-2ffedde6f3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:32.868779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee326a-d8ea-4202-9d30-2ffedde6f3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.869062 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee326a-d8ea-4202-9d30-2ffedde6f3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.869332 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee326a-d8ea-4202-9d30-2ffedde6f3f6 admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.870503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee326a-d8ea-4202-9d30-2ffedde6f3f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:32.872597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee326a-d8ea-4202-9d30-2ffedde6f3f6 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:32.874252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 108/212] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:32 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:32.880648 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea5fe7-7b4d-4935-873e-ef0817fa2fa2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:32.890496 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea5fe7-7b4d-4935-873e-ef0817fa2fa2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:32.895536 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f89549-1443-4e64-9cb0-993f138e7e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:32.896466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89549-1443-4e64-9cb0-993f138e7e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:32.896743 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89549-1443-4e64-9cb0-993f138e7e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:32.897019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89549-1443-4e64-9cb0-993f138e7e35 admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2/users/d1c4f01bf6464c349a0eb731c3535142/roles/a4a3a42f23b2463ebc5e198fe56ac656` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:32.899330 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f89549-1443-4e64-9cb0-993f138e7e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dec779bc5f842f88b59b29d486b4aa2, user_id=d1c4f01bf6464c349a0eb731c3535142, role_id=a4a3a42f23b2463ebc5e198fe56ac656)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:32.902120 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f89549-1443-4e64-9cb0-993f138e7e35 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:32.917718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 105/213] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:48:32 2021] PUT /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2/users/d1c4f01bf6464c349a0eb731c3535142/roles/a4a3a42f23b2463ebc5e198fe56ac656 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 10:48:34.447965 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82787c8-3729-4016-8bd8-6e81051e745d None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:34.448611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82787c8-3729-4016-8bd8-6e81051e745d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:34.448611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82787c8-3729-4016-8bd8-6e81051e745d None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:34.450285 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 109/214] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:34.456674 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b24b1f-db4b-4b30-aced-828e4303ea72 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:34.457222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b24b1f-db4b-4b30-aced-828e4303ea72 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:34.457222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b24b1f-db4b-4b30-aced-828e4303ea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:34.480608 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-88b24b1f-db4b-4b30-aced-828e4303ea72 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:34.481819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-88b24b1f-db4b-4b30-aced-828e4303ea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:34.555094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 106/215] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:34.592427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82787c8-3729-4016-8bd8-6e81051e745d None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:34.605381 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82787c8-3729-4016-8bd8-6e81051e745d None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:34.610344 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961a339-7cf9-42b4-9d18-c356529ab862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:34.611192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961a339-7cf9-42b4-9d18-c356529ab862 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:34.611563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961a339-7cf9-42b4-9d18-c356529ab862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:34.611839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961a339-7cf9-42b4-9d18-c356529ab862 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:34.624095 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961a339-7cf9-42b4-9d18-c356529ab862 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:34.631144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-e961a339-7cf9-42b4-9d18-c356529ab862 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:34.636882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 110/216] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:34.643647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b24b1f-db4b-4b30-aced-828e4303ea72 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:34.657131 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b24b1f-db4b-4b30-aced-828e4303ea72 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:34.668279 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebf0d4-fcb2-42f8-a549-e7880e9af0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:34.668968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebf0d4-fcb2-42f8-a549-e7880e9af0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:34.669247 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebf0d4-fcb2-42f8-a549-e7880e9af0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:34.669520 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebf0d4-fcb2-42f8-a549-e7880e9af0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:34.670291 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebf0d4-fcb2-42f8-a549-e7880e9af0e0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:34.670594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebf0d4-fcb2-42f8-a549-e7880e9af0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:34.672232 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebf0d4-fcb2-42f8-a549-e7880e9af0e0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:34.689185 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 107/217] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:34.695613 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961a339-7cf9-42b4-9d18-c356529ab862 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:34.717474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961a339-7cf9-42b4-9d18-c356529ab862 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:34.721985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865778d-273a-45d5-895b-7eed4ead3622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:34.722985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865778d-273a-45d5-895b-7eed4ead3622 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:34.723293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865778d-273a-45d5-895b-7eed4ead3622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:34.723564 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865778d-273a-45d5-895b-7eed4ead3622 admin admin] PATH_INFO: `/v3/users/d1c4f01bf6464c349a0eb731c3535142` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:34.725485 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865778d-273a-45d5-895b-7eed4ead3622 admin admin] RBAC: Authorizing `identity:get_user(user_id=d1c4f01bf6464c349a0eb731c3535142)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:34.727676 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865778d-273a-45d5-895b-7eed4ead3622 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:34.729342 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 111/218] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:34 2021] GET /identity/v3/users/d1c4f01bf6464c349a0eb731c3535142 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:34.735647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebf0d4-fcb2-42f8-a549-e7880e9af0e0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:34.746225 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebf0d4-fcb2-42f8-a549-e7880e9af0e0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:34.755499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb3547-bdcd-49bd-b0e5-6ca3f4a191e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:34.756168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb3547-bdcd-49bd-b0e5-6ca3f4a191e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:34.756447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb3547-bdcd-49bd-b0e5-6ca3f4a191e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:34.756724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb3547-bdcd-49bd-b0e5-6ca3f4a191e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:34.771339 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb3547-bdcd-49bd-b0e5-6ca3f4a191e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:34.773128 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb3547-bdcd-49bd-b0e5-6ca3f4a191e2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:34.784880 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 108/219] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:34.791531 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865778d-273a-45d5-895b-7eed4ead3622 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:34.801667 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865778d-273a-45d5-895b-7eed4ead3622 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:34.811163 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d5f73-08d1-4ea6-bf50-85990011413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:34.812035 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d5f73-08d1-4ea6-bf50-85990011413b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:34.812320 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d5f73-08d1-4ea6-bf50-85990011413b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:34.812597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d5f73-08d1-4ea6-bf50-85990011413b admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:34.813818 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d5f73-08d1-4ea6-bf50-85990011413b admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:34.815975 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d5f73-08d1-4ea6-bf50-85990011413b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:34.817831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 112/220] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:34 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:34.824574 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb3547-bdcd-49bd-b0e5-6ca3f4a191e2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:34.833817 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb3547-bdcd-49bd-b0e5-6ca3f4a191e2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:34.840217 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6724a3d-e211-4cba-b9b1-34d12a747c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:34.840881 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6724a3d-e211-4cba-b9b1-34d12a747c76 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:34.841167 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6724a3d-e211-4cba-b9b1-34d12a747c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:34.841443 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6724a3d-e211-4cba-b9b1-34d12a747c76 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:34.842294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6724a3d-e211-4cba-b9b1-34d12a747c76 admin admin] RBAC: Adding query filter params (role.id=2dce671f5a1a43da869724374e62098b, scope.project.id=9dec779bc5f842f88b59b29d486b4aa2, user.id=d1c4f01bf6464c349a0eb731c3535142) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:34.842609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6724a3d-e211-4cba-b9b1-34d12a747c76 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:34.844504 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6724a3d-e211-4cba-b9b1-34d12a747c76 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:34.855678 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 109/221] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:34 2021] GET /identity/v3/role_assignments?user.id=d1c4f01bf6464c349a0eb731c3535142&scope.project.id=9dec779bc5f842f88b59b29d486b4aa2&role.id=2dce671f5a1a43da869724374e62098b => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:35.152718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc5894-a9c2-4470-ac60-5638928ddb2e None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:35.153015 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc5894-a9c2-4470-ac60-5638928ddb2e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:35.153230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc5894-a9c2-4470-ac60-5638928ddb2e None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:35.155065 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 113/222] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:35.163048 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88f1d5-04ea-4abe-bbf8-b06b802ba357 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:35.163384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88f1d5-04ea-4abe-bbf8-b06b802ba357 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:35.163637 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88f1d5-04ea-4abe-bbf8-b06b802ba357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:35.192889 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-aa88f1d5-04ea-4abe-bbf8-b06b802ba357 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:35.194138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-aa88f1d5-04ea-4abe-bbf8-b06b802ba357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:35.209618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 110/223] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:35.255553 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc5894-a9c2-4470-ac60-5638928ddb2e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:35.273861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc5894-a9c2-4470-ac60-5638928ddb2e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:35.283953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd4ddc-e0b0-43c5-a016-3c2ce1b4b3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:35.285187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd4ddc-e0b0-43c5-a016-3c2ce1b4b3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:35.285475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd4ddc-e0b0-43c5-a016-3c2ce1b4b3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:35.285752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd4ddc-e0b0-43c5-a016-3c2ce1b4b3b9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:35.297486 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd4ddc-e0b0-43c5-a016-3c2ce1b4b3b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:35.305002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-fddd4ddc-e0b0-43c5-a016-3c2ce1b4b3b9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:48:35.306264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 114/224] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:48:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:35.312860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88f1d5-04ea-4abe-bbf8-b06b802ba357 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:35.328568 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88f1d5-04ea-4abe-bbf8-b06b802ba357 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:35.336411 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbdcbe-1c50-4c89-828b-bb7677a55065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:35.337109 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbdcbe-1c50-4c89-828b-bb7677a55065 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:35.337391 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbdcbe-1c50-4c89-828b-bb7677a55065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:35.337665 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbdcbe-1c50-4c89-828b-bb7677a55065 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:35.338455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbdcbe-1c50-4c89-828b-bb7677a55065 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:35.338755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbdcbe-1c50-4c89-828b-bb7677a55065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:35.340412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbdcbe-1c50-4c89-828b-bb7677a55065 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:35.358196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 111/225] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:35.364855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd4ddc-e0b0-43c5-a016-3c2ce1b4b3b9 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:35.376648 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd4ddc-e0b0-43c5-a016-3c2ce1b4b3b9 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:35.382084 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f07f74-a768-48d9-a97b-fd35941e1f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:35.382977 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f07f74-a768-48d9-a97b-fd35941e1f00 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:35.383310 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f07f74-a768-48d9-a97b-fd35941e1f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:35.383583 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f07f74-a768-48d9-a97b-fd35941e1f00 admin admin] PATH_INFO: `/v3/users/23015594a30b49b885e3a6236f3a6f37` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:35.387058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f07f74-a768-48d9-a97b-fd35941e1f00 admin admin] RBAC: Authorizing `identity:get_user(user_id=23015594a30b49b885e3a6236f3a6f37)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:35.388934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f07f74-a768-48d9-a97b-fd35941e1f00 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:35.390599 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 115/226] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:35 2021] GET /identity/v3/users/23015594a30b49b885e3a6236f3a6f37 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:35.397890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbdcbe-1c50-4c89-828b-bb7677a55065 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:35.408018 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbdcbe-1c50-4c89-828b-bb7677a55065 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:35.413605 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126016bf-9d0f-445e-b67e-5976eb78a3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:35.414263 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126016bf-9d0f-445e-b67e-5976eb78a3bd admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:35.414554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126016bf-9d0f-445e-b67e-5976eb78a3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:35.414821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126016bf-9d0f-445e-b67e-5976eb78a3bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:35.425002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126016bf-9d0f-445e-b67e-5976eb78a3bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:35.427097 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126016bf-9d0f-445e-b67e-5976eb78a3bd admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:35.437329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 112/227] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:35.444224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f07f74-a768-48d9-a97b-fd35941e1f00 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:35.454596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f07f74-a768-48d9-a97b-fd35941e1f00 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:35.466566 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f03024-6319-4dcd-9abb-3ef8dcb98be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:35.467195 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f03024-6319-4dcd-9abb-3ef8dcb98be0 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:35.467484 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f03024-6319-4dcd-9abb-3ef8dcb98be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:35.467760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f03024-6319-4dcd-9abb-3ef8dcb98be0 admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:35.475634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f03024-6319-4dcd-9abb-3ef8dcb98be0 admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:35.477727 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f03024-6319-4dcd-9abb-3ef8dcb98be0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:35.479566 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 116/228] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:35 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:35.486161 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126016bf-9d0f-445e-b67e-5976eb78a3bd admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:35.500375 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126016bf-9d0f-445e-b67e-5976eb78a3bd admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:35.509068 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73167c-176c-4b36-b49e-4235a8dc4661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:35.509736 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73167c-176c-4b36-b49e-4235a8dc4661 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:35.510019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73167c-176c-4b36-b49e-4235a8dc4661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:35.510294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73167c-176c-4b36-b49e-4235a8dc4661 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:35.511177 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73167c-176c-4b36-b49e-4235a8dc4661 admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=9dec779bc5f842f88b59b29d486b4aa2, user.id=23015594a30b49b885e3a6236f3a6f37) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:35.511493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73167c-176c-4b36-b49e-4235a8dc4661 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:35.513362 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73167c-176c-4b36-b49e-4235a8dc4661 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:35.524028 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 113/229] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:35 2021] GET /identity/v3/role_assignments?user.id=23015594a30b49b885e3a6236f3a6f37&scope.project.id=9dec779bc5f842f88b59b29d486b4aa2&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:36.243538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02203b-3e2e-46e0-88d2-0e414a17b793 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.243917 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02203b-3e2e-46e0-88d2-0e414a17b793 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.244098 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02203b-3e2e-46e0-88d2-0e414a17b793 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.246157 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 117/230] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:36.252131 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40a2cb-c908-4891-9fda-fbbe89d1852b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.252423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40a2cb-c908-4891-9fda-fbbe89d1852b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.252809 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40a2cb-c908-4891-9fda-fbbe89d1852b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.279167 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-9e40a2cb-c908-4891-9fda-fbbe89d1852b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:36.280376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9e40a2cb-c908-4891-9fda-fbbe89d1852b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:36.292477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9e63f-a3cb-491e-98ba-ba42ede891c1 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.292773 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9e63f-a3cb-491e-98ba-ba42ede891c1 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.293027 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9e63f-a3cb-491e-98ba-ba42ede891c1 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.294985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 118/231] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:48:36.297247 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 114/232] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:36.303457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d4db4-2d71-456a-ad6e-160ef36ff3a8 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.303457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d4db4-2d71-456a-ad6e-160ef36ff3a8 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.303457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d4db4-2d71-456a-ad6e-160ef36ff3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.326612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-cd7d4db4-2d71-456a-ad6e-160ef36ff3a8 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:36.328198 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-cd7d4db4-2d71-456a-ad6e-160ef36ff3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:36.337245 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40a2cb-c908-4891-9fda-fbbe89d1852b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:36.341954 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 119/233] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:36.350881 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40a2cb-c908-4891-9fda-fbbe89d1852b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:36.359156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2bcbb-63db-44d8-8eb4-eeb3688134ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:36.359981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2bcbb-63db-44d8-8eb4-eeb3688134ef admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.360276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2bcbb-63db-44d8-8eb4-eeb3688134ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.360543 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2bcbb-63db-44d8-8eb4-eeb3688134ef admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.383383 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2bcbb-63db-44d8-8eb4-eeb3688134ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:36.385828 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d4db4-2d71-456a-ad6e-160ef36ff3a8 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:36.391982 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-f3b2bcbb-63db-44d8-8eb4-eeb3688134ef admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 08 10:48:36.396353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 115/234] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:48:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:36.397381 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d4db4-2d71-456a-ad6e-160ef36ff3a8 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:36.402492 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2bcbb-63db-44d8-8eb4-eeb3688134ef admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:36.404022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336aae4-a91c-4310-a9bc-d13ad5dd2055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:36.405941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336aae4-a91c-4310-a9bc-d13ad5dd2055 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.406413 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336aae4-a91c-4310-a9bc-d13ad5dd2055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.406870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336aae4-a91c-4310-a9bc-d13ad5dd2055 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.416048 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2bcbb-63db-44d8-8eb4-eeb3688134ef admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:36.423401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336aae4-a91c-4310-a9bc-d13ad5dd2055 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:36.423537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ffff-3aee-4048-8995-7b97a752029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:36.424209 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ffff-3aee-4048-8995-7b97a752029d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.424556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ffff-3aee-4048-8995-7b97a752029d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.425036 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ffff-3aee-4048-8995-7b97a752029d admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.425879 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527ffff-3aee-4048-8995-7b97a752029d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:36.426187 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527ffff-3aee-4048-8995-7b97a752029d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:36.427861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527ffff-3aee-4048-8995-7b97a752029d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:36.432954 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-0336aae4-a91c-4310-a9bc-d13ad5dd2055 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:36.434934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 120/235] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:36.441811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336aae4-a91c-4310-a9bc-d13ad5dd2055 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:36.442347 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 116/236] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:36.448353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ffff-3aee-4048-8995-7b97a752029d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:36.455448 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336aae4-a91c-4310-a9bc-d13ad5dd2055 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:36.464467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579021b-b6db-4a9f-bee9-897a28213121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:36.465199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579021b-b6db-4a9f-bee9-897a28213121 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.465479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579021b-b6db-4a9f-bee9-897a28213121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.465804 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579021b-b6db-4a9f-bee9-897a28213121 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.466578 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579021b-b6db-4a9f-bee9-897a28213121 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:36.466934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579021b-b6db-4a9f-bee9-897a28213121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:36.468820 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579021b-b6db-4a9f-bee9-897a28213121 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:36.476923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ffff-3aee-4048-8995-7b97a752029d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:36.486117 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 121/237] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:36 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:36.486892 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f71812-4f3f-4646-87ec-ff47f058d225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:36.488765 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f71812-4f3f-4646-87ec-ff47f058d225 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.489194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f71812-4f3f-4646-87ec-ff47f058d225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.489609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f71812-4f3f-4646-87ec-ff47f058d225 admin admin] PATH_INFO: `/v3/users/d1c4f01bf6464c349a0eb731c3535142` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.492113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f71812-4f3f-4646-87ec-ff47f058d225 admin admin] RBAC: Authorizing `identity:get_user(user_id=d1c4f01bf6464c349a0eb731c3535142)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:36.492578 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579021b-b6db-4a9f-bee9-897a28213121 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:36.494688 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f71812-4f3f-4646-87ec-ff47f058d225 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:36.500909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 117/238] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:48:36 2021] GET /identity/v3/users/d1c4f01bf6464c349a0eb731c3535142 => generated 283 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:36.506818 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f71812-4f3f-4646-87ec-ff47f058d225 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:36.506964 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579021b-b6db-4a9f-bee9-897a28213121 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:36.513472 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8d9df-d9a3-49dc-ba0b-9748e47644a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:36.514178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8d9df-d9a3-49dc-ba0b-9748e47644a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.514454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8d9df-d9a3-49dc-ba0b-9748e47644a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.514723 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8d9df-d9a3-49dc-ba0b-9748e47644a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.524467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f71812-4f3f-4646-87ec-ff47f058d225 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:36.528269 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8d9df-d9a3-49dc-ba0b-9748e47644a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:36.530273 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8d9df-d9a3-49dc-ba0b-9748e47644a1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:36.543814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b9a13-1bce-47c6-8384-7e6a2e4f490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:36.544710 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b9a13-1bce-47c6-8384-7e6a2e4f490e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.544996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 122/239] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:36 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:36.545285 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b9a13-1bce-47c6-8384-7e6a2e4f490e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.545728 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b9a13-1bce-47c6-8384-7e6a2e4f490e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.551201 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8d9df-d9a3-49dc-ba0b-9748e47644a1 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:36.558879 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b9a13-1bce-47c6-8384-7e6a2e4f490e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:36.560989 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b9a13-1bce-47c6-8384-7e6a2e4f490e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:36.563085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8d9df-d9a3-49dc-ba0b-9748e47644a1 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:36.569933 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a9d2e-5127-4380-82bc-c78c8021070c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:36.571173 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a9d2e-5127-4380-82bc-c78c8021070c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.571528 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a9d2e-5127-4380-82bc-c78c8021070c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.571882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a9d2e-5127-4380-82bc-c78c8021070c admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.573141 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a9d2e-5127-4380-82bc-c78c8021070c admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:36.574396 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 118/240] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:36 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 08 10:48:36.575472 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a9d2e-5127-4380-82bc-c78c8021070c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:36.577264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 123/241] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:36 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:36.580477 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b9a13-1bce-47c6-8384-7e6a2e4f490e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:36.583647 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a9d2e-5127-4380-82bc-c78c8021070c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:36.596096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a9d2e-5127-4380-82bc-c78c8021070c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:36.596823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b9a13-1bce-47c6-8384-7e6a2e4f490e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:36.605407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d1f07-39e3-41ef-9d8f-331693207f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:36.606722 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1f07-39e3-41ef-9d8f-331693207f10 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.606998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1f07-39e3-41ef-9d8f-331693207f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.607911 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1f07-39e3-41ef-9d8f-331693207f10 admin admin] PATH_INFO: `/v3/groups/3c1c245a19ed471c91b01dde04f4985a` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.612215 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965334a1-7183-4c75-ba2f-06526ce5619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:36.613320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965334a1-7183-4c75-ba2f-06526ce5619a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.613605 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965334a1-7183-4c75-ba2f-06526ce5619a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.613877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965334a1-7183-4c75-ba2f-06526ce5619a admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.617336 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965334a1-7183-4c75-ba2f-06526ce5619a admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:36.620735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965334a1-7183-4c75-ba2f-06526ce5619a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:36.623021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d1f07-39e3-41ef-9d8f-331693207f10 admin admin] RBAC: Authorizing `identity:get_group(group_id=3c1c245a19ed471c91b01dde04f4985a)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:36.624127 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-336d1f07-39e3-41ef-9d8f-331693207f10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:36.624127 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:48:36.624127 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:48:36.625958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 119/242] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:36 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:36.626621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d1f07-39e3-41ef-9d8f-331693207f10 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:36.628596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 124/243] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:36 2021] GET /identity/v3/groups/3c1c245a19ed471c91b01dde04f4985a => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:36.634883 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965334a1-7183-4c75-ba2f-06526ce5619a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:36.638324 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d1f07-39e3-41ef-9d8f-331693207f10 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:36.653332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965334a1-7183-4c75-ba2f-06526ce5619a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:36.659893 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d1f07-39e3-41ef-9d8f-331693207f10 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:36.663032 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f454485-38f9-4046-988a-3e7d31c6b278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:36.665044 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f454485-38f9-4046-988a-3e7d31c6b278 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.665333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f454485-38f9-4046-988a-3e7d31c6b278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.666120 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f454485-38f9-4046-988a-3e7d31c6b278 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.667515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f454485-38f9-4046-988a-3e7d31c6b278 admin admin] RBAC: Adding query filter params (role.id=a4a3a42f23b2463ebc5e198fe56ac656, scope.project.id=9dec779bc5f842f88b59b29d486b4aa2, user.id=d1c4f01bf6464c349a0eb731c3535142) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:36.667828 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f454485-38f9-4046-988a-3e7d31c6b278 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:36.670224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0761f6-b203-437c-9872-2b50a5565a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:36.671777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f454485-38f9-4046-988a-3e7d31c6b278 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:36.672182 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0761f6-b203-437c-9872-2b50a5565a3f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:36.672513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0761f6-b203-437c-9872-2b50a5565a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:36.672793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0761f6-b203-437c-9872-2b50a5565a3f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:36.673637 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0761f6-b203-437c-9872-2b50a5565a3f admin admin] RBAC: Adding query filter params (group.id=3c1c245a19ed471c91b01dde04f4985a, role.id=2dce671f5a1a43da869724374e62098b, scope.project.id=d6453f0e70ff411fbd16c7407a3e8446) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:36.675813 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0761f6-b203-437c-9872-2b50a5565a3f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:36.677717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0761f6-b203-437c-9872-2b50a5565a3f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:36.686025 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 120/244] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:36 2021] GET /identity/v3/role_assignments?user.id=d1c4f01bf6464c349a0eb731c3535142&scope.project.id=9dec779bc5f842f88b59b29d486b4aa2&role.id=a4a3a42f23b2463ebc5e198fe56ac656 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:36.688670 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 125/245] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Nov 8 10:48:36 2021] GET /identity/v3/role_assignments?group.id=3c1c245a19ed471c91b01dde04f4985a&scope.project.id=d6453f0e70ff411fbd16c7407a3e8446&role.id=2dce671f5a1a43da869724374e62098b => generated 260 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:37.213622 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff92d1-de3f-4b90-9758-14107e47f382 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:37.213996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff92d1-de3f-4b90-9758-14107e47f382 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:37.214180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff92d1-de3f-4b90-9758-14107e47f382 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:37.215966 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 121/246] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:37.222467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e2318-a41a-4b84-b92b-d9461e14aadf None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:37.222758 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e2318-a41a-4b84-b92b-d9461e14aadf None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:37.223040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e2318-a41a-4b84-b92b-d9461e14aadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:37.247340 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-8f5e2318-a41a-4b84-b92b-d9461e14aadf None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:37.248545 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8f5e2318-a41a-4b84-b92b-d9461e14aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:37.261456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 126/247] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:37.308663 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff92d1-de3f-4b90-9758-14107e47f382 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:37.322288 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff92d1-de3f-4b90-9758-14107e47f382 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:37.327812 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe871e2-0018-48e3-af4d-1a6e3a75ee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:37.328634 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe871e2-0018-48e3-af4d-1a6e3a75ee66 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:37.328941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe871e2-0018-48e3-af4d-1a6e3a75ee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:37.329213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe871e2-0018-48e3-af4d-1a6e3a75ee66 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:37.344262 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe871e2-0018-48e3-af4d-1a6e3a75ee66 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:37.351611 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-4fe871e2-0018-48e3-af4d-1a6e3a75ee66 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 08 10:48:37.353012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 122/248] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:48:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:37.359327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e2318-a41a-4b84-b92b-d9461e14aadf None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:37.368614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e2318-a41a-4b84-b92b-d9461e14aadf None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:37.376806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea231a-88b1-4a9d-bb4f-d8d8c5417f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:37.377497 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea231a-88b1-4a9d-bb4f-d8d8c5417f4f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:37.378076 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea231a-88b1-4a9d-bb4f-d8d8c5417f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:37.378336 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea231a-88b1-4a9d-bb4f-d8d8c5417f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:37.379203 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea231a-88b1-4a9d-bb4f-d8d8c5417f4f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:37.379434 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea231a-88b1-4a9d-bb4f-d8d8c5417f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:37.381166 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea231a-88b1-4a9d-bb4f-d8d8c5417f4f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:37.393053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 127/249] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:37.399422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe871e2-0018-48e3-af4d-1a6e3a75ee66 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:37.410577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe871e2-0018-48e3-af4d-1a6e3a75ee66 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:37.418837 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f17ae2-6ac5-491c-af48-48390b223e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:37.419531 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f17ae2-6ac5-491c-af48-48390b223e73 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:37.419861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f17ae2-6ac5-491c-af48-48390b223e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:37.420134 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f17ae2-6ac5-491c-af48-48390b223e73 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:37.429045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f17ae2-6ac5-491c-af48-48390b223e73 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:37.430862 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f17ae2-6ac5-491c-af48-48390b223e73 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:37.443428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 123/250] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:37 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:37.450113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea231a-88b1-4a9d-bb4f-d8d8c5417f4f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:37.460717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea231a-88b1-4a9d-bb4f-d8d8c5417f4f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:37.472751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174291d1-cca6-47b2-ae43-857c5c595a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:37.472751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174291d1-cca6-47b2-ae43-857c5c595a7d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:37.472751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174291d1-cca6-47b2-ae43-857c5c595a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:37.472751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174291d1-cca6-47b2-ae43-857c5c595a7d admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:37.479664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174291d1-cca6-47b2-ae43-857c5c595a7d admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:37.479664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174291d1-cca6-47b2-ae43-857c5c595a7d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:37.479664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 128/251] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:37 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:37.485831 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f17ae2-6ac5-491c-af48-48390b223e73 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:37.495718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f17ae2-6ac5-491c-af48-48390b223e73 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:37.506944 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583eb5ae-c094-4e12-87d7-6f8d6a44b16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:37.507953 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eb5ae-c094-4e12-87d7-6f8d6a44b16d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:37.508231 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eb5ae-c094-4e12-87d7-6f8d6a44b16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:37.508500 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eb5ae-c094-4e12-87d7-6f8d6a44b16d admin admin] PATH_INFO: `/v3/groups/3c1c245a19ed471c91b01dde04f4985a` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:37.510733 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583eb5ae-c094-4e12-87d7-6f8d6a44b16d admin admin] RBAC: Authorizing `identity:get_group(group_id=3c1c245a19ed471c91b01dde04f4985a)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:37.511834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-583eb5ae-c094-4e12-87d7-6f8d6a44b16d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:37.511834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:48:37.511834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:48:37.513075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583eb5ae-c094-4e12-87d7-6f8d6a44b16d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:37.514796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 124/252] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:37 2021] GET /identity/v3/groups/3c1c245a19ed471c91b01dde04f4985a => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:37.521920 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174291d1-cca6-47b2-ae43-857c5c595a7d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:37.538421 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174291d1-cca6-47b2-ae43-857c5c595a7d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:37.551752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10c9c2-5278-4bee-806d-20d71c38b341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:37.552794 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10c9c2-5278-4bee-806d-20d71c38b341 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:37.553275 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10c9c2-5278-4bee-806d-20d71c38b341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:37.553760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10c9c2-5278-4bee-806d-20d71c38b341 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:37.554808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10c9c2-5278-4bee-806d-20d71c38b341 admin admin] RBAC: Adding query filter params (group.id=3c1c245a19ed471c91b01dde04f4985a, role.id=a4a3a42f23b2463ebc5e198fe56ac656, scope.project.id=d6453f0e70ff411fbd16c7407a3e8446) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:37.555341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10c9c2-5278-4bee-806d-20d71c38b341 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:37.557438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10c9c2-5278-4bee-806d-20d71c38b341 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:37.563824 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 129/253] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Nov 8 10:48:37 2021] GET /identity/v3/role_assignments?group.id=3c1c245a19ed471c91b01dde04f4985a&scope.project.id=d6453f0e70ff411fbd16c7407a3e8446&role.id=a4a3a42f23b2463ebc5e198fe56ac656 => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:37.610500 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677960e-0dc4-42da-8f20-6e00a3c6b135 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:37.610815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677960e-0dc4-42da-8f20-6e00a3c6b135 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:37.611075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677960e-0dc4-42da-8f20-6e00a3c6b135 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:37.613440 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 125/254] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:37.619707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8af70-5f0f-4bd9-9b6a-ba6b3cf017d1 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:37.620342 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8af70-5f0f-4bd9-9b6a-ba6b3cf017d1 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:37.620815 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8af70-5f0f-4bd9-9b6a-ba6b3cf017d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:37.649341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-04a8af70-5f0f-4bd9-9b6a-ba6b3cf017d1 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:37.650961 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-04a8af70-5f0f-4bd9-9b6a-ba6b3cf017d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:37.663481 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 130/255] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:37.694951 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677960e-0dc4-42da-8f20-6e00a3c6b135 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:37.720049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677960e-0dc4-42da-8f20-6e00a3c6b135 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:37.725016 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d33fd-bcdb-421e-8d67-d1415f15d065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:37.725836 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d33fd-bcdb-421e-8d67-d1415f15d065 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:37.726115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d33fd-bcdb-421e-8d67-d1415f15d065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:37.726380 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d33fd-bcdb-421e-8d67-d1415f15d065 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:37.745634 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d33fd-bcdb-421e-8d67-d1415f15d065 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:37.752858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-4f3d33fd-bcdb-421e-8d67-d1415f15d065 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:37.754293 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 126/256] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:37.761053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8af70-5f0f-4bd9-9b6a-ba6b3cf017d1 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:37.776655 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8af70-5f0f-4bd9-9b6a-ba6b3cf017d1 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:37.792030 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6f4f2-aa70-4cfd-9b16-c2d143064077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:37.793136 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f4f2-aa70-4cfd-9b16-c2d143064077 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:37.793641 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f4f2-aa70-4cfd-9b16-c2d143064077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:37.794132 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f4f2-aa70-4cfd-9b16-c2d143064077 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:37.795161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6f4f2-aa70-4cfd-9b16-c2d143064077 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:37.795670 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6f4f2-aa70-4cfd-9b16-c2d143064077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:37.797528 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6f4f2-aa70-4cfd-9b16-c2d143064077 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:37.813744 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 131/257] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:37.820362 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d33fd-bcdb-421e-8d67-d1415f15d065 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:37.835012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d33fd-bcdb-421e-8d67-d1415f15d065 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:37.844630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e857974-0859-4fae-80a9-17fd40bfae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:37.845348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e857974-0859-4fae-80a9-17fd40bfae2d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:37.845629 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e857974-0859-4fae-80a9-17fd40bfae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:37.845911 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e857974-0859-4fae-80a9-17fd40bfae2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:37.978350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e857974-0859-4fae-80a9-17fd40bfae2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:37.980044 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e857974-0859-4fae-80a9-17fd40bfae2d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:37.991818 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 127/258] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:37 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:37.998031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6f4f2-aa70-4cfd-9b16-c2d143064077 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:38.017969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6f4f2-aa70-4cfd-9b16-c2d143064077 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:38.032845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf98ed-203b-41ac-a25e-615d9a67201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:38.034110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf98ed-203b-41ac-a25e-615d9a67201a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:38.034787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf98ed-203b-41ac-a25e-615d9a67201a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:38.035407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf98ed-203b-41ac-a25e-615d9a67201a admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:38.039994 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf98ed-203b-41ac-a25e-615d9a67201a admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:38.042386 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf98ed-203b-41ac-a25e-615d9a67201a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:38.044779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 132/259] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:37 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:38.051536 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e857974-0859-4fae-80a9-17fd40bfae2d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:38.061407 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e857974-0859-4fae-80a9-17fd40bfae2d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:38.071664 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab73465-eca1-4d24-b146-da328f86b51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:38.072553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab73465-eca1-4d24-b146-da328f86b51e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:38.072829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab73465-eca1-4d24-b146-da328f86b51e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:38.073100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab73465-eca1-4d24-b146-da328f86b51e admin admin] PATH_INFO: `/v3/groups/3c1c245a19ed471c91b01dde04f4985a` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:38.078254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab73465-eca1-4d24-b146-da328f86b51e admin admin] RBAC: Authorizing `identity:get_group(group_id=3c1c245a19ed471c91b01dde04f4985a)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:38.080369 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab73465-eca1-4d24-b146-da328f86b51e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:38.082755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 128/260] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:38 2021] GET /identity/v3/groups/3c1c245a19ed471c91b01dde04f4985a => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:38.089175 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf98ed-203b-41ac-a25e-615d9a67201a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:38.102706 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf98ed-203b-41ac-a25e-615d9a67201a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:38.109568 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8e320-1682-4230-920d-da338c2ca13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:38.110503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8e320-1682-4230-920d-da338c2ca13f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:38.110982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8e320-1682-4230-920d-da338c2ca13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:38.111473 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8e320-1682-4230-920d-da338c2ca13f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:38.112950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8e320-1682-4230-920d-da338c2ca13f admin admin] RBAC: Adding query filter params (group.id=3c1c245a19ed471c91b01dde04f4985a, role.id=2dce671f5a1a43da869724374e62098b, scope.project.id=9dec779bc5f842f88b59b29d486b4aa2) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:38.113511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8e320-1682-4230-920d-da338c2ca13f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:38.115746 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8e320-1682-4230-920d-da338c2ca13f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:38.127830 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 133/261] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Nov 8 10:48:38 2021] GET /identity/v3/role_assignments?group.id=3c1c245a19ed471c91b01dde04f4985a&scope.project.id=9dec779bc5f842f88b59b29d486b4aa2&role.id=2dce671f5a1a43da869724374e62098b => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:38.234146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd83845-7640-462b-be22-09110b815632 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:38.234321 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd83845-7640-462b-be22-09110b815632 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:38.234614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd83845-7640-462b-be22-09110b815632 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:38.236521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 129/262] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:38.243897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3adc14-8665-438f-8cb7-04be030fb519 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:38.244536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3adc14-8665-438f-8cb7-04be030fb519 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:38.245010 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3adc14-8665-438f-8cb7-04be030fb519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:38.272447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-1f3adc14-8665-438f-8cb7-04be030fb519 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:38.274087 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1f3adc14-8665-438f-8cb7-04be030fb519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:38.282792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 134/263] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:38.316168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd83845-7640-462b-be22-09110b815632 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:38.336417 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd83845-7640-462b-be22-09110b815632 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:38.341517 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36646029-0041-462f-8689-f46f59b68a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:38.347751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36646029-0041-462f-8689-f46f59b68a07 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:38.348084 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36646029-0041-462f-8689-f46f59b68a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:38.348377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36646029-0041-462f-8689-f46f59b68a07 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:38.364292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36646029-0041-462f-8689-f46f59b68a07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:38.371972 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-36646029-0041-462f-8689-f46f59b68a07 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 08 10:48:38.373275 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 130/264] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:48:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:38.381621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3adc14-8665-438f-8cb7-04be030fb519 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:38.397294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3adc14-8665-438f-8cb7-04be030fb519 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:38.408579 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9f749-668b-4ac6-97dd-956fe17c78a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:38.409840 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9f749-668b-4ac6-97dd-956fe17c78a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:38.410353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9f749-668b-4ac6-97dd-956fe17c78a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:38.410769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9f749-668b-4ac6-97dd-956fe17c78a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:38.411791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9f749-668b-4ac6-97dd-956fe17c78a5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:38.412237 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9f749-668b-4ac6-97dd-956fe17c78a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:38.414012 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9f749-668b-4ac6-97dd-956fe17c78a5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:38.427551 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 135/265] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:38.434104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36646029-0041-462f-8689-f46f59b68a07 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:38.445899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36646029-0041-462f-8689-f46f59b68a07 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:38.460318 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28416887-0c34-4a99-bbd9-5446f526c261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:38.461097 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28416887-0c34-4a99-bbd9-5446f526c261 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:38.461486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28416887-0c34-4a99-bbd9-5446f526c261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:38.461858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28416887-0c34-4a99-bbd9-5446f526c261 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:38.473952 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28416887-0c34-4a99-bbd9-5446f526c261 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:38.479150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28416887-0c34-4a99-bbd9-5446f526c261 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:38.495177 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 131/266] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:38.501543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9f749-668b-4ac6-97dd-956fe17c78a5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:38.516377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9f749-668b-4ac6-97dd-956fe17c78a5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:38.524110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4f0aa-a65f-491d-9a44-0b1270b6719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:38.525329 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4f0aa-a65f-491d-9a44-0b1270b6719f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:38.525826 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4f0aa-a65f-491d-9a44-0b1270b6719f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:38.526295 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4f0aa-a65f-491d-9a44-0b1270b6719f admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:38.527813 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4f0aa-a65f-491d-9a44-0b1270b6719f admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:38.530293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4f0aa-a65f-491d-9a44-0b1270b6719f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:38.532510 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 136/267] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:38 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:38.538613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28416887-0c34-4a99-bbd9-5446f526c261 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:38.552341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28416887-0c34-4a99-bbd9-5446f526c261 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:38.559068 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec4a9d-e806-4717-9d01-c2d6801f26e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:38.559962 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4a9d-e806-4717-9d01-c2d6801f26e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:38.560246 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4a9d-e806-4717-9d01-c2d6801f26e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:38.560524 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4a9d-e806-4717-9d01-c2d6801f26e1 admin admin] PATH_INFO: `/v3/groups/3c1c245a19ed471c91b01dde04f4985a` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:38.561716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec4a9d-e806-4717-9d01-c2d6801f26e1 admin admin] RBAC: Authorizing `identity:get_group(group_id=3c1c245a19ed471c91b01dde04f4985a)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:38.563658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec4a9d-e806-4717-9d01-c2d6801f26e1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:38.565680 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 132/268] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:38 2021] GET /identity/v3/groups/3c1c245a19ed471c91b01dde04f4985a => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:38.572012 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4f0aa-a65f-491d-9a44-0b1270b6719f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:38.582878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4f0aa-a65f-491d-9a44-0b1270b6719f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:38.591773 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebd867-845b-445f-8e96-8faf5f1b9ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:38.592766 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebd867-845b-445f-8e96-8faf5f1b9ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:38.593294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebd867-845b-445f-8e96-8faf5f1b9ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:38.593769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebd867-845b-445f-8e96-8faf5f1b9ec8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:38.594896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebd867-845b-445f-8e96-8faf5f1b9ec8 admin admin] RBAC: Adding query filter params (group.id=3c1c245a19ed471c91b01dde04f4985a, role.id=a4a3a42f23b2463ebc5e198fe56ac656, scope.project.id=9dec779bc5f842f88b59b29d486b4aa2) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:38.595438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebd867-845b-445f-8e96-8faf5f1b9ec8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:38.598145 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebd867-845b-445f-8e96-8faf5f1b9ec8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:38.605004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 137/269] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Nov 8 10:48:38 2021] GET /identity/v3/role_assignments?group.id=3c1c245a19ed471c91b01dde04f4985a&scope.project.id=9dec779bc5f842f88b59b29d486b4aa2&role.id=a4a3a42f23b2463ebc5e198fe56ac656 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:38.894127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccd15d-9070-4317-af43-039a9797c73b None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:38.894359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccd15d-9070-4317-af43-039a9797c73b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:38.894689 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccd15d-9070-4317-af43-039a9797c73b None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:38.896555 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 133/270] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:38.902734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca459ee-cc83-4925-94ff-17ad90699da6 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:38.903351 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca459ee-cc83-4925-94ff-17ad90699da6 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:38.903822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca459ee-cc83-4925-94ff-17ad90699da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:38.932322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-5ca459ee-cc83-4925-94ff-17ad90699da6 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:38.933910 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-5ca459ee-cc83-4925-94ff-17ad90699da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:38.942951 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 138/271] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:38.982465 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccd15d-9070-4317-af43-039a9797c73b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:39.001529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccd15d-9070-4317-af43-039a9797c73b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:39.008226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc4465-2aad-44a2-91ef-a4b86a1b267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:39.008226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc4465-2aad-44a2-91ef-a4b86a1b267f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:39.008472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc4465-2aad-44a2-91ef-a4b86a1b267f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:39.008694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc4465-2aad-44a2-91ef-a4b86a1b267f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:39.022062 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc4465-2aad-44a2-91ef-a4b86a1b267f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:39.030986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-40fc4465-2aad-44a2-91ef-a4b86a1b267f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:48:39.033003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 134/272] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:48:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:39.041113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca459ee-cc83-4925-94ff-17ad90699da6 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:39.052246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca459ee-cc83-4925-94ff-17ad90699da6 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:39.060220 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d39b5-06ac-407c-8a66-122ead12cd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:39.060897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d39b5-06ac-407c-8a66-122ead12cd40 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:39.061178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d39b5-06ac-407c-8a66-122ead12cd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:39.061451 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d39b5-06ac-407c-8a66-122ead12cd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:39.062224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d39b5-06ac-407c-8a66-122ead12cd40 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:39.062526 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d39b5-06ac-407c-8a66-122ead12cd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:39.064164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d39b5-06ac-407c-8a66-122ead12cd40 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:39.079279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 139/273] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:39.082386 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc4465-2aad-44a2-91ef-a4b86a1b267f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:39.095758 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc4465-2aad-44a2-91ef-a4b86a1b267f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:39.107447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e427eb-ad52-43d9-849f-0b9896bff1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:39.108463 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e427eb-ad52-43d9-849f-0b9896bff1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:39.108983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e427eb-ad52-43d9-849f-0b9896bff1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:39.109447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e427eb-ad52-43d9-849f-0b9896bff1d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:39.120905 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e427eb-ad52-43d9-849f-0b9896bff1d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:39.123002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e427eb-ad52-43d9-849f-0b9896bff1d7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:39.142917 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 135/274] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:39.149133 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d39b5-06ac-407c-8a66-122ead12cd40 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:39.164949 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d39b5-06ac-407c-8a66-122ead12cd40 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:39.176674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a6ff6-8a24-4a0b-9e40-a92852b69be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:39.177553 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a6ff6-8a24-4a0b-9e40-a92852b69be1 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:39.177837 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a6ff6-8a24-4a0b-9e40-a92852b69be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:39.178110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a6ff6-8a24-4a0b-9e40-a92852b69be1 admin admin] PATH_INFO: `/v3/projects/27515e2cec514f3da80e13fa65b719ab` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:39.179341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a6ff6-8a24-4a0b-9e40-a92852b69be1 admin admin] RBAC: Authorizing `identity:get_project(project_id=27515e2cec514f3da80e13fa65b719ab)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:39.181150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a6ff6-8a24-4a0b-9e40-a92852b69be1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:39.182842 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 140/275] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:39 2021] GET /identity/v3/projects/27515e2cec514f3da80e13fa65b719ab => generated 344 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:39.189235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e427eb-ad52-43d9-849f-0b9896bff1d7 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:39.199553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e427eb-ad52-43d9-849f-0b9896bff1d7 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:39.210981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150596ef-be70-456f-9bff-999a7c02f630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:39.212203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150596ef-be70-456f-9bff-999a7c02f630 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:39.212682 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150596ef-be70-456f-9bff-999a7c02f630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:39.213168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150596ef-be70-456f-9bff-999a7c02f630 admin admin] PATH_INFO: `/v3/groups/c78c255e4dac4b509aa8a165d9d439f5` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:39.228384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150596ef-be70-456f-9bff-999a7c02f630 admin admin] RBAC: Authorizing `identity:get_group(group_id=c78c255e4dac4b509aa8a165d9d439f5)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:39.230740 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150596ef-be70-456f-9bff-999a7c02f630 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:39.232732 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 136/276] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:39 2021] GET /identity/v3/groups/c78c255e4dac4b509aa8a165d9d439f5 => generated 229 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:39.239534 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a6ff6-8a24-4a0b-9e40-a92852b69be1 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:39.256869 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a6ff6-8a24-4a0b-9e40-a92852b69be1 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:39.264619 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc7b9f-e6c6-4b9a-9c5e-5112ee6f52b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:39.265295 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc7b9f-e6c6-4b9a-9c5e-5112ee6f52b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:39.265575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc7b9f-e6c6-4b9a-9c5e-5112ee6f52b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:39.265848 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc7b9f-e6c6-4b9a-9c5e-5112ee6f52b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:39.267073 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc7b9f-e6c6-4b9a-9c5e-5112ee6f52b4 admin admin] RBAC: Adding query filter params (group.id=c78c255e4dac4b509aa8a165d9d439f5, role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=27515e2cec514f3da80e13fa65b719ab) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:39.267413 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc7b9f-e6c6-4b9a-9c5e-5112ee6f52b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:39.269558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc7b9f-e6c6-4b9a-9c5e-5112ee6f52b4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:39.275741 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 141/277] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Nov 8 10:48:39 2021] GET /identity/v3/role_assignments?group.id=c78c255e4dac4b509aa8a165d9d439f5&scope.project.id=27515e2cec514f3da80e13fa65b719ab&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:39.458329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0b595-bfa6-4889-bd26-1685b9323c55 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:39.459077 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0b595-bfa6-4889-bd26-1685b9323c55 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:39.459610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0b595-bfa6-4889-bd26-1685b9323c55 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:39.467717 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 137/278] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:39 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:39.474674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599fbf4-9dee-4276-8a97-1af82abf61af None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:39.474984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599fbf4-9dee-4276-8a97-1af82abf61af None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:39.475275 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599fbf4-9dee-4276-8a97-1af82abf61af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:39.618629 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-7599fbf4-9dee-4276-8a97-1af82abf61af None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:39.619863 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7599fbf4-9dee-4276-8a97-1af82abf61af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:39.629986 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 142/279] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:39.677537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0b595-bfa6-4889-bd26-1685b9323c55 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:39.691670 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0b595-bfa6-4889-bd26-1685b9323c55 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:39.699237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcbda6-1bdc-4f3a-aa4c-5390c2262880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:39.700063 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcbda6-1bdc-4f3a-aa4c-5390c2262880 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:39.700346 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcbda6-1bdc-4f3a-aa4c-5390c2262880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:39.700621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcbda6-1bdc-4f3a-aa4c-5390c2262880 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:39.717906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcbda6-1bdc-4f3a-aa4c-5390c2262880 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:39.724859 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-d5fcbda6-1bdc-4f3a-aa4c-5390c2262880 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:39.726100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 138/280] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:39.732747 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599fbf4-9dee-4276-8a97-1af82abf61af None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:39.742373 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599fbf4-9dee-4276-8a97-1af82abf61af None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:39.748513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5986a7-4701-443b-b9d7-0b47e5d7023f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:39.749190 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5986a7-4701-443b-b9d7-0b47e5d7023f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:39.749472 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5986a7-4701-443b-b9d7-0b47e5d7023f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:39.749745 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5986a7-4701-443b-b9d7-0b47e5d7023f admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:39.750516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5986a7-4701-443b-b9d7-0b47e5d7023f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:39.750826 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5986a7-4701-443b-b9d7-0b47e5d7023f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:39.752472 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5986a7-4701-443b-b9d7-0b47e5d7023f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:39.770099 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 143/281] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:39.776379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcbda6-1bdc-4f3a-aa4c-5390c2262880 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:39.789277 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcbda6-1bdc-4f3a-aa4c-5390c2262880 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:39.799151 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e78e35-62e5-4297-b310-5526089ad570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:39.800103 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e78e35-62e5-4297-b310-5526089ad570 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:39.800378 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e78e35-62e5-4297-b310-5526089ad570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:39.800644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e78e35-62e5-4297-b310-5526089ad570 admin admin] PATH_INFO: `/v3/groups/3c1c245a19ed471c91b01dde04f4985a` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:39.803893 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e78e35-62e5-4297-b310-5526089ad570 admin admin] RBAC: Authorizing `identity:get_group(group_id=3c1c245a19ed471c91b01dde04f4985a)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:39.806149 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e78e35-62e5-4297-b310-5526089ad570 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:39.808079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 139/282] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:39 2021] GET /identity/v3/groups/3c1c245a19ed471c91b01dde04f4985a => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:39.814266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5986a7-4701-443b-b9d7-0b47e5d7023f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:39.828690 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5986a7-4701-443b-b9d7-0b47e5d7023f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:39.837588 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769440a-46c9-457e-9867-414282b3ab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:39.838754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769440a-46c9-457e-9867-414282b3ab37 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:39.839049 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769440a-46c9-457e-9867-414282b3ab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:39.839337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769440a-46c9-457e-9867-414282b3ab37 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:39.842233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769440a-46c9-457e-9867-414282b3ab37 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:39.844351 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769440a-46c9-457e-9867-414282b3ab37 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:39.846076 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 144/283] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:39 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:39.852918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e78e35-62e5-4297-b310-5526089ad570 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:39.863997 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e78e35-62e5-4297-b310-5526089ad570 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:39.872756 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6feb874-cbe5-4b27-9074-0e2e003dd8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:39.874005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feb874-cbe5-4b27-9074-0e2e003dd8ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:39.874510 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feb874-cbe5-4b27-9074-0e2e003dd8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:39.874979 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feb874-cbe5-4b27-9074-0e2e003dd8ea admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446/groups/3c1c245a19ed471c91b01dde04f4985a/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:39.878793 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6feb874-cbe5-4b27-9074-0e2e003dd8ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6453f0e70ff411fbd16c7407a3e8446, group_id=3c1c245a19ed471c91b01dde04f4985a, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:39.881909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6feb874-cbe5-4b27-9074-0e2e003dd8ea admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:39.907814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 140/284] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Nov 8 10:48:39 2021] PUT /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446/groups/3c1c245a19ed471c91b01dde04f4985a/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:48:40.961294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b10473-4721-4164-8f47-eac4df80b1d8 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:40.961813 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b10473-4721-4164-8f47-eac4df80b1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:40.961889 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b10473-4721-4164-8f47-eac4df80b1d8 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:40.963880 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 145/285] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:40.970495 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598b3c-0e57-4742-acec-50d4abcd3a8a None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:40.971009 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598b3c-0e57-4742-acec-50d4abcd3a8a None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:40.971081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598b3c-0e57-4742-acec-50d4abcd3a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:40.996472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-d7598b3c-0e57-4742-acec-50d4abcd3a8a None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:40.997739 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d7598b3c-0e57-4742-acec-50d4abcd3a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:41.072490 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 141/286] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:41.115665 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b10473-4721-4164-8f47-eac4df80b1d8 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:41.132240 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b10473-4721-4164-8f47-eac4df80b1d8 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:41.136768 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f909d-d0b3-4047-b326-6f881b8c7154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:41.137585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f909d-d0b3-4047-b326-6f881b8c7154 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.137872 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f909d-d0b3-4047-b326-6f881b8c7154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.138151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f909d-d0b3-4047-b326-6f881b8c7154 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.144021 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bac58-2811-4a94-999f-1cf8310be08c None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.144331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bac58-2811-4a94-999f-1cf8310be08c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.144699 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bac58-2811-4a94-999f-1cf8310be08c None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.146512 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 142/287] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:48:41.158079 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f909d-d0b3-4047-b326-6f881b8c7154 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:41.165667 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53caa5-2c81-4c76-aa96-4137cc0b30be None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.165961 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53caa5-2c81-4c76-aa96-4137cc0b30be None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.166246 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53caa5-2c81-4c76-aa96-4137cc0b30be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.167215 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-960f909d-d0b3-4047-b326-6f881b8c7154 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 08 10:48:41.168630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 146/288] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:48:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:41.176096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f909d-d0b3-4047-b326-6f881b8c7154 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:41.198480 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f909d-d0b3-4047-b326-6f881b8c7154 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:41.202295 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-2f53caa5-2c81-4c76-aa96-4137cc0b30be None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:41.204072 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2f53caa5-2c81-4c76-aa96-4137cc0b30be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:41.210805 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc0818-6760-43d2-8a94-689206847435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:41.211863 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc0818-6760-43d2-8a94-689206847435 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.212347 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc0818-6760-43d2-8a94-689206847435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.212873 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc0818-6760-43d2-8a94-689206847435 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.213892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc0818-6760-43d2-8a94-689206847435 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:41.214876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc0818-6760-43d2-8a94-689206847435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:41.217717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc0818-6760-43d2-8a94-689206847435 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:41.227648 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 143/289] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:41.234577 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 147/290] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:41.240724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53caa5-2c81-4c76-aa96-4137cc0b30be None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:41.250966 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53caa5-2c81-4c76-aa96-4137cc0b30be None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:41.259494 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4abf9-9daa-4b36-b568-97f8e1aaa589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:41.260730 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4abf9-9daa-4b36-b568-97f8e1aaa589 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.261283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4abf9-9daa-4b36-b568-97f8e1aaa589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.263164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc0818-6760-43d2-8a94-689206847435 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:41.263826 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4abf9-9daa-4b36-b568-97f8e1aaa589 admin admin] PATH_INFO: `/v3/groups/3c1c245a19ed471c91b01dde04f4985a` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.276271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4abf9-9daa-4b36-b568-97f8e1aaa589 admin admin] RBAC: Authorizing `identity:get_group(group_id=3c1c245a19ed471c91b01dde04f4985a)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:41.278890 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc0818-6760-43d2-8a94-689206847435 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:41.280545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4abf9-9daa-4b36-b568-97f8e1aaa589 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:41.283181 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 144/291] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:41 2021] GET /identity/v3/groups/3c1c245a19ed471c91b01dde04f4985a => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:41.291192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28d506-c1fe-421c-8d45-fd91da40f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:41.291192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28d506-c1fe-421c-8d45-fd91da40f2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.291192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28d506-c1fe-421c-8d45-fd91da40f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.291192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28d506-c1fe-421c-8d45-fd91da40f2c3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.302709 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4abf9-9daa-4b36-b568-97f8e1aaa589 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:41.305606 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28d506-c1fe-421c-8d45-fd91da40f2c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:41.312560 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-6a28d506-c1fe-421c-8d45-fd91da40f2c3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:41.313808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 148/292] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:41.320265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4abf9-9daa-4b36-b568-97f8e1aaa589 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:41.320625 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28d506-c1fe-421c-8d45-fd91da40f2c3 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:41.326115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e993c7c-b23a-403b-b97d-d136e1eea381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:41.327314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e993c7c-b23a-403b-b97d-d136e1eea381 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.327563 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e993c7c-b23a-403b-b97d-d136e1eea381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.327981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e993c7c-b23a-403b-b97d-d136e1eea381 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.332145 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e993c7c-b23a-403b-b97d-d136e1eea381 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:41.332870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28d506-c1fe-421c-8d45-fd91da40f2c3 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:41.334622 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e993c7c-b23a-403b-b97d-d136e1eea381 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:41.336941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 145/293] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:41 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:41.342068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9fcda-2aed-49e8-b611-b8c034beb4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:41.343169 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9fcda-2aed-49e8-b611-b8c034beb4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.344015 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e993c7c-b23a-403b-b97d-d136e1eea381 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:41.344973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9fcda-2aed-49e8-b611-b8c034beb4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.347811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9fcda-2aed-49e8-b611-b8c034beb4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.350621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9fcda-2aed-49e8-b611-b8c034beb4ab admin admin] RBAC: Adding query filter params (name=member) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:41.351082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9fcda-2aed-49e8-b611-b8c034beb4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:41.355583 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9fcda-2aed-49e8-b611-b8c034beb4ab admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:41.364384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e993c7c-b23a-403b-b97d-d136e1eea381 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:41.374203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f994c-8e37-4569-aeee-ce22b9b4b91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:41.375535 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f994c-8e37-4569-aeee-ce22b9b4b91a admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.376004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 149/294] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:41.376347 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f994c-8e37-4569-aeee-ce22b9b4b91a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.376738 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f994c-8e37-4569-aeee-ce22b9b4b91a admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446/groups/3c1c245a19ed471c91b01dde04f4985a/roles/a4a3a42f23b2463ebc5e198fe56ac656` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.379902 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f994c-8e37-4569-aeee-ce22b9b4b91a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6453f0e70ff411fbd16c7407a3e8446, group_id=3c1c245a19ed471c91b01dde04f4985a, role_id=a4a3a42f23b2463ebc5e198fe56ac656)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:41.382456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9fcda-2aed-49e8-b611-b8c034beb4ab admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:41.388687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f994c-8e37-4569-aeee-ce22b9b4b91a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:41.399818 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9fcda-2aed-49e8-b611-b8c034beb4ab admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:41.404792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46902-10c2-4eac-bf73-10a33aaf7c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:41.405832 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46902-10c2-4eac-bf73-10a33aaf7c74 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.406212 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46902-10c2-4eac-bf73-10a33aaf7c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.406605 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d46902-10c2-4eac-bf73-10a33aaf7c74 admin admin] PATH_INFO: `/v3/groups/3c1c245a19ed471c91b01dde04f4985a` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.407956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d46902-10c2-4eac-bf73-10a33aaf7c74 admin admin] RBAC: Authorizing `identity:get_group(group_id=3c1c245a19ed471c91b01dde04f4985a)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:41.415283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d46902-10c2-4eac-bf73-10a33aaf7c74 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:41.418513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 150/295] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:41 2021] GET /identity/v3/groups/3c1c245a19ed471c91b01dde04f4985a => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:41.420266 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 146/296] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Nov 8 10:48:41 2021] PUT /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446/groups/3c1c245a19ed471c91b01dde04f4985a/roles/a4a3a42f23b2463ebc5e198fe56ac656 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 10:48:41.426750 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46902-10c2-4eac-bf73-10a33aaf7c74 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:41.448727 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d46902-10c2-4eac-bf73-10a33aaf7c74 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:41.544601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f829f-e7de-4c44-8b32-d3bfaf67301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:41.545504 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f829f-e7de-4c44-8b32-d3bfaf67301a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.545843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f829f-e7de-4c44-8b32-d3bfaf67301a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.546126 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f829f-e7de-4c44-8b32-d3bfaf67301a admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.547486 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f829f-e7de-4c44-8b32-d3bfaf67301a admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:41.549914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f829f-e7de-4c44-8b32-d3bfaf67301a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:41.551985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 151/297] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:41 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:41.559458 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f994c-8e37-4569-aeee-ce22b9b4b91a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:41.578870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f994c-8e37-4569-aeee-ce22b9b4b91a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:41.585650 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da33b2-026f-4ad5-a11b-1bf01c35c04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:41.587060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da33b2-026f-4ad5-a11b-1bf01c35c04a admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.587567 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da33b2-026f-4ad5-a11b-1bf01c35c04a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.588096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da33b2-026f-4ad5-a11b-1bf01c35c04a admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2/groups/3c1c245a19ed471c91b01dde04f4985a/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.590693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da33b2-026f-4ad5-a11b-1bf01c35c04a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dec779bc5f842f88b59b29d486b4aa2, group_id=3c1c245a19ed471c91b01dde04f4985a, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:41.593914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da33b2-026f-4ad5-a11b-1bf01c35c04a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:41.623519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 147/298] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Nov 8 10:48:41 2021] PUT /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2/groups/3c1c245a19ed471c91b01dde04f4985a/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:48:41.720748 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb8f2f-84e3-402d-900b-b160dafc05dc None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.720952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb8f2f-84e3-402d-900b-b160dafc05dc None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.721255 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb8f2f-84e3-402d-900b-b160dafc05dc None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.723417 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 152/299] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:41.729819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9e044-0b7c-4792-beb5-21a4f72968ac None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.730423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9e044-0b7c-4792-beb5-21a4f72968ac None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.730892 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9e044-0b7c-4792-beb5-21a4f72968ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.757135 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-a5d9e044-0b7c-4792-beb5-21a4f72968ac None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:41.758702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-a5d9e044-0b7c-4792-beb5-21a4f72968ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:41.832489 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 148/300] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:41.868988 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb8f2f-84e3-402d-900b-b160dafc05dc None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:41.890327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb8f2f-84e3-402d-900b-b160dafc05dc None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:41.896721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78555e6-130c-48a0-b2eb-dde0f5e21459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:41.897553 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78555e6-130c-48a0-b2eb-dde0f5e21459 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.897840 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78555e6-130c-48a0-b2eb-dde0f5e21459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.898113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78555e6-130c-48a0-b2eb-dde0f5e21459 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.921133 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78555e6-130c-48a0-b2eb-dde0f5e21459 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:41.929218 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-c78555e6-130c-48a0-b2eb-dde0f5e21459 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 08 10:48:41.930830 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 153/301] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:48:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:41.936990 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9e044-0b7c-4792-beb5-21a4f72968ac None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:41.948389 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9e044-0b7c-4792-beb5-21a4f72968ac None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:41.958114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4609d7-75af-4189-a65d-724928db1417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:41.959300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4609d7-75af-4189-a65d-724928db1417 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:41.959814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4609d7-75af-4189-a65d-724928db1417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:41.960287 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4609d7-75af-4189-a65d-724928db1417 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:41.961291 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4609d7-75af-4189-a65d-724928db1417 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:41.961819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4609d7-75af-4189-a65d-724928db1417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:41.963818 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4609d7-75af-4189-a65d-724928db1417 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:41.976627 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 149/302] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:41.982476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78555e6-130c-48a0-b2eb-dde0f5e21459 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:41.994397 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78555e6-130c-48a0-b2eb-dde0f5e21459 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:42.000603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b591e0-7ea6-489e-8946-b0f458fc8140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:42.001454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b591e0-7ea6-489e-8946-b0f458fc8140 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:42.001733 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b591e0-7ea6-489e-8946-b0f458fc8140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:42.002000 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b591e0-7ea6-489e-8946-b0f458fc8140 admin admin] PATH_INFO: `/v3/groups/3c1c245a19ed471c91b01dde04f4985a` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:42.003421 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b591e0-7ea6-489e-8946-b0f458fc8140 admin admin] RBAC: Authorizing `identity:get_group(group_id=3c1c245a19ed471c91b01dde04f4985a)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:42.005316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b591e0-7ea6-489e-8946-b0f458fc8140 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:42.006922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 154/303] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:41 2021] GET /identity/v3/groups/3c1c245a19ed471c91b01dde04f4985a => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:42.013743 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4609d7-75af-4189-a65d-724928db1417 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:42.025112 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4609d7-75af-4189-a65d-724928db1417 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:42.030091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc6ad1-4535-45f6-8fdd-458a24afe3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:42.030963 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc6ad1-4535-45f6-8fdd-458a24afe3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:42.031310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc6ad1-4535-45f6-8fdd-458a24afe3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:42.031580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc6ad1-4535-45f6-8fdd-458a24afe3b9 admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:42.032775 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc6ad1-4535-45f6-8fdd-458a24afe3b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:42.035318 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc6ad1-4535-45f6-8fdd-458a24afe3b9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:42.037019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 150/304] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:42 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:42.043624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b591e0-7ea6-489e-8946-b0f458fc8140 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:42.053542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b591e0-7ea6-489e-8946-b0f458fc8140 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:42.058149 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbabef-ec39-4f4d-a7b1-f6edf0960ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:42.059157 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbabef-ec39-4f4d-a7b1-f6edf0960ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:42.059439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbabef-ec39-4f4d-a7b1-f6edf0960ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:42.059709 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbabef-ec39-4f4d-a7b1-f6edf0960ac5 admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2/groups/3c1c245a19ed471c91b01dde04f4985a/roles/a4a3a42f23b2463ebc5e198fe56ac656` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:42.062019 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbabef-ec39-4f4d-a7b1-f6edf0960ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dec779bc5f842f88b59b29d486b4aa2, group_id=3c1c245a19ed471c91b01dde04f4985a, role_id=a4a3a42f23b2463ebc5e198fe56ac656)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:42.064871 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbabef-ec39-4f4d-a7b1-f6edf0960ac5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:42.083834 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 155/305] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Nov 8 10:48:42 2021] PUT /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2/groups/3c1c245a19ed471c91b01dde04f4985a/roles/a4a3a42f23b2463ebc5e198fe56ac656 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:48:42.270237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245cb10-621d-4927-ac13-f70922103216 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:42.270433 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245cb10-621d-4927-ac13-f70922103216 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:42.270690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245cb10-621d-4927-ac13-f70922103216 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:42.272995 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 151/306] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:42.279329 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f83b4-2113-476e-8ac9-fee6335215de None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:42.279618 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f83b4-2113-476e-8ac9-fee6335215de None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:42.279888 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f83b4-2113-476e-8ac9-fee6335215de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:42.300923 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-389f83b4-2113-476e-8ac9-fee6335215de None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:42.302168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-389f83b4-2113-476e-8ac9-fee6335215de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:42.373404 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 156/307] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:42.419396 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245cb10-621d-4927-ac13-f70922103216 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:42.433318 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245cb10-621d-4927-ac13-f70922103216 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:42.439007 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ddf40-3387-4646-879d-e881bf5a50dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:42.439842 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ddf40-3387-4646-879d-e881bf5a50dd admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:42.440152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ddf40-3387-4646-879d-e881bf5a50dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:42.440426 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ddf40-3387-4646-879d-e881bf5a50dd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:42.456539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ddf40-3387-4646-879d-e881bf5a50dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:42.463907 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-871ddf40-3387-4646-879d-e881bf5a50dd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:48:42.466139 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 152/308] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:48:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:42.473098 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f83b4-2113-476e-8ac9-fee6335215de None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:42.485942 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f83b4-2113-476e-8ac9-fee6335215de None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:42.496225 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777a20e-ad77-4c4c-b0a7-41de675f62dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:42.496914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777a20e-ad77-4c4c-b0a7-41de675f62dd admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:42.497198 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777a20e-ad77-4c4c-b0a7-41de675f62dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:42.497471 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777a20e-ad77-4c4c-b0a7-41de675f62dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:42.498249 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777a20e-ad77-4c4c-b0a7-41de675f62dd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:42.498553 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777a20e-ad77-4c4c-b0a7-41de675f62dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:42.500238 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777a20e-ad77-4c4c-b0a7-41de675f62dd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:42.517432 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 157/309] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:42.524018 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ddf40-3387-4646-879d-e881bf5a50dd admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:42.540334 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ddf40-3387-4646-879d-e881bf5a50dd admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:42.551557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e45076-b9a1-46b6-81df-361f057c5ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:42.552426 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e45076-b9a1-46b6-81df-361f057c5ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:42.552706 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e45076-b9a1-46b6-81df-361f057c5ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:42.552977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e45076-b9a1-46b6-81df-361f057c5ee0 admin admin] PATH_INFO: `/v3/groups/c78c255e4dac4b509aa8a165d9d439f5` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:42.559151 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e45076-b9a1-46b6-81df-361f057c5ee0 admin admin] RBAC: Authorizing `identity:get_group(group_id=c78c255e4dac4b509aa8a165d9d439f5)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:42.561137 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e45076-b9a1-46b6-81df-361f057c5ee0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:42.562766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 153/310] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:42 2021] GET /identity/v3/groups/c78c255e4dac4b509aa8a165d9d439f5 => generated 229 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:42.569271 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777a20e-ad77-4c4c-b0a7-41de675f62dd admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:42.582476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777a20e-ad77-4c4c-b0a7-41de675f62dd admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:42.586862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0481d6-4792-4dc7-9094-159ff9ca8ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:42.587759 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0481d6-4792-4dc7-9094-159ff9ca8ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:42.588040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0481d6-4792-4dc7-9094-159ff9ca8ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:42.588312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0481d6-4792-4dc7-9094-159ff9ca8ec6 admin admin] PATH_INFO: `/v3/projects/27515e2cec514f3da80e13fa65b719ab` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:42.589506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0481d6-4792-4dc7-9094-159ff9ca8ec6 admin admin] RBAC: Authorizing `identity:get_project(project_id=27515e2cec514f3da80e13fa65b719ab)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:42.591343 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0481d6-4792-4dc7-9094-159ff9ca8ec6 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:42.598378 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 158/311] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:42 2021] GET /identity/v3/projects/27515e2cec514f3da80e13fa65b719ab => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:42.599774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e45076-b9a1-46b6-81df-361f057c5ee0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:42.611669 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e45076-b9a1-46b6-81df-361f057c5ee0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:42.616049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdabed6-9072-4213-82c1-1c01aaebba75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:42.616913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdabed6-9072-4213-82c1-1c01aaebba75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:42.617193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdabed6-9072-4213-82c1-1c01aaebba75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:42.617468 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdabed6-9072-4213-82c1-1c01aaebba75 admin admin] PATH_INFO: `/v3/projects/27515e2cec514f3da80e13fa65b719ab/groups/c78c255e4dac4b509aa8a165d9d439f5/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:42.619498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdabed6-9072-4213-82c1-1c01aaebba75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27515e2cec514f3da80e13fa65b719ab, group_id=c78c255e4dac4b509aa8a165d9d439f5, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:42.622127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdabed6-9072-4213-82c1-1c01aaebba75 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:42.643351 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 154/312] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Nov 8 10:48:42 2021] PUT /identity/v3/projects/27515e2cec514f3da80e13fa65b719ab/groups/c78c255e4dac4b509aa8a165d9d439f5/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:48:43.343409 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef37c3e-bfde-445d-b1fb-618328559293 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:43.344438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef37c3e-bfde-445d-b1fb-618328559293 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:43.344926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef37c3e-bfde-445d-b1fb-618328559293 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:43.347593 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 159/313] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:43.353929 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da619-6990-4dd0-8ad0-64a9f4f98925 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:43.354753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da619-6990-4dd0-8ad0-64a9f4f98925 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:43.355281 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da619-6990-4dd0-8ad0-64a9f4f98925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:43.380127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-7f9da619-6990-4dd0-8ad0-64a9f4f98925 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:43.381678 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-7f9da619-6990-4dd0-8ad0-64a9f4f98925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:43.469318 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 155/314] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:43.498836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef37c3e-bfde-445d-b1fb-618328559293 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:43.512026 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef37c3e-bfde-445d-b1fb-618328559293 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:43.517004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136d6a2-585c-461e-af40-a61859227e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:43.518137 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136d6a2-585c-461e-af40-a61859227e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:43.518900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136d6a2-585c-461e-af40-a61859227e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:43.519407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136d6a2-585c-461e-af40-a61859227e40 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:43.530123 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136d6a2-585c-461e-af40-a61859227e40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:43.537672 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-9136d6a2-585c-461e-af40-a61859227e40 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:43.539464 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 160/315] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:43.546113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9da619-6990-4dd0-8ad0-64a9f4f98925 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:43.555919 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9da619-6990-4dd0-8ad0-64a9f4f98925 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:43.560757 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612ccb2-6a3a-451e-9662-8b6c5916bc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:43.561666 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612ccb2-6a3a-451e-9662-8b6c5916bc86 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:43.562171 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612ccb2-6a3a-451e-9662-8b6c5916bc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:43.562640 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612ccb2-6a3a-451e-9662-8b6c5916bc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:43.563642 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612ccb2-6a3a-451e-9662-8b6c5916bc86 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:43.564143 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612ccb2-6a3a-451e-9662-8b6c5916bc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:43.566562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612ccb2-6a3a-451e-9662-8b6c5916bc86 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:43.575515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 156/316] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:43.582236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136d6a2-585c-461e-af40-a61859227e40 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:43.593009 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136d6a2-585c-461e-af40-a61859227e40 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:43.598388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07b055-e499-45c6-8cd5-a376e6f75b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:43.599350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07b055-e499-45c6-8cd5-a376e6f75b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:43.599857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07b055-e499-45c6-8cd5-a376e6f75b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:43.600326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07b055-e499-45c6-8cd5-a376e6f75b0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:43.609172 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07b055-e499-45c6-8cd5-a376e6f75b0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:43.611289 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07b055-e499-45c6-8cd5-a376e6f75b0a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:43.621371 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 161/317] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:43.627890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612ccb2-6a3a-451e-9662-8b6c5916bc86 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:43.638570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612ccb2-6a3a-451e-9662-8b6c5916bc86 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:43.646388 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6e2d9-6943-410d-a589-de443a598969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:43.647651 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6e2d9-6943-410d-a589-de443a598969 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:43.648131 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6e2d9-6943-410d-a589-de443a598969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:43.648652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6e2d9-6943-410d-a589-de443a598969 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:43.650118 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6e2d9-6943-410d-a589-de443a598969 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:43.652580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6e2d9-6943-410d-a589-de443a598969 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:43.654544 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 157/318] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:43 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:43.661741 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07b055-e499-45c6-8cd5-a376e6f75b0a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:43.673797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07b055-e499-45c6-8cd5-a376e6f75b0a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:43.680634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465f120-9ccd-41c4-9a1f-22fe22841b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:43.681802 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465f120-9ccd-41c4-9a1f-22fe22841b53 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:43.682277 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465f120-9ccd-41c4-9a1f-22fe22841b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:43.682806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465f120-9ccd-41c4-9a1f-22fe22841b53 admin admin] PATH_INFO: `/v3/groups/3c1c245a19ed471c91b01dde04f4985a` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:43.684298 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465f120-9ccd-41c4-9a1f-22fe22841b53 admin admin] RBAC: Authorizing `identity:get_group(group_id=3c1c245a19ed471c91b01dde04f4985a)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:43.686555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465f120-9ccd-41c4-9a1f-22fe22841b53 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:43.688482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 162/319] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:43 2021] GET /identity/v3/groups/3c1c245a19ed471c91b01dde04f4985a => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:43.695627 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6e2d9-6943-410d-a589-de443a598969 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:43.706490 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6e2d9-6943-410d-a589-de443a598969 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:43.715199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab180b-9fc5-4808-a51c-daf3b3ed0032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:43.716113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab180b-9fc5-4808-a51c-daf3b3ed0032 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:43.716643 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab180b-9fc5-4808-a51c-daf3b3ed0032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:43.717110 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab180b-9fc5-4808-a51c-daf3b3ed0032 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:43.718310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab180b-9fc5-4808-a51c-daf3b3ed0032 admin admin] RBAC: Adding query filter params (group.id=3c1c245a19ed471c91b01dde04f4985a, role.id=2dce671f5a1a43da869724374e62098b, scope.project.id=d6453f0e70ff411fbd16c7407a3e8446) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:43.718834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab180b-9fc5-4808-a51c-daf3b3ed0032 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:43.720978 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab180b-9fc5-4808-a51c-daf3b3ed0032 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:43.728542 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 158/320] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Nov 8 10:48:43 2021] GET /identity/v3/role_assignments?group.id=3c1c245a19ed471c91b01dde04f4985a&scope.project.id=d6453f0e70ff411fbd16c7407a3e8446&role.id=2dce671f5a1a43da869724374e62098b => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:44.132026 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f17c3-803a-444f-8f6f-0f0ea076f832 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.132535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f17c3-803a-444f-8f6f-0f0ea076f832 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.132999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f17c3-803a-444f-8f6f-0f0ea076f832 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.136099 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 163/321] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:44 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:44.143020 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdf3a4-1c2d-4529-a106-1998e0240492 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.143403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdf3a4-1c2d-4529-a106-1998e0240492 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.143655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdf3a4-1c2d-4529-a106-1998e0240492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.167852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-2efdf3a4-1c2d-4529-a106-1998e0240492 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:44.169042 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2efdf3a4-1c2d-4529-a106-1998e0240492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:44.176629 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 159/322] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:44.201631 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f17c3-803a-444f-8f6f-0f0ea076f832 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:44.219074 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f17c3-803a-444f-8f6f-0f0ea076f832 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:44.223798 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef598f-19d9-4351-b587-7de18f5bdd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:44.224609 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef598f-19d9-4351-b587-7de18f5bdd84 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.224886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef598f-19d9-4351-b587-7de18f5bdd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.225150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef598f-19d9-4351-b587-7de18f5bdd84 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.235871 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef598f-19d9-4351-b587-7de18f5bdd84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:44.243316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-04ef598f-19d9-4351-b587-7de18f5bdd84 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 08 10:48:44.244840 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 164/323] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:48:44 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:44.251252 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdf3a4-1c2d-4529-a106-1998e0240492 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:44.260860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdf3a4-1c2d-4529-a106-1998e0240492 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:44.265191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849bce1-0d23-40ef-ab98-446aab1f8af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:44.265857 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849bce1-0d23-40ef-ab98-446aab1f8af4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.266132 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849bce1-0d23-40ef-ab98-446aab1f8af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.266400 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849bce1-0d23-40ef-ab98-446aab1f8af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.267562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849bce1-0d23-40ef-ab98-446aab1f8af4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:44.267861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849bce1-0d23-40ef-ab98-446aab1f8af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:44.269524 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849bce1-0d23-40ef-ab98-446aab1f8af4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:44.282215 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 160/324] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:44 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:44.288623 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef598f-19d9-4351-b587-7de18f5bdd84 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:44.298405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef598f-19d9-4351-b587-7de18f5bdd84 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:44.302783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bb3cc-f57f-4550-9934-0dbdf81030a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:44.304519 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bb3cc-f57f-4550-9934-0dbdf81030a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.304801 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bb3cc-f57f-4550-9934-0dbdf81030a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.305069 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bb3cc-f57f-4550-9934-0dbdf81030a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.313845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bb3cc-f57f-4550-9934-0dbdf81030a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:44.315771 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bb3cc-f57f-4550-9934-0dbdf81030a3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:44.325321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 165/325] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:44 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 08 10:48:44.331473 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849bce1-0d23-40ef-ab98-446aab1f8af4 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:44.344237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849bce1-0d23-40ef-ab98-446aab1f8af4 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:44.348742 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe24f0d-39bf-4e8f-8cab-2732598f6657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:44.349600 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24f0d-39bf-4e8f-8cab-2732598f6657 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.349874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24f0d-39bf-4e8f-8cab-2732598f6657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.350300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24f0d-39bf-4e8f-8cab-2732598f6657 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.351557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe24f0d-39bf-4e8f-8cab-2732598f6657 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:44.353614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe24f0d-39bf-4e8f-8cab-2732598f6657 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:44.355298 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 161/326] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:44 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:44.361503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bb3cc-f57f-4550-9934-0dbdf81030a3 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:44.370597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bb3cc-f57f-4550-9934-0dbdf81030a3 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:44.375943 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59246a20-368b-45e1-ad5c-05ceb8e3564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:44.376812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59246a20-368b-45e1-ad5c-05ceb8e3564b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.377086 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59246a20-368b-45e1-ad5c-05ceb8e3564b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.377401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59246a20-368b-45e1-ad5c-05ceb8e3564b admin admin] PATH_INFO: `/v3/groups/3c1c245a19ed471c91b01dde04f4985a` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.378753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59246a20-368b-45e1-ad5c-05ceb8e3564b admin admin] RBAC: Authorizing `identity:get_group(group_id=3c1c245a19ed471c91b01dde04f4985a)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:44.380700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59246a20-368b-45e1-ad5c-05ceb8e3564b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:44.382373 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 166/327] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:44 2021] GET /identity/v3/groups/3c1c245a19ed471c91b01dde04f4985a => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:44.388776 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe24f0d-39bf-4e8f-8cab-2732598f6657 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:44.400362 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe24f0d-39bf-4e8f-8cab-2732598f6657 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:44.404679 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693877b4-c222-4f6d-bc25-505de60069e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:44.405345 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693877b4-c222-4f6d-bc25-505de60069e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.405622 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693877b4-c222-4f6d-bc25-505de60069e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.405894 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693877b4-c222-4f6d-bc25-505de60069e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.406754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693877b4-c222-4f6d-bc25-505de60069e7 admin admin] RBAC: Adding query filter params (group.id=3c1c245a19ed471c91b01dde04f4985a, role.id=a4a3a42f23b2463ebc5e198fe56ac656, scope.project.id=d6453f0e70ff411fbd16c7407a3e8446) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:44.407060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693877b4-c222-4f6d-bc25-505de60069e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:44.409216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693877b4-c222-4f6d-bc25-505de60069e7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:44.421620 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 162/328] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Nov 8 10:48:44 2021] GET /identity/v3/role_assignments?group.id=3c1c245a19ed471c91b01dde04f4985a&scope.project.id=d6453f0e70ff411fbd16c7407a3e8446&role.id=a4a3a42f23b2463ebc5e198fe56ac656 => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:44.727499 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7344d-1502-447f-8970-60b5f95cfbd9 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.727902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7344d-1502-447f-8970-60b5f95cfbd9 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.728074 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7344d-1502-447f-8970-60b5f95cfbd9 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.729938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 167/329] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:44.736255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc354b1-a23b-48d3-84bb-c7db368e12fc None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.736844 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc354b1-a23b-48d3-84bb-c7db368e12fc None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.737524 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc354b1-a23b-48d3-84bb-c7db368e12fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.756979 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-4fc354b1-a23b-48d3-84bb-c7db368e12fc None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:44.758175 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-4fc354b1-a23b-48d3-84bb-c7db368e12fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:44.766300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 163/330] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:44.792432 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7344d-1502-447f-8970-60b5f95cfbd9 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:44.809574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7344d-1502-447f-8970-60b5f95cfbd9 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:44.815609 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1163089-205c-4ab8-a631-f5c976618312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:44.816823 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1163089-205c-4ab8-a631-f5c976618312 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.817314 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1163089-205c-4ab8-a631-f5c976618312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.817785 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1163089-205c-4ab8-a631-f5c976618312 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.829468 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1163089-205c-4ab8-a631-f5c976618312 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:44.837306 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-c1163089-205c-4ab8-a631-f5c976618312 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 08 10:48:44.839147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 168/331] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:44.845789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc354b1-a23b-48d3-84bb-c7db368e12fc None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:44.856987 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc354b1-a23b-48d3-84bb-c7db368e12fc None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:44.861712 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb4aec-79e0-465e-b5b5-a99e21967466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:44.862846 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb4aec-79e0-465e-b5b5-a99e21967466 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.863400 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb4aec-79e0-465e-b5b5-a99e21967466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.863875 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb4aec-79e0-465e-b5b5-a99e21967466 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.864845 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb4aec-79e0-465e-b5b5-a99e21967466 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:44.865352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb4aec-79e0-465e-b5b5-a99e21967466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:44.867191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb4aec-79e0-465e-b5b5-a99e21967466 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:44.876829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 164/332] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:48:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:44.883227 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1163089-205c-4ab8-a631-f5c976618312 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:44.895049 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1163089-205c-4ab8-a631-f5c976618312 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:44.899960 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d143f-19d4-4f4e-9a17-4fc5b719b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:44.900692 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d143f-19d4-4f4e-9a17-4fc5b719b245 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.900973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d143f-19d4-4f4e-9a17-4fc5b719b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.901302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d143f-19d4-4f4e-9a17-4fc5b719b245 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.911755 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d143f-19d4-4f4e-9a17-4fc5b719b245 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:44.913656 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d143f-19d4-4f4e-9a17-4fc5b719b245 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:44.924750 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 169/333] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:44 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:44.931108 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb4aec-79e0-465e-b5b5-a99e21967466 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:44.941789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb4aec-79e0-465e-b5b5-a99e21967466 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:44.946099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603c9dd-3649-4ac7-9ef4-a756825454b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:44.946969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603c9dd-3649-4ac7-9ef4-a756825454b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.947264 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603c9dd-3649-4ac7-9ef4-a756825454b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.947532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603c9dd-3649-4ac7-9ef4-a756825454b5 admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.948711 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603c9dd-3649-4ac7-9ef4-a756825454b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:44.950766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603c9dd-3649-4ac7-9ef4-a756825454b5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:44.952964 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 165/334] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:44 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:44.959628 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d143f-19d4-4f4e-9a17-4fc5b719b245 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:44.970387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d143f-19d4-4f4e-9a17-4fc5b719b245 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:44.975318 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e6fb0-29f1-47f1-938f-e95d8d29097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:44.976419 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6fb0-29f1-47f1-938f-e95d8d29097a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:44.976933 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6fb0-29f1-47f1-938f-e95d8d29097a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:44.977444 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6fb0-29f1-47f1-938f-e95d8d29097a admin admin] PATH_INFO: `/v3/groups/3c1c245a19ed471c91b01dde04f4985a` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:44.979048 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e6fb0-29f1-47f1-938f-e95d8d29097a admin admin] RBAC: Authorizing `identity:get_group(group_id=3c1c245a19ed471c91b01dde04f4985a)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:44.981299 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e6fb0-29f1-47f1-938f-e95d8d29097a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:44.983365 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 170/335] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:44 2021] GET /identity/v3/groups/3c1c245a19ed471c91b01dde04f4985a => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:44.990216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603c9dd-3649-4ac7-9ef4-a756825454b5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:45.000956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603c9dd-3649-4ac7-9ef4-a756825454b5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:45.005965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ce016-2d12-4282-b2e2-76082e27f10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:45.006988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ce016-2d12-4282-b2e2-76082e27f10a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.007513 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ce016-2d12-4282-b2e2-76082e27f10a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.007979 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ce016-2d12-4282-b2e2-76082e27f10a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.009093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ce016-2d12-4282-b2e2-76082e27f10a admin admin] RBAC: Adding query filter params (group.id=3c1c245a19ed471c91b01dde04f4985a, role.id=2dce671f5a1a43da869724374e62098b, scope.project.id=9dec779bc5f842f88b59b29d486b4aa2) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:45.009663 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ce016-2d12-4282-b2e2-76082e27f10a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:45.011810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ce016-2d12-4282-b2e2-76082e27f10a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:45.019793 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 166/336] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Nov 8 10:48:44 2021] GET /identity/v3/role_assignments?group.id=3c1c245a19ed471c91b01dde04f4985a&scope.project.id=9dec779bc5f842f88b59b29d486b4aa2&role.id=2dce671f5a1a43da869724374e62098b => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:45.044256 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632c712-480c-492c-84a4-f7e6688f5c22 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.044557 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632c712-480c-492c-84a4-f7e6688f5c22 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.044976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632c712-480c-492c-84a4-f7e6688f5c22 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.046879 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 171/337] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:45.054203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a13ae-bc76-45d7-ad46-48568a469dfe None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.054513 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a13ae-bc76-45d7-ad46-48568a469dfe None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.054755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a13ae-bc76-45d7-ad46-48568a469dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.073964 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-733a13ae-bc76-45d7-ad46-48568a469dfe None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:45.075278 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-733a13ae-bc76-45d7-ad46-48568a469dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:45.083573 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 167/338] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:45.108271 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632c712-480c-492c-84a4-f7e6688f5c22 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:45.121330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632c712-480c-492c-84a4-f7e6688f5c22 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:45.125751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ddd2a-5095-49ea-9ce4-7d0f41c1a772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:45.126630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ddd2a-5095-49ea-9ce4-7d0f41c1a772 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.126911 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ddd2a-5095-49ea-9ce4-7d0f41c1a772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.127262 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ddd2a-5095-49ea-9ce4-7d0f41c1a772 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.138811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ddd2a-5095-49ea-9ce4-7d0f41c1a772 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:45.147033 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-687ddd2a-5095-49ea-9ce4-7d0f41c1a772 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 08 10:48:45.148639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 172/339] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:48:45 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:45.155154 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a13ae-bc76-45d7-ad46-48568a469dfe None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:45.165320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a13ae-bc76-45d7-ad46-48568a469dfe None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:45.170125 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeea35-a000-4c9d-b6f3-91b2c4d9e170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:45.170814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeea35-a000-4c9d-b6f3-91b2c4d9e170 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.171053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeea35-a000-4c9d-b6f3-91b2c4d9e170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.171396 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeea35-a000-4c9d-b6f3-91b2c4d9e170 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.172176 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeeea35-a000-4c9d-b6f3-91b2c4d9e170 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:45.172478 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeeea35-a000-4c9d-b6f3-91b2c4d9e170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:45.174091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeeea35-a000-4c9d-b6f3-91b2c4d9e170 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:45.184150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 168/340] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:45 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:45.190641 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ddd2a-5095-49ea-9ce4-7d0f41c1a772 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:45.200826 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ddd2a-5095-49ea-9ce4-7d0f41c1a772 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:45.205681 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623502b1-db3e-49e4-88c6-959d99b5fb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:45.206413 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623502b1-db3e-49e4-88c6-959d99b5fb69 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.206680 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623502b1-db3e-49e4-88c6-959d99b5fb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.206949 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623502b1-db3e-49e4-88c6-959d99b5fb69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.216866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623502b1-db3e-49e4-88c6-959d99b5fb69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:45.218740 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623502b1-db3e-49e4-88c6-959d99b5fb69 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:45.229296 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 173/341] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:45 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:45.235263 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeea35-a000-4c9d-b6f3-91b2c4d9e170 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:45.246064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeea35-a000-4c9d-b6f3-91b2c4d9e170 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:45.251975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22ab45-70e2-4d7b-8a4a-a6dce6ba6db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:45.253595 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22ab45-70e2-4d7b-8a4a-a6dce6ba6db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.254211 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22ab45-70e2-4d7b-8a4a-a6dce6ba6db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.254685 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22ab45-70e2-4d7b-8a4a-a6dce6ba6db4 admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.256354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22ab45-70e2-4d7b-8a4a-a6dce6ba6db4 admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:45.258406 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22ab45-70e2-4d7b-8a4a-a6dce6ba6db4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:45.260132 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 169/342] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:45 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:45.266299 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623502b1-db3e-49e4-88c6-959d99b5fb69 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:45.276521 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623502b1-db3e-49e4-88c6-959d99b5fb69 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:45.281134 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1049c-56e2-4562-bbc7-cb83b5d94caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:45.281996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1049c-56e2-4562-bbc7-cb83b5d94caa admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.282276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1049c-56e2-4562-bbc7-cb83b5d94caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.282552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1049c-56e2-4562-bbc7-cb83b5d94caa admin admin] PATH_INFO: `/v3/groups/3c1c245a19ed471c91b01dde04f4985a` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.283822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1049c-56e2-4562-bbc7-cb83b5d94caa admin admin] RBAC: Authorizing `identity:get_group(group_id=3c1c245a19ed471c91b01dde04f4985a)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:45.285693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1049c-56e2-4562-bbc7-cb83b5d94caa admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:45.292661 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 174/343] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:45 2021] GET /identity/v3/groups/3c1c245a19ed471c91b01dde04f4985a => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:45.293898 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22ab45-70e2-4d7b-8a4a-a6dce6ba6db4 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:45.304065 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22ab45-70e2-4d7b-8a4a-a6dce6ba6db4 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:45.311442 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cce9d-a035-4383-859d-4c7355bdb5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:45.312118 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cce9d-a035-4383-859d-4c7355bdb5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.312395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cce9d-a035-4383-859d-4c7355bdb5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.312667 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cce9d-a035-4383-859d-4c7355bdb5d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.313530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cce9d-a035-4383-859d-4c7355bdb5d0 admin admin] RBAC: Adding query filter params (group.id=3c1c245a19ed471c91b01dde04f4985a, role.id=a4a3a42f23b2463ebc5e198fe56ac656, scope.project.id=9dec779bc5f842f88b59b29d486b4aa2) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:45.313840 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cce9d-a035-4383-859d-4c7355bdb5d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:45.315850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cce9d-a035-4383-859d-4c7355bdb5d0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:45.322581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 170/344] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Nov 8 10:48:45 2021] GET /identity/v3/role_assignments?group.id=3c1c245a19ed471c91b01dde04f4985a&scope.project.id=9dec779bc5f842f88b59b29d486b4aa2&role.id=a4a3a42f23b2463ebc5e198fe56ac656 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:45.537363 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142171f5-8129-43e7-a819-cd1859ddefdc None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.538106 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142171f5-8129-43e7-a819-cd1859ddefdc None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.538106 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142171f5-8129-43e7-a819-cd1859ddefdc None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.539633 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 175/345] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:45.547484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df656be1-8268-4c1e-9810-808166309ba5 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.547930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df656be1-8268-4c1e-9810-808166309ba5 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.548050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df656be1-8268-4c1e-9810-808166309ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.567556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-df656be1-8268-4c1e-9810-808166309ba5 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:45.568772 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-df656be1-8268-4c1e-9810-808166309ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:45.577359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 171/346] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:45.602249 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142171f5-8129-43e7-a819-cd1859ddefdc None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:45.616177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142171f5-8129-43e7-a819-cd1859ddefdc None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:45.620706 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aebdd9-2096-4a52-a5ed-b0f731e02fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:45.621493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aebdd9-2096-4a52-a5ed-b0f731e02fdc admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.621774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aebdd9-2096-4a52-a5ed-b0f731e02fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.622052 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aebdd9-2096-4a52-a5ed-b0f731e02fdc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.633477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aebdd9-2096-4a52-a5ed-b0f731e02fdc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:45.640326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-43aebdd9-2096-4a52-a5ed-b0f731e02fdc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:48:45.641516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 176/347] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:48:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:45.648458 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df656be1-8268-4c1e-9810-808166309ba5 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:45.657730 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df656be1-8268-4c1e-9810-808166309ba5 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:45.662664 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf869d-e7df-4c87-bdb1-22c9ee960364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:45.663376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf869d-e7df-4c87-bdb1-22c9ee960364 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.663657 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf869d-e7df-4c87-bdb1-22c9ee960364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.663928 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf869d-e7df-4c87-bdb1-22c9ee960364 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.664707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf869d-e7df-4c87-bdb1-22c9ee960364 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:45.665006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf869d-e7df-4c87-bdb1-22c9ee960364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:45.666625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf869d-e7df-4c87-bdb1-22c9ee960364 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:45.675527 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 172/348] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:45.681731 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aebdd9-2096-4a52-a5ed-b0f731e02fdc admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:45.691538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aebdd9-2096-4a52-a5ed-b0f731e02fdc admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:45.696070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa350b1b-9268-4bb9-a193-aeab3426a176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:45.696711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa350b1b-9268-4bb9-a193-aeab3426a176 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.696991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa350b1b-9268-4bb9-a193-aeab3426a176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.697259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa350b1b-9268-4bb9-a193-aeab3426a176 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.706526 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa350b1b-9268-4bb9-a193-aeab3426a176 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:45.708330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa350b1b-9268-4bb9-a193-aeab3426a176 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:45.717455 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 177/349] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:45 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:45.724235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf869d-e7df-4c87-bdb1-22c9ee960364 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:45.734322 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf869d-e7df-4c87-bdb1-22c9ee960364 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:45.739818 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627ba7-8892-4128-a51a-fc4de5de73a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:45.740689 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627ba7-8892-4128-a51a-fc4de5de73a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.740970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627ba7-8892-4128-a51a-fc4de5de73a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.741239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627ba7-8892-4128-a51a-fc4de5de73a4 admin admin] PATH_INFO: `/v3/projects/27515e2cec514f3da80e13fa65b719ab` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.742651 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3627ba7-8892-4128-a51a-fc4de5de73a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=27515e2cec514f3da80e13fa65b719ab)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:45.744500 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3627ba7-8892-4128-a51a-fc4de5de73a4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:45.746158 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 173/350] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:48:45 2021] GET /identity/v3/projects/27515e2cec514f3da80e13fa65b719ab => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:45.752439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa350b1b-9268-4bb9-a193-aeab3426a176 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:45.761579 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa350b1b-9268-4bb9-a193-aeab3426a176 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:45.766066 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24be11-970a-498e-9dc7-2b17d5e58340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:45.767330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24be11-970a-498e-9dc7-2b17d5e58340 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.767613 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24be11-970a-498e-9dc7-2b17d5e58340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.767887 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24be11-970a-498e-9dc7-2b17d5e58340 admin admin] PATH_INFO: `/v3/groups/c78c255e4dac4b509aa8a165d9d439f5` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.769146 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24be11-970a-498e-9dc7-2b17d5e58340 admin admin] RBAC: Authorizing `identity:get_group(group_id=c78c255e4dac4b509aa8a165d9d439f5)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:45.771033 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24be11-970a-498e-9dc7-2b17d5e58340 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:45.772619 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 178/351] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Nov 8 10:48:45 2021] GET /identity/v3/groups/c78c255e4dac4b509aa8a165d9d439f5 => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:45.778587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627ba7-8892-4128-a51a-fc4de5de73a4 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:45.788835 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627ba7-8892-4128-a51a-fc4de5de73a4 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:45.793326 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36b794-4edb-4c09-aa10-062d5caa06a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:45.793947 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36b794-4edb-4c09-aa10-062d5caa06a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:45.794230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36b794-4edb-4c09-aa10-062d5caa06a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:45.794506 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36b794-4edb-4c09-aa10-062d5caa06a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:45.795390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36b794-4edb-4c09-aa10-062d5caa06a4 admin admin] RBAC: Adding query filter params (group.id=c78c255e4dac4b509aa8a165d9d439f5, role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=27515e2cec514f3da80e13fa65b719ab) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:45.795698 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36b794-4edb-4c09-aa10-062d5caa06a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:45.797808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36b794-4edb-4c09-aa10-062d5caa06a4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:45.804089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 174/352] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Nov 8 10:48:45 2021] GET /identity/v3/role_assignments?group.id=c78c255e4dac4b509aa8a165d9d439f5&scope.project.id=27515e2cec514f3da80e13fa65b719ab&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:48.605729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f481-9138-4c25-833f-916eedc3823b None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:48.606245 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f481-9138-4c25-833f-916eedc3823b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:48.606245 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f481-9138-4c25-833f-916eedc3823b None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:48.608351 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 179/353] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:48.612187 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b4f8-2521-4819-bdd0-10c9cf793c74 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:48.612640 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b4f8-2521-4819-bdd0-10c9cf793c74 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:48.612860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b4f8-2521-4819-bdd0-10c9cf793c74 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:48.615162 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 175/354] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:48.620778 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc8fb9-3449-41a8-8f26-6b6d11fa0aec None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:48.621072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc8fb9-3449-41a8-8f26-6b6d11fa0aec None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:48.621352 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc8fb9-3449-41a8-8f26-6b6d11fa0aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:48.622771 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04620e-8c9c-4f78-9701-1b4e20f7901f None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:48.623055 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04620e-8c9c-4f78-9701-1b4e20f7901f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:48.623372 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04620e-8c9c-4f78-9701-1b4e20f7901f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:48.648888 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-3cbc8fb9-3449-41a8-8f26-6b6d11fa0aec None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:48.650564 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-3cbc8fb9-3449-41a8-8f26-6b6d11fa0aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:48.665616 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-3a04620e-8c9c-4f78-9701-1b4e20f7901f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:48.666852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3a04620e-8c9c-4f78-9701-1b4e20f7901f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:48.674246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 180/355] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:48.691417 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 176/356] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:48.701998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc8fb9-3449-41a8-8f26-6b6d11fa0aec None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:48.711750 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc8fb9-3449-41a8-8f26-6b6d11fa0aec None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:48.716965 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaae20-11cc-417d-b018-434c81f7c74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:48.717709 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaae20-11cc-417d-b018-434c81f7c74b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:48.717989 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaae20-11cc-417d-b018-434c81f7c74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:48.718261 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaae20-11cc-417d-b018-434c81f7c74b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:48.729595 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04620e-8c9c-4f78-9701-1b4e20f7901f None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:48.730192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaae20-11cc-417d-b018-434c81f7c74b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:48.732102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaae20-11cc-417d-b018-434c81f7c74b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:48.745734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04620e-8c9c-4f78-9701-1b4e20f7901f None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:48.750881 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-decaae20-11cc-417d-b018-434c81f7c74b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:48.752497 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 181/357] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:48.758797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaae20-11cc-417d-b018-434c81f7c74b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:48.760353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70863acd-137b-428a-8e8a-af82d2c1c255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:48.762131 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70863acd-137b-428a-8e8a-af82d2c1c255 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:48.762965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70863acd-137b-428a-8e8a-af82d2c1c255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:48.764026 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70863acd-137b-428a-8e8a-af82d2c1c255 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:48.775162 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaae20-11cc-417d-b018-434c81f7c74b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:48.781610 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c606d7-4138-4819-a57e-aabea5ea3ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:48.782296 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c606d7-4138-4819-a57e-aabea5ea3ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:48.782580 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c606d7-4138-4819-a57e-aabea5ea3ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:48.782859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c606d7-4138-4819-a57e-aabea5ea3ff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:48.783816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c606d7-4138-4819-a57e-aabea5ea3ff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:48.784164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c606d7-4138-4819-a57e-aabea5ea3ff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:48.785326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-e2c606d7-4138-4819-a57e-aabea5ea3ff8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:48.785326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:48:48.785326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:48:48.786226 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c606d7-4138-4819-a57e-aabea5ea3ff8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:48.793895 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70863acd-137b-428a-8e8a-af82d2c1c255 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:48.795807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70863acd-137b-428a-8e8a-af82d2c1c255 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:48.814259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 182/358] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:48.825789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c606d7-4138-4819-a57e-aabea5ea3ff8 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:48.826153 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-70863acd-137b-428a-8e8a-af82d2c1c255 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:48.828207 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 177/359] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:48.838960 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c606d7-4138-4819-a57e-aabea5ea3ff8 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:48.846107 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70863acd-137b-428a-8e8a-af82d2c1c255 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:48.858595 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02451cef-4680-4c4f-82ff-b1edf151d198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:48.861091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70863acd-137b-428a-8e8a-af82d2c1c255 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:48.863311 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451cef-4680-4c4f-82ff-b1edf151d198 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:48.864935 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451cef-4680-4c4f-82ff-b1edf151d198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:48.865843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451cef-4680-4c4f-82ff-b1edf151d198 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:48.866750 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02451cef-4680-4c4f-82ff-b1edf151d198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:48.868730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-02451cef-4680-4c4f-82ff-b1edf151d198 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:48.868730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:48:48.868730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:48:48.870113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8397a-17c2-4058-955d-dde8cf285bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:48.871559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02451cef-4680-4c4f-82ff-b1edf151d198 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:48.872370 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8397a-17c2-4058-955d-dde8cf285bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:48.872785 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8397a-17c2-4058-955d-dde8cf285bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:48.873189 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8397a-17c2-4058-955d-dde8cf285bd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:48.875590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8397a-17c2-4058-955d-dde8cf285bd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:48.876049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8397a-17c2-4058-955d-dde8cf285bd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:48.877852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8397a-17c2-4058-955d-dde8cf285bd6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:48.903361 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 178/360] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:48.904647 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 183/361] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Nov 8 10:48:48 2021] POST /identity/v3/users => generated 246 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:48:48.908387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b363-7dfd-451b-a240-0ba912fbf038 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:48.908387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b363-7dfd-451b-a240-0ba912fbf038 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:48.908387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b363-7dfd-451b-a240-0ba912fbf038 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:48.908387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 179/362] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:48.910236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02451cef-4680-4c4f-82ff-b1edf151d198 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:48.914696 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8d82f-0e63-4944-8045-80a817820989 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:48.915050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8d82f-0e63-4944-8045-80a817820989 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:48.915352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8d82f-0e63-4944-8045-80a817820989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:48.929000 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02451cef-4680-4c4f-82ff-b1edf151d198 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:48.934532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-d6c8d82f-0e63-4944-8045-80a817820989 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:48.935811 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d6c8d82f-0e63-4944-8045-80a817820989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:48.938050 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e36c9b-c53e-4f5f-b59d-dbc33f279d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:48.939196 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e36c9b-c53e-4f5f-b59d-dbc33f279d50 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:48.939851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e36c9b-c53e-4f5f-b59d-dbc33f279d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:48.940344 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e36c9b-c53e-4f5f-b59d-dbc33f279d50 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:48.941214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e36c9b-c53e-4f5f-b59d-dbc33f279d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:48.947876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e36c9b-c53e-4f5f-b59d-dbc33f279d50 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:48.949484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 180/363] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:48.971101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8d82f-0e63-4944-8045-80a817820989 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:48.983752 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8d82f-0e63-4944-8045-80a817820989 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:48.989452 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e1557-daf6-4052-b190-74b99781b436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:48.990012 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 184/364] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Nov 8 10:48:48 2021] POST /identity/v3/users => generated 248 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:48:48.991681 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e1557-daf6-4052-b190-74b99781b436 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:48.991681 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e1557-daf6-4052-b190-74b99781b436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:48.991681 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e1557-daf6-4052-b190-74b99781b436 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:49.008776 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e1557-daf6-4052-b190-74b99781b436 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:49.010680 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e1557-daf6-4052-b190-74b99781b436 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:49.038355 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-af4e1557-daf6-4052-b190-74b99781b436 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:49.045377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 181/365] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:49.046865 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e36c9b-c53e-4f5f-b59d-dbc33f279d50 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:49.069897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e36c9b-c53e-4f5f-b59d-dbc33f279d50 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:49.078907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebb2c9-39cf-47a6-b9b7-d5b899a109c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:49.080004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebb2c9-39cf-47a6-b9b7-d5b899a109c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:49.080542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebb2c9-39cf-47a6-b9b7-d5b899a109c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:49.081013 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebb2c9-39cf-47a6-b9b7-d5b899a109c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:49.082072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebb2c9-39cf-47a6-b9b7-d5b899a109c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:49.082604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebb2c9-39cf-47a6-b9b7-d5b899a109c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:49.084503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebb2c9-39cf-47a6-b9b7-d5b899a109c0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:49.109857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 185/366] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:49.117459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e1557-daf6-4052-b190-74b99781b436 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:49.134044 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e1557-daf6-4052-b190-74b99781b436 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:49.143369 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853d81d-e64a-43e1-9b2a-2e8ff4c9d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:49.144080 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853d81d-e64a-43e1-9b2a-2e8ff4c9d9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:49.144361 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853d81d-e64a-43e1-9b2a-2e8ff4c9d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:49.144639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853d81d-e64a-43e1-9b2a-2e8ff4c9d9f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:49.145553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853d81d-e64a-43e1-9b2a-2e8ff4c9d9f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:49.147834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853d81d-e64a-43e1-9b2a-2e8ff4c9d9f1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:49.182433 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 182/367] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Nov 8 10:48:49 2021] POST /identity/v3/users => generated 248 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:48:49.475544 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dffea-d734-4ece-8642-f150ec8ca3e3 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:49.475841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dffea-d734-4ece-8642-f150ec8ca3e3 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:49.476114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dffea-d734-4ece-8642-f150ec8ca3e3 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:49.479258 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 186/368] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:49 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:49.484333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145003b-9e8c-4e68-92bf-f7529b43ab7b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:49.484625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145003b-9e8c-4e68-92bf-f7529b43ab7b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:49.484907 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145003b-9e8c-4e68-92bf-f7529b43ab7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:49.511238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-e145003b-9e8c-4e68-92bf-f7529b43ab7b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:49.512455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e145003b-9e8c-4e68-92bf-f7529b43ab7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:49.522668 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 183/369] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:49.547631 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dffea-d734-4ece-8642-f150ec8ca3e3 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:49.563359 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dffea-d734-4ece-8642-f150ec8ca3e3 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:49.569690 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba42977-83a0-4042-b056-be9abf0ced40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:49.570511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba42977-83a0-4042-b056-be9abf0ced40 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:49.570797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba42977-83a0-4042-b056-be9abf0ced40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:49.571071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba42977-83a0-4042-b056-be9abf0ced40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:49.589356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba42977-83a0-4042-b056-be9abf0ced40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:49.591643 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba42977-83a0-4042-b056-be9abf0ced40 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:49.610920 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-0ba42977-83a0-4042-b056-be9abf0ced40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:49.612938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 187/370] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:49.619493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145003b-9e8c-4e68-92bf-f7529b43ab7b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:49.632406 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145003b-9e8c-4e68-92bf-f7529b43ab7b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:49.639487 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5623a-2b06-4c9f-ad10-494ad7e58e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:49.640513 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5623a-2b06-4c9f-ad10-494ad7e58e8f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:49.640990 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5623a-2b06-4c9f-ad10-494ad7e58e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:49.641455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5623a-2b06-4c9f-ad10-494ad7e58e8f admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:49.642810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5623a-2b06-4c9f-ad10-494ad7e58e8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:49.643367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5623a-2b06-4c9f-ad10-494ad7e58e8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:49.645190 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5623a-2b06-4c9f-ad10-494ad7e58e8f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:49.661447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 184/371] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:49.667822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba42977-83a0-4042-b056-be9abf0ced40 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:49.678135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba42977-83a0-4042-b056-be9abf0ced40 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:49.686562 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d226ee-b303-4677-b504-04d0c7b40ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:49.687509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d226ee-b303-4677-b504-04d0c7b40ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:49.687990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d226ee-b303-4677-b504-04d0c7b40ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:49.688475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d226ee-b303-4677-b504-04d0c7b40ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:49.689391 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d226ee-b303-4677-b504-04d0c7b40ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:49.691605 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d226ee-b303-4677-b504-04d0c7b40ad0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:49.721474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 188/372] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Nov 8 10:48:49 2021] POST /identity/v3/users => generated 249 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:48:50.335435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b51be2-02c7-4774-92bf-610c178949cf None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:50.335818 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b51be2-02c7-4774-92bf-610c178949cf None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:50.336005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b51be2-02c7-4774-92bf-610c178949cf None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:50.338137 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 185/373] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:50.345490 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e36c4b-ef97-4475-a1a6-f55e4b946e56 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:50.345803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e36c4b-ef97-4475-a1a6-f55e4b946e56 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:50.346128 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e36c4b-ef97-4475-a1a6-f55e4b946e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:50.365278 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-64e36c4b-ef97-4475-a1a6-f55e4b946e56 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:50.366503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-64e36c4b-ef97-4475-a1a6-f55e4b946e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:50.375170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 189/374] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:50.400066 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b51be2-02c7-4774-92bf-610c178949cf None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:50.412892 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b51be2-02c7-4774-92bf-610c178949cf None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:50.417256 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999affd7-a655-45a6-a6e8-3f2427c94d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:50.417931 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999affd7-a655-45a6-a6e8-3f2427c94d2b admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:50.418220 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999affd7-a655-45a6-a6e8-3f2427c94d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:50.418555 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999affd7-a655-45a6-a6e8-3f2427c94d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:50.419377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999affd7-a655-45a6-a6e8-3f2427c94d2b admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:50.421055 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999affd7-a655-45a6-a6e8-3f2427c94d2b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:50.433884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.sql.core [None req-999affd7-a655-45a6-a6e8-3f2427c94d2b admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 08 10:48:50.433884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 08 10:48:50.433884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [parameters: {'id': '3314a49909f94fc1a9044cb1d429e81b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 08 10:48:50.433884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79201) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 08 10:48:50.454071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-999affd7-a655-45a6-a6e8-3f2427c94d2b admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 08 10:48:50.456009 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 186/375] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 10:48:50 2021] POST /identity/v3/roles => generated 144 bytes in 56 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:50.467733 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e36c4b-ef97-4475-a1a6-f55e4b946e56 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:50.482836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e36c4b-ef97-4475-a1a6-f55e4b946e56 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:50.488599 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc28dc-d936-494a-9ca7-3f49fc780afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:50.489510 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc28dc-d936-494a-9ca7-3f49fc780afa admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:50.489878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc28dc-d936-494a-9ca7-3f49fc780afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:50.490152 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc28dc-d936-494a-9ca7-3f49fc780afa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:50.502590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc28dc-d936-494a-9ca7-3f49fc780afa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:50.510128 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-84dc28dc-d936-494a-9ca7-3f49fc780afa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 08 10:48:50.514554 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 190/376] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:48:50 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:50.518936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999affd7-a655-45a6-a6e8-3f2427c94d2b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:50.531211 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999affd7-a655-45a6-a6e8-3f2427c94d2b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:50.536236 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb232d-7c4c-4fb0-9fe1-e52f89b935d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:50.536991 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb232d-7c4c-4fb0-9fe1-e52f89b935d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:50.537273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb232d-7c4c-4fb0-9fe1-e52f89b935d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:50.537548 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb232d-7c4c-4fb0-9fe1-e52f89b935d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:50.538377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb232d-7c4c-4fb0-9fe1-e52f89b935d0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:50.538694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb232d-7c4c-4fb0-9fe1-e52f89b935d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:50.540649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb232d-7c4c-4fb0-9fe1-e52f89b935d0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:50.553936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 187/377] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:50 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:51.833514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175d249-6dc9-4ed2-a326-1766e2082e7e None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:51.834031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175d249-6dc9-4ed2-a326-1766e2082e7e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:51.834031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175d249-6dc9-4ed2-a326-1766e2082e7e None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:51.836101 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 191/378] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:51.841723 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3116c2-ac1b-476f-b5ec-fd3834304309 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:51.842119 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3116c2-ac1b-476f-b5ec-fd3834304309 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:51.842299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3116c2-ac1b-476f-b5ec-fd3834304309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:51.864856 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-1d3116c2-ac1b-476f-b5ec-fd3834304309 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:51.866063 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1d3116c2-ac1b-476f-b5ec-fd3834304309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:51.877194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418f6fd-3413-4937-9976-1655a0e60e7e None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:51.877699 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418f6fd-3413-4937-9976-1655a0e60e7e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:51.877877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 188/379] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:51.878024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418f6fd-3413-4937-9976-1655a0e60e7e None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:51.880052 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 192/380] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:51.885963 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad09bc-092d-460e-b8d7-c35d24e8fd04 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:51.886252 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad09bc-092d-460e-b8d7-c35d24e8fd04 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:51.886532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad09bc-092d-460e-b8d7-c35d24e8fd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:51.901649 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418f6fd-3413-4937-9976-1655a0e60e7e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:51.908008 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-b9ad09bc-092d-460e-b8d7-c35d24e8fd04 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:51.909477 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b9ad09bc-092d-460e-b8d7-c35d24e8fd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:51.917582 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 189/381] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:51.932728 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418f6fd-3413-4937-9976-1655a0e60e7e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:51.941965 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29c2c3-ff8f-41a3-bcbe-fe5e7b4ad120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:51.942797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29c2c3-ff8f-41a3-bcbe-fe5e7b4ad120 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:51.943080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29c2c3-ff8f-41a3-bcbe-fe5e7b4ad120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:51.943406 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29c2c3-ff8f-41a3-bcbe-fe5e7b4ad120 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:51.964184 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29c2c3-ff8f-41a3-bcbe-fe5e7b4ad120 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:51.964882 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad09bc-092d-460e-b8d7-c35d24e8fd04 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:51.971381 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-ae29c2c3-ff8f-41a3-bcbe-fe5e7b4ad120 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:48:51.972817 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 193/382] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:48:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:51.975053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad09bc-092d-460e-b8d7-c35d24e8fd04 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:51.981898 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cd465-65c8-445a-8d68-98e216f24ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:51.982703 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cd465-65c8-445a-8d68-98e216f24ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:51.982984 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cd465-65c8-445a-8d68-98e216f24ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:51.983296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cd465-65c8-445a-8d68-98e216f24ae5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:51.984011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29c2c3-ff8f-41a3-bcbe-fe5e7b4ad120 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:51.994229 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cd465-65c8-445a-8d68-98e216f24ae5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:51.999958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29c2c3-ff8f-41a3-bcbe-fe5e7b4ad120 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.000988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-c56cd465-65c8-445a-8d68-98e216f24ae5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:48:52.002584 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 190/383] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:48:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:52.010428 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1266fb-d103-43f3-989a-fde3f5a5fce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.011103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1266fb-d103-43f3-989a-fde3f5a5fce8 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.011443 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1266fb-d103-43f3-989a-fde3f5a5fce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.011723 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1266fb-d103-43f3-989a-fde3f5a5fce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.012502 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1266fb-d103-43f3-989a-fde3f5a5fce8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.012809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1266fb-d103-43f3-989a-fde3f5a5fce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.014447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1266fb-d103-43f3-989a-fde3f5a5fce8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.018845 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cd465-65c8-445a-8d68-98e216f24ae5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.029544 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cd465-65c8-445a-8d68-98e216f24ae5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.032717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 194/384] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:48:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:52.039335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1266fb-d103-43f3-989a-fde3f5a5fce8 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.047705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe4a2e-a390-4454-a925-e1d8886ebf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.048385 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe4a2e-a390-4454-a925-e1d8886ebf6b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.048655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe4a2e-a390-4454-a925-e1d8886ebf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.048928 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe4a2e-a390-4454-a925-e1d8886ebf6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.049873 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe4a2e-a390-4454-a925-e1d8886ebf6b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.050155 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe4a2e-a390-4454-a925-e1d8886ebf6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.053070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe4a2e-a390-4454-a925-e1d8886ebf6b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.057566 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1266fb-d103-43f3-989a-fde3f5a5fce8 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.069762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5cf52-efa2-49a0-bbce-417113e83415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.070561 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5cf52-efa2-49a0-bbce-417113e83415 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.070838 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5cf52-efa2-49a0-bbce-417113e83415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.071107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5cf52-efa2-49a0-bbce-417113e83415 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.072053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 191/385] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:52.074495 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe4a2e-a390-4454-a925-e1d8886ebf6b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.090113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5cf52-efa2-49a0-bbce-417113e83415 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.091935 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5cf52-efa2-49a0-bbce-417113e83415 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.094480 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe4a2e-a390-4454-a925-e1d8886ebf6b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.101392 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cbca5-a709-47e0-86d9-5348bb40565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.102924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbca5-a709-47e0-86d9-5348bb40565f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.103467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbca5-a709-47e0-86d9-5348bb40565f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.104370 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbca5-a709-47e0-86d9-5348bb40565f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.112886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-a1f5cf52-efa2-49a0-bbce-417113e83415 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:52.114697 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 195/386] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:52.117147 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cbca5-a709-47e0-86d9-5348bb40565f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.119251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cbca5-a709-47e0-86d9-5348bb40565f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.120177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f0b9f-402d-4962-837a-831cc0a12e93 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.120469 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f0b9f-402d-4962-837a-831cc0a12e93 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.120747 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f0b9f-402d-4962-837a-831cc0a12e93 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.127170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 196/387] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:52 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:52.127170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f0b9f-402d-4962-837a-831cc0a12e93 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.144114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f0b9f-402d-4962-837a-831cc0a12e93 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.144459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-857cbca5-a709-47e0-86d9-5348bb40565f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:52.145987 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 192/388] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:52.147007 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b6a55-aa3f-48cf-bd97-92e831212a3b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.147335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b6a55-aa3f-48cf-bd97-92e831212a3b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.147611 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b6a55-aa3f-48cf-bd97-92e831212a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.150273 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a5fb9-fc65-4dad-820a-4ce5155208d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.151523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a5fb9-fc65-4dad-820a-4ce5155208d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.152001 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a5fb9-fc65-4dad-820a-4ce5155208d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.152515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a5fb9-fc65-4dad-820a-4ce5155208d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.153508 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a5fb9-fc65-4dad-820a-4ce5155208d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.154221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a5fb9-fc65-4dad-820a-4ce5155208d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.156946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a5fb9-fc65-4dad-820a-4ce5155208d8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.166240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-e65b6a55-aa3f-48cf-bd97-92e831212a3b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:52.167751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e65b6a55-aa3f-48cf-bd97-92e831212a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:52.171501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 197/389] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:52.172657 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a5fb9-fc65-4dad-820a-4ce5155208d8 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.181563 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 193/390] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:52.182379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b6a55-aa3f-48cf-bd97-92e831212a3b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.183540 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a5fb9-fc65-4dad-820a-4ce5155208d8 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.189198 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23403a4b-50a0-4e13-92a4-4c11c4ae9100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.190406 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403a4b-50a0-4e13-92a4-4c11c4ae9100 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.190980 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403a4b-50a0-4e13-92a4-4c11c4ae9100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.191486 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403a4b-50a0-4e13-92a4-4c11c4ae9100 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.192221 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b6a55-aa3f-48cf-bd97-92e831212a3b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.192650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403a4b-50a0-4e13-92a4-4c11c4ae9100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.193335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403a4b-50a0-4e13-92a4-4c11c4ae9100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.195328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403a4b-50a0-4e13-92a4-4c11c4ae9100 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.196925 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e51ee-470b-4927-b4f6-1609892c3742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.197772 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e51ee-470b-4927-b4f6-1609892c3742 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.198057 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e51ee-470b-4927-b4f6-1609892c3742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.198327 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e51ee-470b-4927-b4f6-1609892c3742 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.207000 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e51ee-470b-4927-b4f6-1609892c3742 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.208862 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e51ee-470b-4927-b4f6-1609892c3742 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.210935 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 198/391] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:52.216379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23403a4b-50a0-4e13-92a4-4c11c4ae9100 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.225297 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-729e51ee-470b-4927-b4f6-1609892c3742 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 08 10:48:52.226255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 194/392] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/users/glance => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:52.227021 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e51ee-470b-4927-b4f6-1609892c3742 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.229389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23403a4b-50a0-4e13-92a4-4c11c4ae9100 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.235223 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf7324-bc91-496d-9303-5147b78e05da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.236254 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf7324-bc91-496d-9303-5147b78e05da admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.236792 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e51ee-470b-4927-b4f6-1609892c3742 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.237044 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf7324-bc91-496d-9303-5147b78e05da admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.237507 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf7324-bc91-496d-9303-5147b78e05da admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.242272 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e08ad3-3169-4120-9c95-797bf462a61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.243092 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08ad3-3169-4120-9c95-797bf462a61c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.243407 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08ad3-3169-4120-9c95-797bf462a61c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.243732 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08ad3-3169-4120-9c95-797bf462a61c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.248467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf7324-bc91-496d-9303-5147b78e05da admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.251391 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf7324-bc91-496d-9303-5147b78e05da admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.255413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e08ad3-3169-4120-9c95-797bf462a61c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:52.262460 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-c5e08ad3-3169-4120-9c95-797bf462a61c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:48:52.264175 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 195/393] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:52.265023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e08ad3-3169-4120-9c95-797bf462a61c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.267195 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-3adf7324-bc91-496d-9303-5147b78e05da admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 08 10:48:52.269103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 199/394] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:52.272014 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf7324-bc91-496d-9303-5147b78e05da admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.276827 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e08ad3-3169-4120-9c95-797bf462a61c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.281829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06664886-44d2-477f-99e4-7f5980cf67df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.282550 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664886-44d2-477f-99e4-7f5980cf67df admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.282832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664886-44d2-477f-99e4-7f5980cf67df admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.283108 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664886-44d2-477f-99e4-7f5980cf67df admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.284398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06664886-44d2-477f-99e4-7f5980cf67df admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.284811 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06664886-44d2-477f-99e4-7f5980cf67df admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.285538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf7324-bc91-496d-9303-5147b78e05da admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.285932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-06664886-44d2-477f-99e4-7f5980cf67df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:52.285932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:48:52.285932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:48:52.287196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06664886-44d2-477f-99e4-7f5980cf67df admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.290844 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3c5da-3b71-4f4d-a7ac-4c7bd0e5ca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.291773 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3c5da-3b71-4f4d-a7ac-4c7bd0e5ca14 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.292268 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3c5da-3b71-4f4d-a7ac-4c7bd0e5ca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.292732 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3c5da-3b71-4f4d-a7ac-4c7bd0e5ca14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.293682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3c5da-3b71-4f4d-a7ac-4c7bd0e5ca14 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.294197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3c5da-3b71-4f4d-a7ac-4c7bd0e5ca14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.296013 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3c5da-3b71-4f4d-a7ac-4c7bd0e5ca14 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.306836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 200/395] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:52.308097 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3c5da-3b71-4f4d-a7ac-4c7bd0e5ca14 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.319473 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3c5da-3b71-4f4d-a7ac-4c7bd0e5ca14 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.325117 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd00cf-f42b-432c-984f-c80fbfc3c5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.326043 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd00cf-f42b-432c-984f-c80fbfc3c5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.326520 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd00cf-f42b-432c-984f-c80fbfc3c5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.327208 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 196/396] 10.222.0.20 () {56 vars in 1158 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:52.327553 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd00cf-f42b-432c-984f-c80fbfc3c5a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.327903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06664886-44d2-477f-99e4-7f5980cf67df admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.328987 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd00cf-f42b-432c-984f-c80fbfc3c5a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.329504 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd00cf-f42b-432c-984f-c80fbfc3c5a0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.330911 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-37dd00cf-f42b-432c-984f-c80fbfc3c5a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:52.330911 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:48:52.330911 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:48:52.332734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd00cf-f42b-432c-984f-c80fbfc3c5a0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.341391 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06664886-44d2-477f-99e4-7f5980cf67df admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.346336 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b7f60-9fb4-43a3-b17a-9cd234d6e08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.348577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b7f60-9fb4-43a3-b17a-9cd234d6e08a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.349070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b7f60-9fb4-43a3-b17a-9cd234d6e08a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.349561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b7f60-9fb4-43a3-b17a-9cd234d6e08a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.361200 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b7f60-9fb4-43a3-b17a-9cd234d6e08a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.363536 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b7f60-9fb4-43a3-b17a-9cd234d6e08a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.376703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 201/397] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:52.377536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd00cf-f42b-432c-984f-c80fbfc3c5a0 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.385065 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-907b7f60-9fb4-43a3-b17a-9cd234d6e08a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:52.387106 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 197/398] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:52.387857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd00cf-f42b-432c-984f-c80fbfc3c5a0 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.388379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b7f60-9fb4-43a3-b17a-9cd234d6e08a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.396488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f1cfa-c671-4bac-a1b4-8c11442544ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.396488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f1cfa-c671-4bac-a1b4-8c11442544ab admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.396488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f1cfa-c671-4bac-a1b4-8c11442544ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.396823 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f1cfa-c671-4bac-a1b4-8c11442544ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.405008 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b7f60-9fb4-43a3-b17a-9cd234d6e08a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.405690 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f1cfa-c671-4bac-a1b4-8c11442544ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.407719 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f1cfa-c671-4bac-a1b4-8c11442544ab admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.411978 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b18f6-129c-47e2-a214-a38dbb02bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.412764 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b18f6-129c-47e2-a214-a38dbb02bbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.413394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b18f6-129c-47e2-a214-a38dbb02bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.413394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b18f6-129c-47e2-a214-a38dbb02bbd7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.417802 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 202/399] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:52.418545 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f1cfa-c671-4bac-a1b4-8c11442544ab admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.422174 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b18f6-129c-47e2-a214-a38dbb02bbd7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.424247 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b18f6-129c-47e2-a214-a38dbb02bbd7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.428298 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f1cfa-c671-4bac-a1b4-8c11442544ab admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.433281 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefa8f0-07ed-4eee-9493-0dd3b4ca23ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.433992 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefa8f0-07ed-4eee-9493-0dd3b4ca23ca admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.434374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefa8f0-07ed-4eee-9493-0dd3b4ca23ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.434753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefa8f0-07ed-4eee-9493-0dd3b4ca23ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.434916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 198/400] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:52.435756 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefa8f0-07ed-4eee-9493-0dd3b4ca23ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.435958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b18f6-129c-47e2-a214-a38dbb02bbd7 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.436181 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefa8f0-07ed-4eee-9493-0dd3b4ca23ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.437958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefa8f0-07ed-4eee-9493-0dd3b4ca23ca admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.445370 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b18f6-129c-47e2-a214-a38dbb02bbd7 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.449842 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecb285-66fe-49b7-9d67-19ce820f0f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.450707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecb285-66fe-49b7-9d67-19ce820f0f04 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.451088 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecb285-66fe-49b7-9d67-19ce820f0f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.451508 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecb285-66fe-49b7-9d67-19ce820f0f04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.451877 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 203/401] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:52.456145 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefa8f0-07ed-4eee-9493-0dd3b4ca23ca admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.475770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefa8f0-07ed-4eee-9493-0dd3b4ca23ca admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.477291 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecb285-66fe-49b7-9d67-19ce820f0f04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.479238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecb285-66fe-49b7-9d67-19ce820f0f04 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.484171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69f620-5b56-4d27-b15d-a85aefb00811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.485221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69f620-5b56-4d27-b15d-a85aefb00811 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.485714 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69f620-5b56-4d27-b15d-a85aefb00811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.486178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69f620-5b56-4d27-b15d-a85aefb00811 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.498523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69f620-5b56-4d27-b15d-a85aefb00811 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.499625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-cbecb285-66fe-49b7-9d67-19ce820f0f04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:52.500893 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 199/402] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:52.501167 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69f620-5b56-4d27-b15d-a85aefb00811 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.501672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecb285-66fe-49b7-9d67-19ce820f0f04 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.513625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecb285-66fe-49b7-9d67-19ce820f0f04 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.518942 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98687e40-5c6c-475b-91ae-d3432bac2993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.519908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98687e40-5c6c-475b-91ae-d3432bac2993 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.520250 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98687e40-5c6c-475b-91ae-d3432bac2993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.520575 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98687e40-5c6c-475b-91ae-d3432bac2993 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.524270 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-db69f620-5b56-4d27-b15d-a85aefb00811 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:52.525711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 204/403] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:52.526663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69f620-5b56-4d27-b15d-a85aefb00811 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.528242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98687e40-5c6c-475b-91ae-d3432bac2993 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.530398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98687e40-5c6c-475b-91ae-d3432bac2993 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.538126 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69f620-5b56-4d27-b15d-a85aefb00811 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.543105 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d99e7-53e0-4423-a14c-95be72039c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.544061 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d99e7-53e0-4423-a14c-95be72039c1e admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.544555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d99e7-53e0-4423-a14c-95be72039c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.545037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d99e7-53e0-4423-a14c-95be72039c1e admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.545996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d99e7-53e0-4423-a14c-95be72039c1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.546498 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d99e7-53e0-4423-a14c-95be72039c1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.546768 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-98687e40-5c6c-475b-91ae-d3432bac2993 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 08 10:48:52.553344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 200/404] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:52.553344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98687e40-5c6c-475b-91ae-d3432bac2993 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.553531 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d99e7-53e0-4423-a14c-95be72039c1e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.563935 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98687e40-5c6c-475b-91ae-d3432bac2993 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.569970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14f45b-8a1b-4d0e-bbec-91302a60b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.570637 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14f45b-8a1b-4d0e-bbec-91302a60b85a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.570920 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14f45b-8a1b-4d0e-bbec-91302a60b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.571237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14f45b-8a1b-4d0e-bbec-91302a60b85a admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.571983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14f45b-8a1b-4d0e-bbec-91302a60b85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.572289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14f45b-8a1b-4d0e-bbec-91302a60b85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.573016 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 205/405] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:52.574046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14f45b-8a1b-4d0e-bbec-91302a60b85a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.574440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d99e7-53e0-4423-a14c-95be72039c1e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.586961 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d99e7-53e0-4423-a14c-95be72039c1e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.587560 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 201/406] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:52.588464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14f45b-8a1b-4d0e-bbec-91302a60b85a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.592457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12838155-06b9-4302-8ce5-5405cce62348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.593586 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838155-06b9-4302-8ce5-5405cce62348 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.594107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838155-06b9-4302-8ce5-5405cce62348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.595075 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838155-06b9-4302-8ce5-5405cce62348 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.596687 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12838155-06b9-4302-8ce5-5405cce62348 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.597193 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12838155-06b9-4302-8ce5-5405cce62348 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.598463 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14f45b-8a1b-4d0e-bbec-91302a60b85a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.599943 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12838155-06b9-4302-8ce5-5405cce62348 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.603007 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eb436-b37f-4516-8cd6-24dfc2665c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.604732 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb436-b37f-4516-8cd6-24dfc2665c60 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.605024 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb436-b37f-4516-8cd6-24dfc2665c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.605303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb436-b37f-4516-8cd6-24dfc2665c60 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.616342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217eb436-b37f-4516-8cd6-24dfc2665c60 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.618688 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217eb436-b37f-4516-8cd6-24dfc2665c60 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.631439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 206/407] 10.222.0.20 () {56 vars in 1158 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:52.633115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12838155-06b9-4302-8ce5-5405cce62348 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.643438 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-217eb436-b37f-4516-8cd6-24dfc2665c60 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:48:52.645343 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 202/408] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:52.645696 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12838155-06b9-4302-8ce5-5405cce62348 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.646187 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eb436-b37f-4516-8cd6-24dfc2665c60 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.651102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f66c00-fbab-406c-8f97-bf4e98283cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.652581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f66c00-fbab-406c-8f97-bf4e98283cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.653115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f66c00-fbab-406c-8f97-bf4e98283cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.653586 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f66c00-fbab-406c-8f97-bf4e98283cc2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.658385 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eb436-b37f-4516-8cd6-24dfc2665c60 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.663460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f66c00-fbab-406c-8f97-bf4e98283cc2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.664466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06621d39-33ab-4dd4-93b8-1331b122d237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.665117 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06621d39-33ab-4dd4-93b8-1331b122d237 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.665485 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06621d39-33ab-4dd4-93b8-1331b122d237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.665817 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06621d39-33ab-4dd4-93b8-1331b122d237 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.667115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f66c00-fbab-406c-8f97-bf4e98283cc2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.675631 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06621d39-33ab-4dd4-93b8-1331b122d237 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.677540 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06621d39-33ab-4dd4-93b8-1331b122d237 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.683144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-e7f66c00-fbab-406c-8f97-bf4e98283cc2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:48:52.685172 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 207/409] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:52.686182 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f66c00-fbab-406c-8f97-bf4e98283cc2 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.686994 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 203/410] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:52.692373 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06621d39-33ab-4dd4-93b8-1331b122d237 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.697912 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f66c00-fbab-406c-8f97-bf4e98283cc2 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.703374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ead6a3-839b-4204-b7bb-940949e1012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.703935 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06621d39-33ab-4dd4-93b8-1331b122d237 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.704511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ead6a3-839b-4204-b7bb-940949e1012c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.705160 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ead6a3-839b-4204-b7bb-940949e1012c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.705753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ead6a3-839b-4204-b7bb-940949e1012c admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.706967 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ead6a3-839b-4204-b7bb-940949e1012c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.707581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ead6a3-839b-4204-b7bb-940949e1012c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.709062 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-74ead6a3-839b-4204-b7bb-940949e1012c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:52.709062 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:48:52.709062 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:48:52.709291 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62391525-7df6-493b-a46b-9c7337e44184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.709855 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391525-7df6-493b-a46b-9c7337e44184 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.710183 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391525-7df6-493b-a46b-9c7337e44184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.710460 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391525-7df6-493b-a46b-9c7337e44184 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.711326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ead6a3-839b-4204-b7bb-940949e1012c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.711426 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62391525-7df6-493b-a46b-9c7337e44184 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.711661 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62391525-7df6-493b-a46b-9c7337e44184 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.712755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-62391525-7df6-493b-a46b-9c7337e44184 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:48:52.712755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:48:52.712755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:48:52.714146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62391525-7df6-493b-a46b-9c7337e44184 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.731264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 208/411] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:52.733146 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ead6a3-839b-4204-b7bb-940949e1012c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.734850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 204/412] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:52.743347 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62391525-7df6-493b-a46b-9c7337e44184 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.744720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ead6a3-839b-4204-b7bb-940949e1012c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.750081 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a4602-9dec-43b2-be8c-fda50d5a0c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.751413 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4602-9dec-43b2-be8c-fda50d5a0c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.751902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4602-9dec-43b2-be8c-fda50d5a0c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.752736 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4602-9dec-43b2-be8c-fda50d5a0c0c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.753341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62391525-7df6-493b-a46b-9c7337e44184 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.758063 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dbb96-e5f4-4403-bac9-a2f479d253c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.758756 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dbb96-e5f4-4403-bac9-a2f479d253c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.759114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dbb96-e5f4-4403-bac9-a2f479d253c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.759444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dbb96-e5f4-4403-bac9-a2f479d253c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.760297 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3dbb96-e5f4-4403-bac9-a2f479d253c6 admin admin] RBAC: Adding query filter params (role.id=2ba23f9ef2de43a6bf86f97ccf919c68, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=d3421cf1bbb24423a2f24c4667adfdda) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.760699 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3dbb96-e5f4-4403-bac9-a2f479d253c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.762795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3dbb96-e5f4-4403-bac9-a2f479d253c6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.766205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a4602-9dec-43b2-be8c-fda50d5a0c0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.768866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a4602-9dec-43b2-be8c-fda50d5a0c0c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.769444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 205/413] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/role_assignments?user.id=d3421cf1bbb24423a2f24c4667adfdda&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=2ba23f9ef2de43a6bf86f97ccf919c68 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:52.770074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dbb96-e5f4-4403-bac9-a2f479d253c6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.780075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dbb96-e5f4-4403-bac9-a2f479d253c6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.785777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d7d07-0198-439a-9b53-5f7ab6564707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.786462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d7d07-0198-439a-9b53-5f7ab6564707 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.786805 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d7d07-0198-439a-9b53-5f7ab6564707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.787081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d7d07-0198-439a-9b53-5f7ab6564707 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.788058 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d7d07-0198-439a-9b53-5f7ab6564707 admin admin] RBAC: Adding query filter params (role.id=2ba23f9ef2de43a6bf86f97ccf919c68, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=07a71b8adef243049d3b055e66566a63) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.788372 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d7d07-0198-439a-9b53-5f7ab6564707 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.790472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d7d07-0198-439a-9b53-5f7ab6564707 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.793203 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-a61a4602-9dec-43b2-be8c-fda50d5a0c0c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:52.795540 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 209/414] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:52.796955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267a7fc-7d51-407a-8431-d1b06c4323c0 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.797243 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267a7fc-7d51-407a-8431-d1b06c4323c0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.797515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267a7fc-7d51-407a-8431-d1b06c4323c0 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.799602 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 210/415] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:52.802205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267a7fc-7d51-407a-8431-d1b06c4323c0 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.803351 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 206/416] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/role_assignments?user.id=07a71b8adef243049d3b055e66566a63&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=2ba23f9ef2de43a6bf86f97ccf919c68 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:52.807043 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115ce06-d6ca-4f5e-88f2-74b52125642b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.807431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115ce06-d6ca-4f5e-88f2-74b52125642b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.807782 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115ce06-d6ca-4f5e-88f2-74b52125642b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.816833 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267a7fc-7d51-407a-8431-d1b06c4323c0 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.821445 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb268704-5d88-4cf5-95ff-91fc2759336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.822217 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268704-5d88-4cf5-95ff-91fc2759336d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.822591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268704-5d88-4cf5-95ff-91fc2759336d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.822932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268704-5d88-4cf5-95ff-91fc2759336d admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.823786 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb268704-5d88-4cf5-95ff-91fc2759336d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.824816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb268704-5d88-4cf5-95ff-91fc2759336d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.826884 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb268704-5d88-4cf5-95ff-91fc2759336d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.830493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-6115ce06-d6ca-4f5e-88f2-74b52125642b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:52.832039 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6115ce06-d6ca-4f5e-88f2-74b52125642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:52.840688 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 207/417] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:52.841823 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 211/418] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:52.848521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115ce06-d6ca-4f5e-88f2-74b52125642b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.858617 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115ce06-d6ca-4f5e-88f2-74b52125642b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.864188 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbeca1-2225-412e-849f-064bc2248d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.865116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbeca1-2225-412e-849f-064bc2248d46 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.865489 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbeca1-2225-412e-849f-064bc2248d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.865814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbeca1-2225-412e-849f-064bc2248d46 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.868844 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb268704-5d88-4cf5-95ff-91fc2759336d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.874053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbeca1-2225-412e-849f-064bc2248d46 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.876491 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbeca1-2225-412e-849f-064bc2248d46 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.885273 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb268704-5d88-4cf5-95ff-91fc2759336d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.890826 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6a57d-6b96-4ce7-88e0-1a29967391f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.892335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6a57d-6b96-4ce7-88e0-1a29967391f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.892851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6a57d-6b96-4ce7-88e0-1a29967391f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.893516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6a57d-6b96-4ce7-88e0-1a29967391f7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.894755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-bcbbeca1-2225-412e-849f-064bc2248d46 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:48:52.896456 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 208/419] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:52.902825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbeca1-2225-412e-849f-064bc2248d46 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.907829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6a57d-6b96-4ce7-88e0-1a29967391f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:52.914345 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbeca1-2225-412e-849f-064bc2248d46 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.916979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-04c6a57d-6b96-4ce7-88e0-1a29967391f7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:48:52.923189 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af17617-ea7a-4fd7-a659-0234f715f92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.923189 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af17617-ea7a-4fd7-a659-0234f715f92e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.923189 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af17617-ea7a-4fd7-a659-0234f715f92e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.923189 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af17617-ea7a-4fd7-a659-0234f715f92e admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.923587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af17617-ea7a-4fd7-a659-0234f715f92e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.923587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af17617-ea7a-4fd7-a659-0234f715f92e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.923947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 212/420] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:52.924239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af17617-ea7a-4fd7-a659-0234f715f92e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.927091 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6a57d-6b96-4ce7-88e0-1a29967391f7 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.939577 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6a57d-6b96-4ce7-88e0-1a29967391f7 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.942212 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 209/421] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:52.951176 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af17617-ea7a-4fd7-a659-0234f715f92e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.951368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca219e0b-66f1-40cb-8d14-f359d193456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.952043 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca219e0b-66f1-40cb-8d14-f359d193456b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.952405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca219e0b-66f1-40cb-8d14-f359d193456b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.952777 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca219e0b-66f1-40cb-8d14-f359d193456b admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.953713 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca219e0b-66f1-40cb-8d14-f359d193456b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.954077 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca219e0b-66f1-40cb-8d14-f359d193456b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.956031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca219e0b-66f1-40cb-8d14-f359d193456b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.968455 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 213/422] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:52.971296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af17617-ea7a-4fd7-a659-0234f715f92e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:52.976163 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca219e0b-66f1-40cb-8d14-f359d193456b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:52.989722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdbe26-00c0-45d7-a33f-66b35be11665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:52.990423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdbe26-00c0-45d7-a33f-66b35be11665 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:52.990705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdbe26-00c0-45d7-a33f-66b35be11665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:52.990971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdbe26-00c0-45d7-a33f-66b35be11665 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:52.991886 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdbe26-00c0-45d7-a33f-66b35be11665 admin admin] RBAC: Adding query filter params (role.id=2ba23f9ef2de43a6bf86f97ccf919c68, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=4b0a2df68bfc41ada3b2135fc2e1930f) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:52.992201 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdbe26-00c0-45d7-a33f-66b35be11665 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:52.994123 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdbe26-00c0-45d7-a33f-66b35be11665 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:52.997836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca219e0b-66f1-40cb-8d14-f359d193456b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:53.006759 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 210/423] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/role_assignments?user.id=4b0a2df68bfc41ada3b2135fc2e1930f&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=2ba23f9ef2de43a6bf86f97ccf919c68 => generated 259 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:53.012885 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a748e8-9404-453a-a8a4-b635324ae719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:53.013739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a748e8-9404-453a-a8a4-b635324ae719 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.014022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a748e8-9404-453a-a8a4-b635324ae719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.014299 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a748e8-9404-453a-a8a4-b635324ae719 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.031214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a748e8-9404-453a-a8a4-b635324ae719 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:53.033209 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a748e8-9404-453a-a8a4-b635324ae719 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:53.062798 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-e3a748e8-9404-453a-a8a4-b635324ae719 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:53.064517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 214/424] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:53.071601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdbe26-00c0-45d7-a33f-66b35be11665 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:53.083050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdbe26-00c0-45d7-a33f-66b35be11665 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:53.087883 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e15a04-29eb-4c6d-a457-678f838aa998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:53.088645 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e15a04-29eb-4c6d-a457-678f838aa998 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.088983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e15a04-29eb-4c6d-a457-678f838aa998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.089263 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e15a04-29eb-4c6d-a457-678f838aa998 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.090060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e15a04-29eb-4c6d-a457-678f838aa998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:53.090420 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e15a04-29eb-4c6d-a457-678f838aa998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:53.092243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e15a04-29eb-4c6d-a457-678f838aa998 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:53.108357 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 211/425] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:53.115875 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a748e8-9404-453a-a8a4-b635324ae719 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:53.126807 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a748e8-9404-453a-a8a4-b635324ae719 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:53.132097 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47129880-3a0b-44fd-8006-84553f15b421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:53.132918 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47129880-3a0b-44fd-8006-84553f15b421 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.133196 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47129880-3a0b-44fd-8006-84553f15b421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.133466 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47129880-3a0b-44fd-8006-84553f15b421 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.142463 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47129880-3a0b-44fd-8006-84553f15b421 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:53.145068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47129880-3a0b-44fd-8006-84553f15b421 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:53.171167 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-47129880-3a0b-44fd-8006-84553f15b421 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 08 10:48:53.172459 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 215/426] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:48:53 2021] GET /identity/v3/users/neutron => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:53.179232 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e15a04-29eb-4c6d-a457-678f838aa998 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:53.189763 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e15a04-29eb-4c6d-a457-678f838aa998 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:53.203702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8efe8-99c9-4162-8c6d-647472286055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:53.204420 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8efe8-99c9-4162-8c6d-647472286055 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.204705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8efe8-99c9-4162-8c6d-647472286055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.204977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8efe8-99c9-4162-8c6d-647472286055 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.206032 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8efe8-99c9-4162-8c6d-647472286055 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:53.206329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8efe8-99c9-4162-8c6d-647472286055 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:53.208254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8efe8-99c9-4162-8c6d-647472286055 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:53.227423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 212/427] 10.222.0.20 () {56 vars in 1160 bytes} [Mon Nov 8 10:48:53 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:53.233790 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47129880-3a0b-44fd-8006-84553f15b421 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:53.244181 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47129880-3a0b-44fd-8006-84553f15b421 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:53.248915 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6bca5-34fa-4dfb-919a-eac285479bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:53.249565 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6bca5-34fa-4dfb-919a-eac285479bba admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.249848 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6bca5-34fa-4dfb-919a-eac285479bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.250119 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6bca5-34fa-4dfb-919a-eac285479bba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.259331 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6bca5-34fa-4dfb-919a-eac285479bba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:53.261252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6bca5-34fa-4dfb-919a-eac285479bba admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:53.271913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 216/428] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:53 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:53.280659 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8efe8-99c9-4162-8c6d-647472286055 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:53.301048 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8efe8-99c9-4162-8c6d-647472286055 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:53.307033 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b8965-a1ee-4414-999f-c8253c4febce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:53.307950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b8965-a1ee-4414-999f-c8253c4febce admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.308231 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b8965-a1ee-4414-999f-c8253c4febce admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.308558 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b8965-a1ee-4414-999f-c8253c4febce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.320222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b8965-a1ee-4414-999f-c8253c4febce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:53.322144 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b8965-a1ee-4414-999f-c8253c4febce admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:53.340017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-a40b8965-a1ee-4414-999f-c8253c4febce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:53.346607 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 213/429] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:53.348090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6bca5-34fa-4dfb-919a-eac285479bba admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:53.357219 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6bca5-34fa-4dfb-919a-eac285479bba admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:53.361773 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df295a8a-dadc-475e-96fd-c59d1f2744c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:53.362426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295a8a-dadc-475e-96fd-c59d1f2744c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.362707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295a8a-dadc-475e-96fd-c59d1f2744c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.363034 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295a8a-dadc-475e-96fd-c59d1f2744c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.363862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df295a8a-dadc-475e-96fd-c59d1f2744c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:53.364176 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df295a8a-dadc-475e-96fd-c59d1f2744c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:53.365760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df295a8a-dadc-475e-96fd-c59d1f2744c9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:53.383027 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 217/430] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:53.384467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b8965-a1ee-4414-999f-c8253c4febce admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:53.395201 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b8965-a1ee-4414-999f-c8253c4febce admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:53.399815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addc537-c7d4-4d49-bb10-e4aea9999c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:53.400653 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addc537-c7d4-4d49-bb10-e4aea9999c1a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.400939 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addc537-c7d4-4d49-bb10-e4aea9999c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.401216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addc537-c7d4-4d49-bb10-e4aea9999c1a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.409002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addc537-c7d4-4d49-bb10-e4aea9999c1a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:53.411116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addc537-c7d4-4d49-bb10-e4aea9999c1a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:53.424847 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-9addc537-c7d4-4d49-bb10-e4aea9999c1a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:48:53.431225 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 214/431] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:53.432628 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df295a8a-dadc-475e-96fd-c59d1f2744c9 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:53.445044 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df295a8a-dadc-475e-96fd-c59d1f2744c9 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:53.449623 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba20bd-cc2c-40cd-88d1-0018ef972fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:53.450337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba20bd-cc2c-40cd-88d1-0018ef972fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.450618 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba20bd-cc2c-40cd-88d1-0018ef972fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.450893 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba20bd-cc2c-40cd-88d1-0018ef972fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.451761 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba20bd-cc2c-40cd-88d1-0018ef972fd3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:53.452067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba20bd-cc2c-40cd-88d1-0018ef972fd3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:53.454019 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba20bd-cc2c-40cd-88d1-0018ef972fd3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:53.477292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 218/432] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:48:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:53.484585 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addc537-c7d4-4d49-bb10-e4aea9999c1a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:53.501359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addc537-c7d4-4d49-bb10-e4aea9999c1a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:53.519800 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef983b1-483c-46db-adbb-502b869681fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:53.520472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef983b1-483c-46db-adbb-502b869681fd admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.520766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef983b1-483c-46db-adbb-502b869681fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.521033 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef983b1-483c-46db-adbb-502b869681fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.521891 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef983b1-483c-46db-adbb-502b869681fd admin admin] RBAC: Adding query filter params (role.id=2ba23f9ef2de43a6bf86f97ccf919c68, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=0e134083351e4493b2a05bea95233f5c) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:53.522199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef983b1-483c-46db-adbb-502b869681fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:53.524116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef983b1-483c-46db-adbb-502b869681fd admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:53.532899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 215/433] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:53 2021] GET /identity/v3/role_assignments?user.id=0e134083351e4493b2a05bea95233f5c&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=2ba23f9ef2de43a6bf86f97ccf919c68 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:53.762671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c54daa-f57e-45a3-820f-b6ad8f932295 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.763074 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c54daa-f57e-45a3-820f-b6ad8f932295 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.763276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c54daa-f57e-45a3-820f-b6ad8f932295 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.765271 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 219/434] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:53.772416 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60061fc0-f86c-4060-9b1b-b83e1ce454c9 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.772707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60061fc0-f86c-4060-9b1b-b83e1ce454c9 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.772984 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60061fc0-f86c-4060-9b1b-b83e1ce454c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.791882 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-60061fc0-f86c-4060-9b1b-b83e1ce454c9 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:53.793134 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-60061fc0-f86c-4060-9b1b-b83e1ce454c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:53.801829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 216/435] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:53.828302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c54daa-f57e-45a3-820f-b6ad8f932295 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:53.845258 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c54daa-f57e-45a3-820f-b6ad8f932295 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:53.850332 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc349-ce44-4d2b-a76c-93f71263f276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:53.851257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc349-ce44-4d2b-a76c-93f71263f276 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.851538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc349-ce44-4d2b-a76c-93f71263f276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.851862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc349-ce44-4d2b-a76c-93f71263f276 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.867728 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc349-ce44-4d2b-a76c-93f71263f276 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:53.869657 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc349-ce44-4d2b-a76c-93f71263f276 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:53.894991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-d5dcc349-ce44-4d2b-a76c-93f71263f276 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:53.896700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 220/436] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:53.903351 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60061fc0-f86c-4060-9b1b-b83e1ce454c9 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:53.912953 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60061fc0-f86c-4060-9b1b-b83e1ce454c9 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:53.917482 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ab6e3-55bb-47ad-a6de-0d135412c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:53.918158 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ab6e3-55bb-47ad-a6de-0d135412c5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.918438 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ab6e3-55bb-47ad-a6de-0d135412c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.918712 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ab6e3-55bb-47ad-a6de-0d135412c5c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.919497 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ab6e3-55bb-47ad-a6de-0d135412c5c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:53.919804 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ab6e3-55bb-47ad-a6de-0d135412c5c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:53.921451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ab6e3-55bb-47ad-a6de-0d135412c5c4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:53.934491 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 217/437] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:53.941316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc349-ce44-4d2b-a76c-93f71263f276 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:53.951458 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc349-ce44-4d2b-a76c-93f71263f276 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:53.957092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a3e77-1912-4a92-94b1-148e48465c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:53.957326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a3e77-1912-4a92-94b1-148e48465c79 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:53.957497 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a3e77-1912-4a92-94b1-148e48465c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:53.957722 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a3e77-1912-4a92-94b1-148e48465c79 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:53.958514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a3e77-1912-4a92-94b1-148e48465c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:53.960544 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a3e77-1912-4a92-94b1-148e48465c79 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:53.985329 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 221/438] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Nov 8 10:48:53 2021] POST /identity/v3/users => generated 247 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:48:55.554904 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7548d-e16a-47ca-8112-4e516d964d45 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:55.555447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7548d-e16a-47ca-8112-4e516d964d45 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:55.555522 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7548d-e16a-47ca-8112-4e516d964d45 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:55.557578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 218/439] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:55.563760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2111fe3-7d1b-4e41-b39b-40d796c673c1 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:55.564157 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2111fe3-7d1b-4e41-b39b-40d796c673c1 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:55.564337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2111fe3-7d1b-4e41-b39b-40d796c673c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:55.597179 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-c2111fe3-7d1b-4e41-b39b-40d796c673c1 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:55.598395 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c2111fe3-7d1b-4e41-b39b-40d796c673c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:55.615101 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 222/440] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:55.651942 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7548d-e16a-47ca-8112-4e516d964d45 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:55.676701 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7548d-e16a-47ca-8112-4e516d964d45 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:55.687280 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c7814-16f9-4768-983f-e59f4ee0e69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:55.688309 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c7814-16f9-4768-983f-e59f4ee0e69d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:55.688907 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c7814-16f9-4768-983f-e59f4ee0e69d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:55.689377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c7814-16f9-4768-983f-e59f4ee0e69d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:55.716252 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c7814-16f9-4768-983f-e59f4ee0e69d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:55.723811 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-879c7814-16f9-4768-983f-e59f4ee0e69d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:48:55.725626 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 219/441] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:48:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:55.733168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2111fe3-7d1b-4e41-b39b-40d796c673c1 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:55.751187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2111fe3-7d1b-4e41-b39b-40d796c673c1 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:55.759034 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512533c7-96b1-40e7-ad85-bf8cd5f2f5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:55.759767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512533c7-96b1-40e7-ad85-bf8cd5f2f5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:55.760048 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512533c7-96b1-40e7-ad85-bf8cd5f2f5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:55.760331 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512533c7-96b1-40e7-ad85-bf8cd5f2f5e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:55.761098 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512533c7-96b1-40e7-ad85-bf8cd5f2f5e7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:55.761401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512533c7-96b1-40e7-ad85-bf8cd5f2f5e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:55.763059 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512533c7-96b1-40e7-ad85-bf8cd5f2f5e7 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:55.775774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 223/442] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:48:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:55.781729 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c7814-16f9-4768-983f-e59f4ee0e69d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:55.793168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d218be7-89b5-4bc9-8a7b-79de27d01da0 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:55.793605 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d218be7-89b5-4bc9-8a7b-79de27d01da0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:55.794026 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d218be7-89b5-4bc9-8a7b-79de27d01da0 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:55.795963 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c7814-16f9-4768-983f-e59f4ee0e69d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:55.796183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 224/443] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:48:55.805168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc0bb4-bcaf-48ab-9faa-ab961079e838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:55.805316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd7882-d136-4124-96b7-4132a66ad2bc None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:55.805586 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd7882-d136-4124-96b7-4132a66ad2bc None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:55.805797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd7882-d136-4124-96b7-4132a66ad2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:55.805977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc0bb4-bcaf-48ab-9faa-ab961079e838 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:55.806227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc0bb4-bcaf-48ab-9faa-ab961079e838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:55.806502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc0bb4-bcaf-48ab-9faa-ab961079e838 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:55.822925 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc0bb4-bcaf-48ab-9faa-ab961079e838 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:55.825862 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc0bb4-bcaf-48ab-9faa-ab961079e838 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:55.830458 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-d7bd7882-d136-4124-96b7-4132a66ad2bc None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:55.831685 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d7bd7882-d136-4124-96b7-4132a66ad2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:55.848248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 225/444] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:55.856748 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-41fc0bb4-bcaf-48ab-9faa-ab961079e838 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:55.858271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 220/445] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:55.864576 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd7882-d136-4124-96b7-4132a66ad2bc None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:55.872555 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc0bb4-bcaf-48ab-9faa-ab961079e838 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:55.875630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd7882-d136-4124-96b7-4132a66ad2bc None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:55.881173 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2283915-7f63-497a-b0f1-1bcfef9f1880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:55.881847 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2283915-7f63-497a-b0f1-1bcfef9f1880 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:55.882131 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2283915-7f63-497a-b0f1-1bcfef9f1880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:55.882406 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2283915-7f63-497a-b0f1-1bcfef9f1880 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:55.883171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2283915-7f63-497a-b0f1-1bcfef9f1880 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:55.883486 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2283915-7f63-497a-b0f1-1bcfef9f1880 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:55.885415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2283915-7f63-497a-b0f1-1bcfef9f1880 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:55.889715 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc0bb4-bcaf-48ab-9faa-ab961079e838 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:55.898601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 226/446] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:55.901197 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157adf15-3d17-4a15-aa08-d280783966a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:55.902011 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157adf15-3d17-4a15-aa08-d280783966a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:55.902291 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157adf15-3d17-4a15-aa08-d280783966a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:55.902565 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157adf15-3d17-4a15-aa08-d280783966a6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:55.904314 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2283915-7f63-497a-b0f1-1bcfef9f1880 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:55.915436 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2283915-7f63-497a-b0f1-1bcfef9f1880 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:55.920194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4695cc-e33c-4e4c-b98b-4572f070b79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:55.920320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157adf15-3d17-4a15-aa08-d280783966a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:55.921344 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4695cc-e33c-4e4c-b98b-4572f070b79b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:55.921826 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4695cc-e33c-4e4c-b98b-4572f070b79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:55.922306 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4695cc-e33c-4e4c-b98b-4572f070b79b admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:55.927473 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-157adf15-3d17-4a15-aa08-d280783966a6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:48:55.928993 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 221/447] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:48:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:55.930315 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de8747-4945-40d3-a285-24a050b7ee87 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:55.930598 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de8747-4945-40d3-a285-24a050b7ee87 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:55.930874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de8747-4945-40d3-a285-24a050b7ee87 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:55.931733 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4695cc-e33c-4e4c-b98b-4572f070b79b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:55.932553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 222/448] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:55.934263 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4695cc-e33c-4e4c-b98b-4572f070b79b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:55.937950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de8747-4945-40d3-a285-24a050b7ee87 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:55.949663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-8b4695cc-e33c-4e4c-b98b-4572f070b79b admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 08 10:48:55.950954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de8747-4945-40d3-a285-24a050b7ee87 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:55.951378 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 227/449] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:55 2021] GET /identity/v3/users/glance => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:55.952713 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ff068-b7f4-4be9-83db-24dbc48ad70f None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:55.953002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ff068-b7f4-4be9-83db-24dbc48ad70f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:55.953498 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ff068-b7f4-4be9-83db-24dbc48ad70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:55.971229 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614b571-fb16-4590-9fe2-5d85625663cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:55.971229 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614b571-fb16-4590-9fe2-5d85625663cb admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:55.971229 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614b571-fb16-4590-9fe2-5d85625663cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:55.971229 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614b571-fb16-4590-9fe2-5d85625663cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:55.971609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614b571-fb16-4590-9fe2-5d85625663cb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:55.971609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614b571-fb16-4590-9fe2-5d85625663cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:55.971726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-0c1ff068-b7f4-4be9-83db-24dbc48ad70f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:55.971804 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614b571-fb16-4590-9fe2-5d85625663cb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:55.972277 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0c1ff068-b7f4-4be9-83db-24dbc48ad70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:55.980466 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 228/450] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:55.981322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ff068-b7f4-4be9-83db-24dbc48ad70f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:55.981563 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 223/451] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:48:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:55.987521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614b571-fb16-4590-9fe2-5d85625663cb admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:55.992398 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ff068-b7f4-4be9-83db-24dbc48ad70f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:55.997022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6721033-932d-44ab-8bb8-e86e0f5f04a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:55.997684 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721033-932d-44ab-8bb8-e86e0f5f04a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:55.998021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721033-932d-44ab-8bb8-e86e0f5f04a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:55.998387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721033-932d-44ab-8bb8-e86e0f5f04a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:55.999283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6721033-932d-44ab-8bb8-e86e0f5f04a8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:55.999598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6721033-932d-44ab-8bb8-e86e0f5f04a8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.001573 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6721033-932d-44ab-8bb8-e86e0f5f04a8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.015645 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614b571-fb16-4590-9fe2-5d85625663cb admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.021049 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 229/452] 10.222.0.20 () {56 vars in 1158 bytes} [Mon Nov 8 10:48:55 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:56.022197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6721033-932d-44ab-8bb8-e86e0f5f04a8 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.023178 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82a2cc-8ec8-42e0-bdc9-36137e1da28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.024154 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82a2cc-8ec8-42e0-bdc9-36137e1da28e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.024582 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82a2cc-8ec8-42e0-bdc9-36137e1da28e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.025056 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82a2cc-8ec8-42e0-bdc9-36137e1da28e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.032875 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6721033-932d-44ab-8bb8-e86e0f5f04a8 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.037612 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82a2cc-8ec8-42e0-bdc9-36137e1da28e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.038685 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60fc6a-c208-4ade-8315-0d5af2af7c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.039679 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60fc6a-c208-4ade-8315-0d5af2af7c23 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.040039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60fc6a-c208-4ade-8315-0d5af2af7c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.040206 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82a2cc-8ec8-42e0-bdc9-36137e1da28e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.040451 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60fc6a-c208-4ade-8315-0d5af2af7c23 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.052601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60fc6a-c208-4ade-8315-0d5af2af7c23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:56.058073 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-eb82a2cc-8ec8-42e0-bdc9-36137e1da28e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:56.059964 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 224/453] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:56.060978 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82a2cc-8ec8-42e0-bdc9-36137e1da28e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.062585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-cd60fc6a-c208-4ade-8315-0d5af2af7c23 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:48:56.069916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 230/454] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:56.069916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60fc6a-c208-4ade-8315-0d5af2af7c23 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.077948 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82a2cc-8ec8-42e0-bdc9-36137e1da28e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.082907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60fc6a-c208-4ade-8315-0d5af2af7c23 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.084022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aea97-064f-48c2-ad3a-71adb0fe8263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.084829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aea97-064f-48c2-ad3a-71adb0fe8263 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.085144 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aea97-064f-48c2-ad3a-71adb0fe8263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.085384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aea97-064f-48c2-ad3a-71adb0fe8263 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.089490 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3ddc7-3325-4a92-94ab-a53e8701ffc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.090491 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3ddc7-3325-4a92-94ab-a53e8701ffc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.090968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3ddc7-3325-4a92-94ab-a53e8701ffc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.091512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3ddc7-3325-4a92-94ab-a53e8701ffc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.092992 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3ddc7-3325-4a92-94ab-a53e8701ffc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:56.093580 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3ddc7-3325-4a92-94ab-a53e8701ffc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.096121 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aea97-064f-48c2-ad3a-71adb0fe8263 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.096662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3ddc7-3325-4a92-94ab-a53e8701ffc0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.097977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aea97-064f-48c2-ad3a-71adb0fe8263 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.111577 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 231/455] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:56.113063 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3ddc7-3325-4a92-94ab-a53e8701ffc0 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.120467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-3e8aea97-064f-48c2-ad3a-71adb0fe8263 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:56.122541 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 225/456] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:56.123502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aea97-064f-48c2-ad3a-71adb0fe8263 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.124839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3ddc7-3325-4a92-94ab-a53e8701ffc0 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.131617 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835ab83-94d4-45fb-bf54-9e233947d218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.132843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835ab83-94d4-45fb-bf54-9e233947d218 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.133356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835ab83-94d4-45fb-bf54-9e233947d218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.133883 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835ab83-94d4-45fb-bf54-9e233947d218 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.134726 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aea97-064f-48c2-ad3a-71adb0fe8263 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.135088 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835ab83-94d4-45fb-bf54-9e233947d218 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:56.135648 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835ab83-94d4-45fb-bf54-9e233947d218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.137982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835ab83-94d4-45fb-bf54-9e233947d218 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.140273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234837ad-3d36-43dd-a7dd-4d16c79ba23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.141503 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234837ad-3d36-43dd-a7dd-4d16c79ba23b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.142224 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234837ad-3d36-43dd-a7dd-4d16c79ba23b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.142571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234837ad-3d36-43dd-a7dd-4d16c79ba23b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.149011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 232/457] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:56.150423 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835ab83-94d4-45fb-bf54-9e233947d218 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.150954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234837ad-3d36-43dd-a7dd-4d16c79ba23b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.153119 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234837ad-3d36-43dd-a7dd-4d16c79ba23b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.161953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835ab83-94d4-45fb-bf54-9e233947d218 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.167236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb654ca-5cd9-4741-bf79-18ac58fc7008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.168214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb654ca-5cd9-4741-bf79-18ac58fc7008 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.168690 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb654ca-5cd9-4741-bf79-18ac58fc7008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.169135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb654ca-5cd9-4741-bf79-18ac58fc7008 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.170050 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb654ca-5cd9-4741-bf79-18ac58fc7008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:56.170525 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb654ca-5cd9-4741-bf79-18ac58fc7008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.172347 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb654ca-5cd9-4741-bf79-18ac58fc7008 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.172561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-234837ad-3d36-43dd-a7dd-4d16c79ba23b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 08 10:48:56.174085 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 226/458] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:56.175419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234837ad-3d36-43dd-a7dd-4d16c79ba23b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.188389 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234837ad-3d36-43dd-a7dd-4d16c79ba23b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.189241 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 233/459] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:56.191093 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb654ca-5cd9-4741-bf79-18ac58fc7008 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.193382 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc15c4-7410-4180-b6c0-29afd0fb92d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.194261 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc15c4-7410-4180-b6c0-29afd0fb92d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.194734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc15c4-7410-4180-b6c0-29afd0fb92d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.194883 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc15c4-7410-4180-b6c0-29afd0fb92d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.203382 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb654ca-5cd9-4741-bf79-18ac58fc7008 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.207894 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc15c4-7410-4180-b6c0-29afd0fb92d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.209813 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef7d14-a50e-4406-ad74-ab28115e0afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.210208 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc15c4-7410-4180-b6c0-29afd0fb92d8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.211065 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef7d14-a50e-4406-ad74-ab28115e0afd admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.211551 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef7d14-a50e-4406-ad74-ab28115e0afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.211996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef7d14-a50e-4406-ad74-ab28115e0afd admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.213475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef7d14-a50e-4406-ad74-ab28115e0afd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:56.213963 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef7d14-a50e-4406-ad74-ab28115e0afd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.216054 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef7d14-a50e-4406-ad74-ab28115e0afd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.231035 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-5ccc15c4-7410-4180-b6c0-29afd0fb92d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:56.232924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 227/460] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:56.233721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc15c4-7410-4180-b6c0-29afd0fb92d8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.236033 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 234/461] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:56.239679 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef7d14-a50e-4406-ad74-ab28115e0afd admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.244437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc15c4-7410-4180-b6c0-29afd0fb92d8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.251417 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef7d14-a50e-4406-ad74-ab28115e0afd admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.252467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b925383-7513-41fa-ab22-a733a3017b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.253400 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b925383-7513-41fa-ab22-a733a3017b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.253771 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b925383-7513-41fa-ab22-a733a3017b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.254113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b925383-7513-41fa-ab22-a733a3017b1b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.257892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939040b-0e92-4daa-980b-d80649aac162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.258747 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939040b-0e92-4daa-980b-d80649aac162 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.259303 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939040b-0e92-4daa-980b-d80649aac162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.259765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939040b-0e92-4daa-980b-d80649aac162 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.260674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939040b-0e92-4daa-980b-d80649aac162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:56.261150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939040b-0e92-4daa-980b-d80649aac162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.262649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b925383-7513-41fa-ab22-a733a3017b1b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.263471 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939040b-0e92-4daa-980b-d80649aac162 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.264919 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b925383-7513-41fa-ab22-a733a3017b1b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.277851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 235/462] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:56.279077 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939040b-0e92-4daa-980b-d80649aac162 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.281040 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-1b925383-7513-41fa-ab22-a733a3017b1b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:48:56.282611 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 228/463] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:56.283635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b925383-7513-41fa-ab22-a733a3017b1b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.290763 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939040b-0e92-4daa-980b-d80649aac162 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.296097 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b925383-7513-41fa-ab22-a733a3017b1b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.296517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b01a3-3839-4f60-93d8-e423fadb28ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.297607 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b01a3-3839-4f60-93d8-e423fadb28ec admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.298186 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b01a3-3839-4f60-93d8-e423fadb28ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.298720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b01a3-3839-4f60-93d8-e423fadb28ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.301661 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44be52-1aa8-4332-9a3e-dee6a2b9dfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.303017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44be52-1aa8-4332-9a3e-dee6a2b9dfda admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.303402 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44be52-1aa8-4332-9a3e-dee6a2b9dfda admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.303753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44be52-1aa8-4332-9a3e-dee6a2b9dfda admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.311926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b01a3-3839-4f60-93d8-e423fadb28ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.313280 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44be52-1aa8-4332-9a3e-dee6a2b9dfda admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.314493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b01a3-3839-4f60-93d8-e423fadb28ec admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.316266 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44be52-1aa8-4332-9a3e-dee6a2b9dfda admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.332405 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-8a44be52-1aa8-4332-9a3e-dee6a2b9dfda admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 08 10:48:56.333294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-b25b01a3-3839-4f60-93d8-e423fadb28ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:56.334030 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 229/464] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:56.334695 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44be52-1aa8-4332-9a3e-dee6a2b9dfda admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.335587 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 236/465] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:56.340909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b01a3-3839-4f60-93d8-e423fadb28ec admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.345634 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44be52-1aa8-4332-9a3e-dee6a2b9dfda admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.352142 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9b6f4-7eba-4587-8021-35a90ad0492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.352887 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9b6f4-7eba-4587-8021-35a90ad0492d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.353232 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9b6f4-7eba-4587-8021-35a90ad0492d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.353623 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9b6f4-7eba-4587-8021-35a90ad0492d admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.354044 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b01a3-3839-4f60-93d8-e423fadb28ec admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.354591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9b6f4-7eba-4587-8021-35a90ad0492d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:56.354965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9b6f4-7eba-4587-8021-35a90ad0492d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.357235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9b6f4-7eba-4587-8021-35a90ad0492d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.359878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec2a02-a7a0-4079-b5cf-f388e2fd0096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.361212 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec2a02-a7a0-4079-b5cf-f388e2fd0096 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.361829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec2a02-a7a0-4079-b5cf-f388e2fd0096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.362274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec2a02-a7a0-4079-b5cf-f388e2fd0096 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.363466 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec2a02-a7a0-4079-b5cf-f388e2fd0096 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:56.363968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec2a02-a7a0-4079-b5cf-f388e2fd0096 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.366603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec2a02-a7a0-4079-b5cf-f388e2fd0096 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.372082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 230/466] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:56.373149 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9b6f4-7eba-4587-8021-35a90ad0492d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.385969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9b6f4-7eba-4587-8021-35a90ad0492d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.388533 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 237/467] 10.222.0.20 () {56 vars in 1158 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:56.389687 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec2a02-a7a0-4079-b5cf-f388e2fd0096 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.390885 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16762a1-3d7c-4176-ab69-fbb09075ea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.392129 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16762a1-3d7c-4176-ab69-fbb09075ea43 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.392467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16762a1-3d7c-4176-ab69-fbb09075ea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.393234 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16762a1-3d7c-4176-ab69-fbb09075ea43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.394063 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16762a1-3d7c-4176-ab69-fbb09075ea43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:56.394378 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16762a1-3d7c-4176-ab69-fbb09075ea43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.396303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16762a1-3d7c-4176-ab69-fbb09075ea43 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.402228 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec2a02-a7a0-4079-b5cf-f388e2fd0096 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.408467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea497d-11a5-4b01-aaff-939364cd1c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.409715 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea497d-11a5-4b01-aaff-939364cd1c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.410194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 231/468] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:56.410698 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea497d-11a5-4b01-aaff-939364cd1c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.410801 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16762a1-3d7c-4176-ab69-fbb09075ea43 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.411387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea497d-11a5-4b01-aaff-939364cd1c1f admin admin] PATH_INFO: `/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/07a71b8adef243049d3b055e66566a63/roles/2ba23f9ef2de43a6bf86f97ccf919c68` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.425422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16762a1-3d7c-4176-ab69-fbb09075ea43 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.430383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea497d-11a5-4b01-aaff-939364cd1c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ae5e80b1f745dfaedd81a2c0ded718, user_id=07a71b8adef243049d3b055e66566a63, role_id=2ba23f9ef2de43a6bf86f97ccf919c68)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.430741 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16fdbf-5154-4a23-bb5c-3902d381d0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.431557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16fdbf-5154-4a23-bb5c-3902d381d0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.431845 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16fdbf-5154-4a23-bb5c-3902d381d0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.432124 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16fdbf-5154-4a23-bb5c-3902d381d0b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.435256 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea497d-11a5-4b01-aaff-939364cd1c1f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.444805 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16fdbf-5154-4a23-bb5c-3902d381d0b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.447259 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16fdbf-5154-4a23-bb5c-3902d381d0b3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.451571 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 238/469] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:48:56 2021] PUT /identity/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/07a71b8adef243049d3b055e66566a63/roles/2ba23f9ef2de43a6bf86f97ccf919c68 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:48:56.452836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea497d-11a5-4b01-aaff-939364cd1c1f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.473754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-4b16fdbf-5154-4a23-bb5c-3902d381d0b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:56.479389 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 232/470] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:56.489006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16fdbf-5154-4a23-bb5c-3902d381d0b3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.513460 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16fdbf-5154-4a23-bb5c-3902d381d0b3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.535660 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea497d-11a5-4b01-aaff-939364cd1c1f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.541679 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cd963-b592-434e-bf2d-d75345e2f8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.542886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cd963-b592-434e-bf2d-d75345e2f8bc admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.543384 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cd963-b592-434e-bf2d-d75345e2f8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.543804 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cd963-b592-434e-bf2d-d75345e2f8bc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.553091 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952cd963-b592-434e-bf2d-d75345e2f8bc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.555627 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952cd963-b592-434e-bf2d-d75345e2f8bc admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.570991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-952cd963-b592-434e-bf2d-d75345e2f8bc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:48:56.573547 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 239/471] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:56.581795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cd963-b592-434e-bf2d-d75345e2f8bc admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.598319 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cd963-b592-434e-bf2d-d75345e2f8bc admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.607343 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b393413-c9e5-4eaa-bbee-145866cb9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.612138 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b393413-c9e5-4eaa-bbee-145866cb9d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.612685 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b393413-c9e5-4eaa-bbee-145866cb9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.613327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b393413-c9e5-4eaa-bbee-145866cb9d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.615299 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b393413-c9e5-4eaa-bbee-145866cb9d24 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:56.615809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b393413-c9e5-4eaa-bbee-145866cb9d24 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.618487 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b393413-c9e5-4eaa-bbee-145866cb9d24 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.645840 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 240/472] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:56.650536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b393413-c9e5-4eaa-bbee-145866cb9d24 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.658472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f728d-88cf-4217-a5ec-3121caf72261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.660116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f728d-88cf-4217-a5ec-3121caf72261 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.660575 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f728d-88cf-4217-a5ec-3121caf72261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.661008 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f728d-88cf-4217-a5ec-3121caf72261 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.661967 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f728d-88cf-4217-a5ec-3121caf72261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:56.662417 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f728d-88cf-4217-a5ec-3121caf72261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.664305 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f728d-88cf-4217-a5ec-3121caf72261 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.673759 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b393413-c9e5-4eaa-bbee-145866cb9d24 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.679485 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 233/473] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:56.685489 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f728d-88cf-4217-a5ec-3121caf72261 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.687659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14c68a-b428-4bf4-ad16-be32de860fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.690423 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14c68a-b428-4bf4-ad16-be32de860fda admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.691577 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14c68a-b428-4bf4-ad16-be32de860fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.693306 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14c68a-b428-4bf4-ad16-be32de860fda admin admin] PATH_INFO: `/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/d3421cf1bbb24423a2f24c4667adfdda/roles/2ba23f9ef2de43a6bf86f97ccf919c68` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.706970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f728d-88cf-4217-a5ec-3121caf72261 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.718521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb6936-100b-4f19-952d-550947a08d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.718993 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb6936-100b-4f19-952d-550947a08d1e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.719341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb6936-100b-4f19-952d-550947a08d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.719613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb6936-100b-4f19-952d-550947a08d1e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.721370 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14c68a-b428-4bf4-ad16-be32de860fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ae5e80b1f745dfaedd81a2c0ded718, user_id=d3421cf1bbb24423a2f24c4667adfdda, role_id=2ba23f9ef2de43a6bf86f97ccf919c68)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.724263 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14c68a-b428-4bf4-ad16-be32de860fda admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.727259 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb6936-100b-4f19-952d-550947a08d1e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.729267 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb6936-100b-4f19-952d-550947a08d1e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.742490 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 241/474] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:48:56 2021] PUT /identity/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/d3421cf1bbb24423a2f24c4667adfdda/roles/2ba23f9ef2de43a6bf86f97ccf919c68 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:48:56.743998 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-67eb6936-100b-4f19-952d-550947a08d1e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:48:56.744371 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040634e4-5bc8-4808-a053-58ebfc675d69 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.744806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040634e4-5bc8-4808-a053-58ebfc675d69 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.745236 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 234/475] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:56.745420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040634e4-5bc8-4808-a053-58ebfc675d69 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.747604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 242/476] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:56.752883 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb6936-100b-4f19-952d-550947a08d1e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.758836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf8bd9-10fd-444a-ac99-924a719100eb None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.759459 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf8bd9-10fd-444a-ac99-924a719100eb None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.759924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf8bd9-10fd-444a-ac99-924a719100eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.769335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb6936-100b-4f19-952d-550947a08d1e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.781405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-8daf8bd9-10fd-444a-ac99-924a719100eb None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:56.782910 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8daf8bd9-10fd-444a-ac99-924a719100eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:56.848832 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 243/477] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:56.894975 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf8bd9-10fd-444a-ac99-924a719100eb None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.898988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87855871-84f0-49fb-b36c-ddc63393615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.899936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87855871-84f0-49fb-b36c-ddc63393615c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.900463 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87855871-84f0-49fb-b36c-ddc63393615c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.900690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87855871-84f0-49fb-b36c-ddc63393615c admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.901627 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87855871-84f0-49fb-b36c-ddc63393615c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:56.902565 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87855871-84f0-49fb-b36c-ddc63393615c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.909657 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87855871-84f0-49fb-b36c-ddc63393615c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:56.915910 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf8bd9-10fd-444a-ac99-924a719100eb None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.920851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1d4b9-ca4e-48dc-8610-ebc1ef453531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.921879 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1d4b9-ca4e-48dc-8610-ebc1ef453531 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.922259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1d4b9-ca4e-48dc-8610-ebc1ef453531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.922632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1d4b9-ca4e-48dc-8610-ebc1ef453531 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.926489 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 235/478] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:56.934243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87855871-84f0-49fb-b36c-ddc63393615c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.935979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1d4b9-ca4e-48dc-8610-ebc1ef453531 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:56.950113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-9ed1d4b9-ca4e-48dc-8610-ebc1ef453531 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:48:56.952669 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 244/479] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:56.961238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87855871-84f0-49fb-b36c-ddc63393615c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.963104 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1d4b9-ca4e-48dc-8610-ebc1ef453531 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:56.975095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a3e19-9696-4bc0-affc-ad22dd0ffe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.977235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a3e19-9696-4bc0-affc-ad22dd0ffe36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.977681 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a3e19-9696-4bc0-affc-ad22dd0ffe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.978102 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a3e19-9696-4bc0-affc-ad22dd0ffe36 admin admin] PATH_INFO: `/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/4b0a2df68bfc41ada3b2135fc2e1930f/roles/2ba23f9ef2de43a6bf86f97ccf919c68` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.983431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1d4b9-ca4e-48dc-8610-ebc1ef453531 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:56.991011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d972ed-2b69-4222-b6f4-786d69dd05b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:56.991913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d972ed-2b69-4222-b6f4-786d69dd05b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:56.992327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d972ed-2b69-4222-b6f4-786d69dd05b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:56.992822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d972ed-2b69-4222-b6f4-786d69dd05b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:56.993749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d972ed-2b69-4222-b6f4-786d69dd05b5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:56.994202 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d972ed-2b69-4222-b6f4-786d69dd05b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:56.996637 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d972ed-2b69-4222-b6f4-786d69dd05b5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.000581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a3e19-9696-4bc0-affc-ad22dd0ffe36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ae5e80b1f745dfaedd81a2c0ded718, user_id=4b0a2df68bfc41ada3b2135fc2e1930f, role_id=2ba23f9ef2de43a6bf86f97ccf919c68)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.004736 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a3e19-9696-4bc0-affc-ad22dd0ffe36 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.009856 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 245/480] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:48:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:57.017896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d972ed-2b69-4222-b6f4-786d69dd05b5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.029072 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 236/481] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:48:56 2021] PUT /identity/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/4b0a2df68bfc41ada3b2135fc2e1930f/roles/2ba23f9ef2de43a6bf86f97ccf919c68 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 10:48:57.030360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d972ed-2b69-4222-b6f4-786d69dd05b5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.096654 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db6464-4cfe-4da9-a708-75723387bec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.097909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db6464-4cfe-4da9-a708-75723387bec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.098399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db6464-4cfe-4da9-a708-75723387bec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.098841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db6464-4cfe-4da9-a708-75723387bec3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.111053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db6464-4cfe-4da9-a708-75723387bec3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.113984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db6464-4cfe-4da9-a708-75723387bec3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.133443 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-d2db6464-4cfe-4da9-a708-75723387bec3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:57.135515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 246/482] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:57.142517 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a3e19-9696-4bc0-affc-ad22dd0ffe36 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.156663 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a3e19-9696-4bc0-affc-ad22dd0ffe36 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.162374 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57023dc-9e97-4a6b-b429-58a53f6410d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.163386 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57023dc-9e97-4a6b-b429-58a53f6410d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.163863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57023dc-9e97-4a6b-b429-58a53f6410d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.164339 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57023dc-9e97-4a6b-b429-58a53f6410d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.165312 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57023dc-9e97-4a6b-b429-58a53f6410d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:57.165804 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57023dc-9e97-4a6b-b429-58a53f6410d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.167680 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57023dc-9e97-4a6b-b429-58a53f6410d5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.185659 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 237/483] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:57.192927 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db6464-4cfe-4da9-a708-75723387bec3 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.208866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db6464-4cfe-4da9-a708-75723387bec3 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.213925 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e9f9f-e563-4c64-9831-c3852648f859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.215030 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e9f9f-e563-4c64-9831-c3852648f859 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.215576 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e9f9f-e563-4c64-9831-c3852648f859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.216023 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e9f9f-e563-4c64-9831-c3852648f859 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.229844 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e9f9f-e563-4c64-9831-c3852648f859 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.232494 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e9f9f-e563-4c64-9831-c3852648f859 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.253785 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-5b8e9f9f-e563-4c64-9831-c3852648f859 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 08 10:48:57.255797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 247/484] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:48:57 2021] GET /identity/v3/users/neutron => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:57.262514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57023dc-9e97-4a6b-b429-58a53f6410d5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.274019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57023dc-9e97-4a6b-b429-58a53f6410d5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.278999 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235086e-d3cf-4e80-9af0-1ac3351fbd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.280029 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235086e-d3cf-4e80-9af0-1ac3351fbd36 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.280499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235086e-d3cf-4e80-9af0-1ac3351fbd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.281009 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235086e-d3cf-4e80-9af0-1ac3351fbd36 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.282060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235086e-d3cf-4e80-9af0-1ac3351fbd36 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:57.282579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235086e-d3cf-4e80-9af0-1ac3351fbd36 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.285451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235086e-d3cf-4e80-9af0-1ac3351fbd36 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.311224 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 238/485] 10.222.0.20 () {56 vars in 1160 bytes} [Mon Nov 8 10:48:57 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:57.313838 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e9f9f-e563-4c64-9831-c3852648f859 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.325348 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e9f9f-e563-4c64-9831-c3852648f859 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.330511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efd1f0-d76f-45a0-ba43-0e7c3306ab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.331947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efd1f0-d76f-45a0-ba43-0e7c3306ab2b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.332333 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efd1f0-d76f-45a0-ba43-0e7c3306ab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.332679 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efd1f0-d76f-45a0-ba43-0e7c3306ab2b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.343762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efd1f0-d76f-45a0-ba43-0e7c3306ab2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.345861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efd1f0-d76f-45a0-ba43-0e7c3306ab2b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.365820 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-d4efd1f0-d76f-45a0-ba43-0e7c3306ab2b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:57.367435 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 248/486] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:57.373602 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235086e-d3cf-4e80-9af0-1ac3351fbd36 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.384520 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235086e-d3cf-4e80-9af0-1ac3351fbd36 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.389235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaccbd-7b13-4b86-b94f-2906a56b741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.390038 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaccbd-7b13-4b86-b94f-2906a56b741e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.390384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaccbd-7b13-4b86-b94f-2906a56b741e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.390758 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaccbd-7b13-4b86-b94f-2906a56b741e admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.392103 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaccbd-7b13-4b86-b94f-2906a56b741e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:57.392479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaccbd-7b13-4b86-b94f-2906a56b741e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.394662 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaccbd-7b13-4b86-b94f-2906a56b741e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.407731 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 239/487] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:57.414204 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efd1f0-d76f-45a0-ba43-0e7c3306ab2b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.424837 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efd1f0-d76f-45a0-ba43-0e7c3306ab2b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.429746 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccd68f-361a-464f-a704-97caef27d811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.430662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd68f-361a-464f-a704-97caef27d811 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.431017 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd68f-361a-464f-a704-97caef27d811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.431383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccd68f-361a-464f-a704-97caef27d811 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.438978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccd68f-361a-464f-a704-97caef27d811 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.441620 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccd68f-361a-464f-a704-97caef27d811 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.454911 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-12ccd68f-361a-464f-a704-97caef27d811 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:48:57.456711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 249/488] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:57.464324 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaccbd-7b13-4b86-b94f-2906a56b741e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.490519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaccbd-7b13-4b86-b94f-2906a56b741e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.497732 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e16374-4fdb-46c2-86c2-5769f287fb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.498408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e16374-4fdb-46c2-86c2-5769f287fb42 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.498736 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e16374-4fdb-46c2-86c2-5769f287fb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.499013 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e16374-4fdb-46c2-86c2-5769f287fb42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.499959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e16374-4fdb-46c2-86c2-5769f287fb42 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:57.500269 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e16374-4fdb-46c2-86c2-5769f287fb42 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.503941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed5e9c-4cbd-4524-895b-48a46e32bcb6 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.504169 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed5e9c-4cbd-4524-895b-48a46e32bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.504614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed5e9c-4cbd-4524-895b-48a46e32bcb6 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.507614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 250/489] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:57.508376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e16374-4fdb-46c2-86c2-5769f287fb42 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.513170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8a01d-8496-4990-802f-62e25c65887f None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.513457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8a01d-8496-4990-802f-62e25c65887f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.513727 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8a01d-8496-4990-802f-62e25c65887f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.538685 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 240/490] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:48:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:57.546277 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e16374-4fdb-46c2-86c2-5769f287fb42 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.555506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-35e8a01d-8496-4990-802f-62e25c65887f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:57.556695 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-35e8a01d-8496-4990-802f-62e25c65887f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:57.565251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e16374-4fdb-46c2-86c2-5769f287fb42 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.574294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 251/491] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:57.584674 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509331e-10ee-4177-9d0d-535c23aedc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.585597 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509331e-10ee-4177-9d0d-535c23aedc36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.585880 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509331e-10ee-4177-9d0d-535c23aedc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.586157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509331e-10ee-4177-9d0d-535c23aedc36 admin admin] PATH_INFO: `/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/0e134083351e4493b2a05bea95233f5c/roles/2ba23f9ef2de43a6bf86f97ccf919c68` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.599376 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8a01d-8496-4990-802f-62e25c65887f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.614067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8a01d-8496-4990-802f-62e25c65887f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.620818 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509331e-10ee-4177-9d0d-535c23aedc36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ae5e80b1f745dfaedd81a2c0ded718, user_id=0e134083351e4493b2a05bea95233f5c, role_id=2ba23f9ef2de43a6bf86f97ccf919c68)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.623544 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509331e-10ee-4177-9d0d-535c23aedc36 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.628529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75739d67-fad0-4367-8de7-0e9ff3f9737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.629319 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739d67-fad0-4367-8de7-0e9ff3f9737a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.629592 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739d67-fad0-4367-8de7-0e9ff3f9737a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.629869 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739d67-fad0-4367-8de7-0e9ff3f9737a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.643021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75739d67-fad0-4367-8de7-0e9ff3f9737a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:57.650331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 241/492] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:48:57 2021] PUT /identity/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/0e134083351e4493b2a05bea95233f5c/roles/2ba23f9ef2de43a6bf86f97ccf919c68 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:48:57.656657 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-75739d67-fad0-4367-8de7-0e9ff3f9737a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:48:57.658267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 252/493] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:48:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:57.666504 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509331e-10ee-4177-9d0d-535c23aedc36 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.747889 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509331e-10ee-4177-9d0d-535c23aedc36 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.758480 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44497ca-b016-4476-b049-0b0f1352e5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.759086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44497ca-b016-4476-b049-0b0f1352e5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.759394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44497ca-b016-4476-b049-0b0f1352e5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.759673 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44497ca-b016-4476-b049-0b0f1352e5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.760459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44497ca-b016-4476-b049-0b0f1352e5f9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:57.760770 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44497ca-b016-4476-b049-0b0f1352e5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.762519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44497ca-b016-4476-b049-0b0f1352e5f9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.775224 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 242/494] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:48:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:57.781590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75739d67-fad0-4367-8de7-0e9ff3f9737a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.792600 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75739d67-fad0-4367-8de7-0e9ff3f9737a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.803961 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a44fe-4f16-4b62-93e0-1a1a0a3a6cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.804835 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a44fe-4f16-4b62-93e0-1a1a0a3a6cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.805119 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a44fe-4f16-4b62-93e0-1a1a0a3a6cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.805445 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a44fe-4f16-4b62-93e0-1a1a0a3a6cb0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.823477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a44fe-4f16-4b62-93e0-1a1a0a3a6cb0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.825488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a44fe-4f16-4b62-93e0-1a1a0a3a6cb0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.847290 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-519a44fe-4f16-4b62-93e0-1a1a0a3a6cb0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:57.848549 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 253/495] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:57.854881 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44497ca-b016-4476-b049-0b0f1352e5f9 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.867230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44497ca-b016-4476-b049-0b0f1352e5f9 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.873170 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094635f-ec0a-4c8f-b11a-58d66461c2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.873851 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094635f-ec0a-4c8f-b11a-58d66461c2cb admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.874187 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094635f-ec0a-4c8f-b11a-58d66461c2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.874466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094635f-ec0a-4c8f-b11a-58d66461c2cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.875298 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094635f-ec0a-4c8f-b11a-58d66461c2cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:57.875611 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094635f-ec0a-4c8f-b11a-58d66461c2cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.877673 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094635f-ec0a-4c8f-b11a-58d66461c2cb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.895644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 243/496] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:57.901922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a44fe-4f16-4b62-93e0-1a1a0a3a6cb0 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.916588 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a44fe-4f16-4b62-93e0-1a1a0a3a6cb0 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.922440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2ce67-31eb-4b82-9067-0796bcf72e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.923304 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2ce67-31eb-4b82-9067-0796bcf72e7d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.923589 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2ce67-31eb-4b82-9067-0796bcf72e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.923869 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2ce67-31eb-4b82-9067-0796bcf72e7d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.936260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2ce67-31eb-4b82-9067-0796bcf72e7d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.938467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2ce67-31eb-4b82-9067-0796bcf72e7d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:57.956104 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-bee2ce67-31eb-4b82-9067-0796bcf72e7d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 08 10:48:57.957537 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 254/497] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:48:57 2021] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:48:57.963990 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094635f-ec0a-4c8f-b11a-58d66461c2cb admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:57.981017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094635f-ec0a-4c8f-b11a-58d66461c2cb admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:57.987056 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7788c-9596-4076-87ca-07176dd9265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:57.987821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7788c-9596-4076-87ca-07176dd9265a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:57.988155 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7788c-9596-4076-87ca-07176dd9265a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:57.988435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7788c-9596-4076-87ca-07176dd9265a admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:57.989377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7788c-9596-4076-87ca-07176dd9265a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:57.989689 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7788c-9596-4076-87ca-07176dd9265a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:57.991776 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7788c-9596-4076-87ca-07176dd9265a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:58.020253 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 244/498] 10.222.0.20 () {56 vars in 1156 bytes} [Mon Nov 8 10:48:57 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:58.026762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2ce67-31eb-4b82-9067-0796bcf72e7d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:58.038526 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2ce67-31eb-4b82-9067-0796bcf72e7d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:58.044470 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b19d7-d350-46b9-bd56-bb5eae65baba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:58.045127 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b19d7-d350-46b9-bd56-bb5eae65baba admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:58.045465 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b19d7-d350-46b9-bd56-bb5eae65baba admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:58.045744 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b19d7-d350-46b9-bd56-bb5eae65baba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:58.059816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b19d7-d350-46b9-bd56-bb5eae65baba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:58.061649 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b19d7-d350-46b9-bd56-bb5eae65baba admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:58.077405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 255/499] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:58.083876 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7788c-9596-4076-87ca-07176dd9265a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:58.094772 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7788c-9596-4076-87ca-07176dd9265a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:58.103075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e077c-bd5f-41b5-b3ce-4c48dc18f2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:58.103972 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e077c-bd5f-41b5-b3ce-4c48dc18f2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:58.104258 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e077c-bd5f-41b5-b3ce-4c48dc18f2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:58.104530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e077c-bd5f-41b5-b3ce-4c48dc18f2f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:58.118546 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e077c-bd5f-41b5-b3ce-4c48dc18f2f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:58.120453 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e077c-bd5f-41b5-b3ce-4c48dc18f2f6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:58.142127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-474e077c-bd5f-41b5-b3ce-4c48dc18f2f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:58.143615 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 245/500] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:58.150235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b19d7-d350-46b9-bd56-bb5eae65baba admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:58.164852 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b19d7-d350-46b9-bd56-bb5eae65baba admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:58.175790 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa29b79-d34a-4eaf-b4d2-d5cfcb24dcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:58.176544 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa29b79-d34a-4eaf-b4d2-d5cfcb24dcbf admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:58.176831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa29b79-d34a-4eaf-b4d2-d5cfcb24dcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:58.177110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa29b79-d34a-4eaf-b4d2-d5cfcb24dcbf admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:58.177967 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa29b79-d34a-4eaf-b4d2-d5cfcb24dcbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:58.178272 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa29b79-d34a-4eaf-b4d2-d5cfcb24dcbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:58.180006 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa29b79-d34a-4eaf-b4d2-d5cfcb24dcbf admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:58.204992 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 256/501] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:58.211656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e077c-bd5f-41b5-b3ce-4c48dc18f2f6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:58.228471 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e077c-bd5f-41b5-b3ce-4c48dc18f2f6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:58.234241 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461df97-499e-4f19-b5c7-021a6ef52aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:58.235142 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461df97-499e-4f19-b5c7-021a6ef52aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:58.235444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461df97-499e-4f19-b5c7-021a6ef52aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:58.235766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461df97-499e-4f19-b5c7-021a6ef52aa5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:58.247169 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461df97-499e-4f19-b5c7-021a6ef52aa5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:58.249310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461df97-499e-4f19-b5c7-021a6ef52aa5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:58.265597 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-c461df97-499e-4f19-b5c7-021a6ef52aa5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:48:58.267564 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 246/502] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:48:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:58.274636 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa29b79-d34a-4eaf-b4d2-d5cfcb24dcbf admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:58.285323 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa29b79-d34a-4eaf-b4d2-d5cfcb24dcbf admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:58.291979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e700a5e-bd78-4fe2-b452-d49600ee02ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:58.292696 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e700a5e-bd78-4fe2-b452-d49600ee02ad admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:58.292978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e700a5e-bd78-4fe2-b452-d49600ee02ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:58.293259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e700a5e-bd78-4fe2-b452-d49600ee02ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:58.294126 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e700a5e-bd78-4fe2-b452-d49600ee02ad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:58.294434 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e700a5e-bd78-4fe2-b452-d49600ee02ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:58.296437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e700a5e-bd78-4fe2-b452-d49600ee02ad admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:58.317361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 257/503] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:48:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:58.324460 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461df97-499e-4f19-b5c7-021a6ef52aa5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:58.340441 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461df97-499e-4f19-b5c7-021a6ef52aa5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:58.346567 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0560b65-aee4-4b5a-a36f-920a81701d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:58.347302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0560b65-aee4-4b5a-a36f-920a81701d61 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:58.347587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0560b65-aee4-4b5a-a36f-920a81701d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:58.347862 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0560b65-aee4-4b5a-a36f-920a81701d61 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:58.348775 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0560b65-aee4-4b5a-a36f-920a81701d61 admin admin] RBAC: Adding query filter params (role.id=2ba23f9ef2de43a6bf86f97ccf919c68, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=029506cc966a44c9bbe83eb084ac6feb) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:58.349135 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0560b65-aee4-4b5a-a36f-920a81701d61 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:58.351098 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0560b65-aee4-4b5a-a36f-920a81701d61 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:58.363670 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 247/504] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:48:58 2021] GET /identity/v3/role_assignments?user.id=029506cc966a44c9bbe83eb084ac6feb&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=2ba23f9ef2de43a6bf86f97ccf919c68 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:59.363094 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72501e5b-ef00-4be7-a6b1-40aea1c3cdea None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.363663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72501e5b-ef00-4be7-a6b1-40aea1c3cdea None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.363663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72501e5b-ef00-4be7-a6b1-40aea1c3cdea None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.365839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 258/505] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:59.372647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cefbd1-722e-4414-85d7-795d02b1c614 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.373157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cefbd1-722e-4414-85d7-795d02b1c614 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.373228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cefbd1-722e-4414-85d7-795d02b1c614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.400278 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-d7cefbd1-722e-4414-85d7-795d02b1c614 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:59.401509 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d7cefbd1-722e-4414-85d7-795d02b1c614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:59.413418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 248/506] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:48:59.452925 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72501e5b-ef00-4be7-a6b1-40aea1c3cdea None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:59.482650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72501e5b-ef00-4be7-a6b1-40aea1c3cdea None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:59.490188 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b4aa1-6361-4e24-99ba-843671efc8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:59.490995 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b4aa1-6361-4e24-99ba-843671efc8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.491312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b4aa1-6361-4e24-99ba-843671efc8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.491585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b4aa1-6361-4e24-99ba-843671efc8a2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.508896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b4aa1-6361-4e24-99ba-843671efc8a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:59.514130 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4c6a-72c5-43d7-9970-4d19da6c1ff8 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.514418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4c6a-72c5-43d7-9970-4d19da6c1ff8 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.514697 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4c6a-72c5-43d7-9970-4d19da6c1ff8 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.515805 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-fc6b4aa1-6361-4e24-99ba-843671efc8a2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:48:59.517706 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 259/508] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:48:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:59.517817 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 249/508] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:48:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:48:59.524297 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d4c6a-72c5-43d7-9970-4d19da6c1ff8 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:59.524435 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64026-0e4e-4e21-889d-cfef9698070e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.524695 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64026-0e4e-4e21-889d-cfef9698070e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.524977 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64026-0e4e-4e21-889d-cfef9698070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.547262 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-b2d64026-0e4e-4e21-889d-cfef9698070e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:48:59.549500 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b2d64026-0e4e-4e21-889d-cfef9698070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:48:59.550357 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d4c6a-72c5-43d7-9970-4d19da6c1ff8 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:59.559848 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dd3ec-22c2-44b7-a4d3-f50400aae399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:59.560823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dd3ec-22c2-44b7-a4d3-f50400aae399 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.561310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dd3ec-22c2-44b7-a4d3-f50400aae399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.561789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dd3ec-22c2-44b7-a4d3-f50400aae399 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.562766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dd3ec-22c2-44b7-a4d3-f50400aae399 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:59.563697 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dd3ec-22c2-44b7-a4d3-f50400aae399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:59.566053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dd3ec-22c2-44b7-a4d3-f50400aae399 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:59.569558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 260/509] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:48:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:48:59.581577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 250/510] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:48:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:59.587695 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d64026-0e4e-4e21-889d-cfef9698070e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:59.598456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d64026-0e4e-4e21-889d-cfef9698070e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:59.599771 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dd3ec-22c2-44b7-a4d3-f50400aae399 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:59.610624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03fa3d-44a2-42fb-856d-f947d84f01ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:59.610624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03fa3d-44a2-42fb-856d-f947d84f01ea admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.610624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03fa3d-44a2-42fb-856d-f947d84f01ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.610624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03fa3d-44a2-42fb-856d-f947d84f01ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.621456 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dd3ec-22c2-44b7-a4d3-f50400aae399 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:59.627027 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03fa3d-44a2-42fb-856d-f947d84f01ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:59.631060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03fa3d-44a2-42fb-856d-f947d84f01ea admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:59.634032 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681478-6272-4fdf-9281-f2c449a1bdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:59.635100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681478-6272-4fdf-9281-f2c449a1bdcd admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.635569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681478-6272-4fdf-9281-f2c449a1bdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.636073 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681478-6272-4fdf-9281-f2c449a1bdcd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.663102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-0a03fa3d-44a2-42fb-856d-f947d84f01ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:59.665007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 261/511] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:59.669879 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681478-6272-4fdf-9281-f2c449a1bdcd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:48:59.670995 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03fa3d-44a2-42fb-856d-f947d84f01ea admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:59.675696 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-dd681478-6272-4fdf-9281-f2c449a1bdcd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:48:59.677236 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 251/512] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:48:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:59.688119 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681478-6272-4fdf-9281-f2c449a1bdcd admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:59.688478 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03fa3d-44a2-42fb-856d-f947d84f01ea admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:59.698513 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681478-6272-4fdf-9281-f2c449a1bdcd admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:59.701386 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bd732-460d-4c4f-8554-712bc1ac0f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:59.702387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd732-460d-4c4f-8554-712bc1ac0f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.702868 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd732-460d-4c4f-8554-712bc1ac0f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.703434 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd732-460d-4c4f-8554-712bc1ac0f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.704390 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bd732-460d-4c4f-8554-712bc1ac0f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:59.704935 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bd732-460d-4c4f-8554-712bc1ac0f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:59.706911 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bd732-460d-4c4f-8554-712bc1ac0f93 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:59.717180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5605d3-c118-4264-8114-9c79b129f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:59.717869 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5605d3-c118-4264-8114-9c79b129f2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.718155 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5605d3-c118-4264-8114-9c79b129f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.718439 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5605d3-c118-4264-8114-9c79b129f2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.719224 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5605d3-c118-4264-8114-9c79b129f2c3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:59.719530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5605d3-c118-4264-8114-9c79b129f2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:59.721376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5605d3-c118-4264-8114-9c79b129f2c3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:59.721963 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 262/513] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:59.727770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bd732-460d-4c4f-8554-712bc1ac0f93 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:59.741965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 252/514] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:48:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:59.745069 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bd732-460d-4c4f-8554-712bc1ac0f93 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:59.748333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5605d3-c118-4264-8114-9c79b129f2c3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:59.757482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db14230-a3ab-41cf-98fa-2ab110ba6c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:59.759968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db14230-a3ab-41cf-98fa-2ab110ba6c92 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.760498 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db14230-a3ab-41cf-98fa-2ab110ba6c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.761150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db14230-a3ab-41cf-98fa-2ab110ba6c92 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.764085 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5605d3-c118-4264-8114-9c79b129f2c3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:59.777035 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db14230-a3ab-41cf-98fa-2ab110ba6c92 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:59.777909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3e4e7-1caa-4ef7-9a7b-1210895ce841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:59.779023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3e4e7-1caa-4ef7-9a7b-1210895ce841 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.779549 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3e4e7-1caa-4ef7-9a7b-1210895ce841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.780023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3e4e7-1caa-4ef7-9a7b-1210895ce841 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.782982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db14230-a3ab-41cf-98fa-2ab110ba6c92 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:59.798314 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-4db14230-a3ab-41cf-98fa-2ab110ba6c92 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 08 10:48:59.800440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 263/515] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:48:59 2021] GET /identity/v3/users/glance => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:59.803525 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3e4e7-1caa-4ef7-9a7b-1210895ce841 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:59.806106 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db14230-a3ab-41cf-98fa-2ab110ba6c92 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:59.807344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3e4e7-1caa-4ef7-9a7b-1210895ce841 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:59.826053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db14230-a3ab-41cf-98fa-2ab110ba6c92 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:59.832853 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ecd62-5452-4209-b5d3-66830b63fa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:59.833863 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ecd62-5452-4209-b5d3-66830b63fa92 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.834402 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ecd62-5452-4209-b5d3-66830b63fa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.834981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ecd62-5452-4209-b5d3-66830b63fa92 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.836085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ecd62-5452-4209-b5d3-66830b63fa92 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:59.836808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ecd62-5452-4209-b5d3-66830b63fa92 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:59.840612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ecd62-5452-4209-b5d3-66830b63fa92 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:59.841673 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-f9e3e4e7-1caa-4ef7-9a7b-1210895ce841 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:48:59.843168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 253/516] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:48:59.852873 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3e4e7-1caa-4ef7-9a7b-1210895ce841 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:59.861714 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 264/517] 10.222.0.20 () {56 vars in 1158 bytes} [Mon Nov 8 10:48:59 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:48:59.867720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ecd62-5452-4209-b5d3-66830b63fa92 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:59.871012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3e4e7-1caa-4ef7-9a7b-1210895ce841 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:59.887476 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e9fc4-f169-4f47-bf40-0afcf5238655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:59.888607 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e9fc4-f169-4f47-bf40-0afcf5238655 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.890691 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e9fc4-f169-4f47-bf40-0afcf5238655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.891294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e9fc4-f169-4f47-bf40-0afcf5238655 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.892735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e9fc4-f169-4f47-bf40-0afcf5238655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:48:59.894109 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e9fc4-f169-4f47-bf40-0afcf5238655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:59.898393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ecd62-5452-4209-b5d3-66830b63fa92 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:59.900274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e9fc4-f169-4f47-bf40-0afcf5238655 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:59.911295 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bda56c-bd62-4855-84a9-5ba121b046d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:59.912408 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bda56c-bd62-4855-84a9-5ba121b046d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.912915 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bda56c-bd62-4855-84a9-5ba121b046d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.913416 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bda56c-bd62-4855-84a9-5ba121b046d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.924232 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 254/518] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:48:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:48:59.929079 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bda56c-bd62-4855-84a9-5ba121b046d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:59.930252 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e9fc4-f169-4f47-bf40-0afcf5238655 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:59.936141 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bda56c-bd62-4855-84a9-5ba121b046d6 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:59.948280 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e9fc4-f169-4f47-bf40-0afcf5238655 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:59.954273 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 265/519] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:48:59 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:48:59.957067 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eeafd6-e82c-433c-9b04-a8ded06efbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:59.958155 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeafd6-e82c-433c-9b04-a8ded06efbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.958693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeafd6-e82c-433c-9b04-a8ded06efbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.959870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bda56c-bd62-4855-84a9-5ba121b046d6 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:48:59.963525 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeafd6-e82c-433c-9b04-a8ded06efbe4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:48:59.975697 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bda56c-bd62-4855-84a9-5ba121b046d6 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:48:59.979913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eeafd6-e82c-433c-9b04-a8ded06efbe4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:48:59.983149 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eeafd6-e82c-433c-9b04-a8ded06efbe4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:48:59.987670 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ff2a7-4df9-4327-a664-2de15c218065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:48:59.988788 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ff2a7-4df9-4327-a664-2de15c218065 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:48:59.989322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ff2a7-4df9-4327-a664-2de15c218065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:48:59.989818 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ff2a7-4df9-4327-a664-2de15c218065 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.005432 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-01eeafd6-e82c-433c-9b04-a8ded06efbe4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 08 10:49:00.007431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 255/520] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Nov 8 10:48:59 2021] GET /identity/v3/users/nova => generated 82 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:00.012104 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ff2a7-4df9-4327-a664-2de15c218065 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.013238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eeafd6-e82c-433c-9b04-a8ded06efbe4 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.015387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ff2a7-4df9-4327-a664-2de15c218065 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.034801 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eeafd6-e82c-433c-9b04-a8ded06efbe4 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.044693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8195c8-9fbf-45ab-9014-7bb37bcb5260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.045630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8195c8-9fbf-45ab-9014-7bb37bcb5260 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.045917 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8195c8-9fbf-45ab-9014-7bb37bcb5260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.046248 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8195c8-9fbf-45ab-9014-7bb37bcb5260 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.047230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8195c8-9fbf-45ab-9014-7bb37bcb5260 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.047544 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8195c8-9fbf-45ab-9014-7bb37bcb5260 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.049597 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8195c8-9fbf-45ab-9014-7bb37bcb5260 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.049936 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-f89ff2a7-4df9-4327-a664-2de15c218065 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:00.051674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 266/521] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:48:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:00.053213 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a429f0a-efe8-478a-b930-0fbe2dcc4c22 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.053700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a429f0a-efe8-478a-b930-0fbe2dcc4c22 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.054173 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a429f0a-efe8-478a-b930-0fbe2dcc4c22 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.056307 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 267/522] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:00.057604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a429f0a-efe8-478a-b930-0fbe2dcc4c22 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.071001 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a429f0a-efe8-478a-b930-0fbe2dcc4c22 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.077267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4ba83-b56b-44ed-a477-dfa05ffac5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.078034 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ba83-b56b-44ed-a477-dfa05ffac5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.078572 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ba83-b56b-44ed-a477-dfa05ffac5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.079456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ba83-b56b-44ed-a477-dfa05ffac5c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.080538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4ba83-b56b-44ed-a477-dfa05ffac5c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.080990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4ba83-b56b-44ed-a477-dfa05ffac5c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.081518 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 256/523] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:00.082991 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d69565-3a38-4078-907b-2339960aba8e None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.083107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4ba83-b56b-44ed-a477-dfa05ffac5c1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.083489 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d69565-3a38-4078-907b-2339960aba8e None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.083849 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d69565-3a38-4078-907b-2339960aba8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.102638 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 268/524] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:00.102638 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4ba83-b56b-44ed-a477-dfa05ffac5c1 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.112565 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-58d69565-3a38-4078-907b-2339960aba8e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:00.113238 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4ba83-b56b-44ed-a477-dfa05ffac5c1 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.114344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-58d69565-3a38-4078-907b-2339960aba8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:00.118183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70204c57-9d8e-4f82-a0ee-8dad334dcdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.118954 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70204c57-9d8e-4f82-a0ee-8dad334dcdcd admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.119367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70204c57-9d8e-4f82-a0ee-8dad334dcdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.119745 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70204c57-9d8e-4f82-a0ee-8dad334dcdcd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.123968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 257/525] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:49:00.131382 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d69565-3a38-4078-907b-2339960aba8e None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.135762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70204c57-9d8e-4f82-a0ee-8dad334dcdcd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.137704 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70204c57-9d8e-4f82-a0ee-8dad334dcdcd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.148054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d69565-3a38-4078-907b-2339960aba8e None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.151917 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 269/526] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:49:00.154780 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70204c57-9d8e-4f82-a0ee-8dad334dcdcd admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.155710 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b67daf-c615-4009-bdb9-00f383f118bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.156656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b67daf-c615-4009-bdb9-00f383f118bb admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.157090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b67daf-c615-4009-bdb9-00f383f118bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.157487 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b67daf-c615-4009-bdb9-00f383f118bb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.165415 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b67daf-c615-4009-bdb9-00f383f118bb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.166241 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70204c57-9d8e-4f82-a0ee-8dad334dcdcd admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.167836 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b67daf-c615-4009-bdb9-00f383f118bb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.171562 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249e759-ca78-406b-8d21-09708f24ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.172517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249e759-ca78-406b-8d21-09708f24ed7a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.172946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249e759-ca78-406b-8d21-09708f24ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.173379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249e759-ca78-406b-8d21-09708f24ed7a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.184165 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-c2b67daf-c615-4009-bdb9-00f383f118bb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:00.185384 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249e759-ca78-406b-8d21-09708f24ed7a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:00.185653 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 258/527] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:00.186551 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b67daf-c615-4009-bdb9-00f383f118bb admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.193239 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-2249e759-ca78-406b-8d21-09708f24ed7a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:49:00.195728 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 270/528] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:00.201810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249e759-ca78-406b-8d21-09708f24ed7a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.201950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b67daf-c615-4009-bdb9-00f383f118bb admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.212096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249e759-ca78-406b-8d21-09708f24ed7a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.214078 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a6ab4-408f-4ba5-9e67-54a72fd60171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.215381 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a6ab4-408f-4ba5-9e67-54a72fd60171 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.215950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a6ab4-408f-4ba5-9e67-54a72fd60171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.216386 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a6ab4-408f-4ba5-9e67-54a72fd60171 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.217273 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61326b91-ff3a-4223-9903-962e60f1093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.218010 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61326b91-ff3a-4223-9903-962e60f1093e admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.218435 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61326b91-ff3a-4223-9903-962e60f1093e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.218816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61326b91-ff3a-4223-9903-962e60f1093e admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.219842 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61326b91-ff3a-4223-9903-962e60f1093e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.220400 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61326b91-ff3a-4223-9903-962e60f1093e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.222982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61326b91-ff3a-4223-9903-962e60f1093e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.232746 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a6ab4-408f-4ba5-9e67-54a72fd60171 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.235899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a6ab4-408f-4ba5-9e67-54a72fd60171 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.238100 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 271/529] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:00.239052 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61326b91-ff3a-4223-9903-962e60f1093e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.251742 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61326b91-ff3a-4223-9903-962e60f1093e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.257324 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-ca7a6ab4-408f-4ba5-9e67-54a72fd60171 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:00.257906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eee26-818c-4114-a384-65b471cfd6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.258722 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eee26-818c-4114-a384-65b471cfd6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.259115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eee26-818c-4114-a384-65b471cfd6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.259585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eee26-818c-4114-a384-65b471cfd6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.259753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 259/530] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:00.260626 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62eee26-818c-4114-a384-65b471cfd6d1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.260914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a6ab4-408f-4ba5-9e67-54a72fd60171 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.261125 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62eee26-818c-4114-a384-65b471cfd6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.262952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62eee26-818c-4114-a384-65b471cfd6d1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.272453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 272/531] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:00.278282 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eee26-818c-4114-a384-65b471cfd6d1 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.278396 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a6ab4-408f-4ba5-9e67-54a72fd60171 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.287763 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98b1d4-4278-4cff-a662-5902578f2429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.288606 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98b1d4-4278-4cff-a662-5902578f2429 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.288850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eee26-818c-4114-a384-65b471cfd6d1 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.289213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98b1d4-4278-4cff-a662-5902578f2429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.289628 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98b1d4-4278-4cff-a662-5902578f2429 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.290788 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98b1d4-4278-4cff-a662-5902578f2429 admin admin] RBAC: Adding query filter params (role.id=2ba23f9ef2de43a6bf86f97ccf919c68, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=07a71b8adef243049d3b055e66566a63) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.291358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98b1d4-4278-4cff-a662-5902578f2429 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.293877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98b1d4-4278-4cff-a662-5902578f2429 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.294187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fd086-cc52-4c79-a39a-e65147be2c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.295046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fd086-cc52-4c79-a39a-e65147be2c24 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.295529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fd086-cc52-4c79-a39a-e65147be2c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.295991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fd086-cc52-4c79-a39a-e65147be2c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.296897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fd086-cc52-4c79-a39a-e65147be2c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.297311 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fd086-cc52-4c79-a39a-e65147be2c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.299439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fd086-cc52-4c79-a39a-e65147be2c24 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.302370 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 260/532] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/role_assignments?user.id=07a71b8adef243049d3b055e66566a63&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=2ba23f9ef2de43a6bf86f97ccf919c68 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:00.303587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98b1d4-4278-4cff-a662-5902578f2429 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.322237 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 273/533] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:00.326207 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98b1d4-4278-4cff-a662-5902578f2429 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.328324 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fd086-cc52-4c79-a39a-e65147be2c24 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.341389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fd086-cc52-4c79-a39a-e65147be2c24 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.343901 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880445c-68f4-418a-8c22-09892f3acad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.344747 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880445c-68f4-418a-8c22-09892f3acad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.345038 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880445c-68f4-418a-8c22-09892f3acad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.345312 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880445c-68f4-418a-8c22-09892f3acad5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.347491 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfa91a-ab3e-4efe-a87e-d49777cec30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.348773 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfa91a-ab3e-4efe-a87e-d49777cec30d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.349269 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfa91a-ab3e-4efe-a87e-d49777cec30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.349793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfa91a-ab3e-4efe-a87e-d49777cec30d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.364382 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfa91a-ab3e-4efe-a87e-d49777cec30d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.368576 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfa91a-ab3e-4efe-a87e-d49777cec30d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.370452 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880445c-68f4-418a-8c22-09892f3acad5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.372886 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880445c-68f4-418a-8c22-09892f3acad5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.398855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-49dfa91a-ab3e-4efe-a87e-d49777cec30d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:00.401365 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 274/534] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:00.408282 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfa91a-ab3e-4efe-a87e-d49777cec30d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.409620 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-a880445c-68f4-418a-8c22-09892f3acad5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:00.411447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 261/535] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:00.422470 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880445c-68f4-418a-8c22-09892f3acad5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.430457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfa91a-ab3e-4efe-a87e-d49777cec30d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.438998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a69c64-6807-4377-9712-ebb82e08971c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.439759 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a69c64-6807-4377-9712-ebb82e08971c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.440049 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a69c64-6807-4377-9712-ebb82e08971c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.440512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a69c64-6807-4377-9712-ebb82e08971c admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.441267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a69c64-6807-4377-9712-ebb82e08971c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.441580 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a69c64-6807-4377-9712-ebb82e08971c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.443530 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a69c64-6807-4377-9712-ebb82e08971c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.447912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880445c-68f4-418a-8c22-09892f3acad5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.452625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1bf3a-8ad9-4499-84f4-077691ce2d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.453321 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1bf3a-8ad9-4499-84f4-077691ce2d6a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.453606 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1bf3a-8ad9-4499-84f4-077691ce2d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.453881 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1bf3a-8ad9-4499-84f4-077691ce2d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.454660 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1bf3a-8ad9-4499-84f4-077691ce2d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.454971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1bf3a-8ad9-4499-84f4-077691ce2d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.456987 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1bf3a-8ad9-4499-84f4-077691ce2d6a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.475880 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 275/536] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:00.482440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a69c64-6807-4377-9712-ebb82e08971c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.492081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 262/537] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:00.495714 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1bf3a-8ad9-4499-84f4-077691ce2d6a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.505140 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a69c64-6807-4377-9712-ebb82e08971c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.515409 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1bf3a-8ad9-4499-84f4-077691ce2d6a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.518124 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c607dd-1256-4e35-b459-0dbbc3d077bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.518945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c607dd-1256-4e35-b459-0dbbc3d077bd admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.519881 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c607dd-1256-4e35-b459-0dbbc3d077bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.521267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c607dd-1256-4e35-b459-0dbbc3d077bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.522180 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c607dd-1256-4e35-b459-0dbbc3d077bd admin admin] RBAC: Adding query filter params (role.id=2ba23f9ef2de43a6bf86f97ccf919c68, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=d3421cf1bbb24423a2f24c4667adfdda) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.522495 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c607dd-1256-4e35-b459-0dbbc3d077bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.524464 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c607dd-1256-4e35-b459-0dbbc3d077bd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.531727 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853511d3-6ef5-4a01-bb56-e15a557fa5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.532565 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853511d3-6ef5-4a01-bb56-e15a557fa5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.532853 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853511d3-6ef5-4a01-bb56-e15a557fa5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.533132 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853511d3-6ef5-4a01-bb56-e15a557fa5c8 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.544676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853511d3-6ef5-4a01-bb56-e15a557fa5c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.545758 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 276/538] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/role_assignments?user.id=d3421cf1bbb24423a2f24c4667adfdda&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=2ba23f9ef2de43a6bf86f97ccf919c68 => generated 608 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:00.547344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853511d3-6ef5-4a01-bb56-e15a557fa5c8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.566242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-853511d3-6ef5-4a01-bb56-e15a557fa5c8 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 08 10:49:00.568313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 263/539] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/users/cinder => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:00.575680 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c607dd-1256-4e35-b459-0dbbc3d077bd admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.589663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c607dd-1256-4e35-b459-0dbbc3d077bd admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.595047 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769c030-c8ca-4457-a29d-b6da03651861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.596489 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769c030-c8ca-4457-a29d-b6da03651861 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.597165 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769c030-c8ca-4457-a29d-b6da03651861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.597699 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769c030-c8ca-4457-a29d-b6da03651861 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.598854 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769c030-c8ca-4457-a29d-b6da03651861 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.599407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769c030-c8ca-4457-a29d-b6da03651861 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.601619 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769c030-c8ca-4457-a29d-b6da03651861 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.623276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 277/540] 10.222.0.20 () {56 vars in 1158 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:00.630064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853511d3-6ef5-4a01-bb56-e15a557fa5c8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.644988 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d96af-e36c-4328-8d2a-27f59e4673d7 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.645590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853511d3-6ef5-4a01-bb56-e15a557fa5c8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.645871 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d96af-e36c-4328-8d2a-27f59e4673d7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.646354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d96af-e36c-4328-8d2a-27f59e4673d7 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.649261 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 278/541] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:00.653974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d2b61-29b7-40f6-b0e9-d253cf3fa0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.654634 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d2b61-29b7-40f6-b0e9-d253cf3fa0fb admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.654923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d2b61-29b7-40f6-b0e9-d253cf3fa0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.655208 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d2b61-29b7-40f6-b0e9-d253cf3fa0fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.659934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae21cde-c646-4916-ab48-01e775d3c838 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.660543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae21cde-c646-4916-ab48-01e775d3c838 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.661075 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae21cde-c646-4916-ab48-01e775d3c838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.665230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d2b61-29b7-40f6-b0e9-d253cf3fa0fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.667430 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d2b61-29b7-40f6-b0e9-d253cf3fa0fb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.678437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 264/542] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:49:00.692294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-cae21cde-c646-4916-ab48-01e775d3c838 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:00.693563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-cae21cde-c646-4916-ab48-01e775d3c838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:00.695451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d2b61-29b7-40f6-b0e9-d253cf3fa0fb admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.704696 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 279/543] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:49:00.710480 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d2b61-29b7-40f6-b0e9-d253cf3fa0fb admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.715254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f31c0d-c8da-4612-aa2e-a7dc51fcb331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.716360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f31c0d-c8da-4612-aa2e-a7dc51fcb331 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.716825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f31c0d-c8da-4612-aa2e-a7dc51fcb331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.717284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f31c0d-c8da-4612-aa2e-a7dc51fcb331 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.731453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae21cde-c646-4916-ab48-01e775d3c838 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.731833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f31c0d-c8da-4612-aa2e-a7dc51fcb331 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.733974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f31c0d-c8da-4612-aa2e-a7dc51fcb331 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.748998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae21cde-c646-4916-ab48-01e775d3c838 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.755855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797e990-c627-4247-942d-14438eb4e04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.756449 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-10f31c0d-c8da-4612-aa2e-a7dc51fcb331 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:00.756935 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797e990-c627-4247-942d-14438eb4e04a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.757319 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797e990-c627-4247-942d-14438eb4e04a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.757692 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797e990-c627-4247-942d-14438eb4e04a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.758597 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 265/544] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:00.767295 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f31c0d-c8da-4612-aa2e-a7dc51fcb331 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.778349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797e990-c627-4247-942d-14438eb4e04a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:00.779940 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f31c0d-c8da-4612-aa2e-a7dc51fcb331 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.785291 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9376c-a7f4-4d0f-bebe-c0fe47844fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.786210 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9376c-a7f4-4d0f-bebe-c0fe47844fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.786612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-0797e990-c627-4247-942d-14438eb4e04a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:49:00.786822 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9376c-a7f4-4d0f-bebe-c0fe47844fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.787294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9376c-a7f4-4d0f-bebe-c0fe47844fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.788208 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9376c-a7f4-4d0f-bebe-c0fe47844fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.788577 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 280/545] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:00.788915 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9376c-a7f4-4d0f-bebe-c0fe47844fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.790714 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9376c-a7f4-4d0f-bebe-c0fe47844fb0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.795424 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797e990-c627-4247-942d-14438eb4e04a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.810851 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 266/546] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:00.811035 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797e990-c627-4247-942d-14438eb4e04a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.812295 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9376c-a7f4-4d0f-bebe-c0fe47844fb0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.817071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be979b-d6ec-4640-905e-45e2eb329148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.818311 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be979b-d6ec-4640-905e-45e2eb329148 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.818886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be979b-d6ec-4640-905e-45e2eb329148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.820018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be979b-d6ec-4640-905e-45e2eb329148 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.821384 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be979b-d6ec-4640-905e-45e2eb329148 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.821937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be979b-d6ec-4640-905e-45e2eb329148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.823286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9376c-a7f4-4d0f-bebe-c0fe47844fb0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.824171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be979b-d6ec-4640-905e-45e2eb329148 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.828960 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75703d12-b78d-4294-8b79-f061b4ba3b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.829769 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75703d12-b78d-4294-8b79-f061b4ba3b59 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.830046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75703d12-b78d-4294-8b79-f061b4ba3b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.830403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75703d12-b78d-4294-8b79-f061b4ba3b59 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.836968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 281/547] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:00.839790 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75703d12-b78d-4294-8b79-f061b4ba3b59 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.841877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75703d12-b78d-4294-8b79-f061b4ba3b59 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.843002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be979b-d6ec-4640-905e-45e2eb329148 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.853787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be979b-d6ec-4640-905e-45e2eb329148 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.857161 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-75703d12-b78d-4294-8b79-f061b4ba3b59 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:00.859014 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 267/548] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:00.859245 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b211c9-9783-4da9-862e-0bf5ec22de18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.860741 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b211c9-9783-4da9-862e-0bf5ec22de18 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.861374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b211c9-9783-4da9-862e-0bf5ec22de18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.861683 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b211c9-9783-4da9-862e-0bf5ec22de18 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.866065 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75703d12-b78d-4294-8b79-f061b4ba3b59 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.872789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b211c9-9783-4da9-862e-0bf5ec22de18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.874739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b211c9-9783-4da9-862e-0bf5ec22de18 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.876378 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75703d12-b78d-4294-8b79-f061b4ba3b59 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.881955 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11732978-afc8-46f0-a758-d2cdb53e9d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.882619 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11732978-afc8-46f0-a758-d2cdb53e9d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.882903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11732978-afc8-46f0-a758-d2cdb53e9d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.883561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11732978-afc8-46f0-a758-d2cdb53e9d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.884012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11732978-afc8-46f0-a758-d2cdb53e9d54 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.884341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11732978-afc8-46f0-a758-d2cdb53e9d54 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.886183 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11732978-afc8-46f0-a758-d2cdb53e9d54 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.894984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-49b211c9-9783-4da9-862e-0bf5ec22de18 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:00.896401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 282/549] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:00.900095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 268/550] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:00.904193 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b211c9-9783-4da9-862e-0bf5ec22de18 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.906914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11732978-afc8-46f0-a758-d2cdb53e9d54 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.916029 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b211c9-9783-4da9-862e-0bf5ec22de18 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.918425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11732978-afc8-46f0-a758-d2cdb53e9d54 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.921497 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5752519-c738-4f72-8047-8b6999d3d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.922251 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5752519-c738-4f72-8047-8b6999d3d4bc admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.922527 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5752519-c738-4f72-8047-8b6999d3d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.922803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5752519-c738-4f72-8047-8b6999d3d4bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.923684 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5752519-c738-4f72-8047-8b6999d3d4bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.923787 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a123d-decf-407f-8a7c-ca83a886c4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.924144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5752519-c738-4f72-8047-8b6999d3d4bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.924722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a123d-decf-407f-8a7c-ca83a886c4bd admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.925215 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a123d-decf-407f-8a7c-ca83a886c4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.925514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a123d-decf-407f-8a7c-ca83a886c4bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.925934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5752519-c738-4f72-8047-8b6999d3d4bc admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.926375 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a123d-decf-407f-8a7c-ca83a886c4bd admin admin] RBAC: Adding query filter params (role.id=2ba23f9ef2de43a6bf86f97ccf919c68, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=4b0a2df68bfc41ada3b2135fc2e1930f) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:00.926684 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a123d-decf-407f-8a7c-ca83a886c4bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.929313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a123d-decf-407f-8a7c-ca83a886c4bd admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.937835 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 269/551] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/role_assignments?user.id=4b0a2df68bfc41ada3b2135fc2e1930f&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=2ba23f9ef2de43a6bf86f97ccf919c68 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:00.939378 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 283/552] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:00.945471 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a123d-decf-407f-8a7c-ca83a886c4bd admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:00.955981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a123d-decf-407f-8a7c-ca83a886c4bd admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:00.960936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a71ba9-6fe9-4a4c-9210-b04763211c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:00.961784 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a71ba9-6fe9-4a4c-9210-b04763211c24 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:00.962067 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a71ba9-6fe9-4a4c-9210-b04763211c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:00.962349 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a71ba9-6fe9-4a4c-9210-b04763211c24 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:00.971087 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a71ba9-6fe9-4a4c-9210-b04763211c24 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:00.973216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a71ba9-6fe9-4a4c-9210-b04763211c24 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:00.988822 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-81a71ba9-6fe9-4a4c-9210-b04763211c24 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 08 10:49:00.990450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 270/553] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/users/neutron => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:00.997099 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5752519-c738-4f72-8047-8b6999d3d4bc admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.011406 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5752519-c738-4f72-8047-8b6999d3d4bc admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.019474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72387b-2586-4b34-a411-0db408f1eb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.020181 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72387b-2586-4b34-a411-0db408f1eb92 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.020465 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72387b-2586-4b34-a411-0db408f1eb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.020744 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72387b-2586-4b34-a411-0db408f1eb92 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.021627 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72387b-2586-4b34-a411-0db408f1eb92 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:01.021936 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72387b-2586-4b34-a411-0db408f1eb92 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.023874 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72387b-2586-4b34-a411-0db408f1eb92 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.056110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 284/554] 10.222.0.20 () {56 vars in 1160 bytes} [Mon Nov 8 10:49:00 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:01.062639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a71ba9-6fe9-4a4c-9210-b04763211c24 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.077118 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a71ba9-6fe9-4a4c-9210-b04763211c24 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.085090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889c610-d7d9-488e-b959-c381282809de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.085804 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889c610-d7d9-488e-b959-c381282809de admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.086089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889c610-d7d9-488e-b959-c381282809de admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.086369 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889c610-d7d9-488e-b959-c381282809de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.100313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889c610-d7d9-488e-b959-c381282809de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.102123 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889c610-d7d9-488e-b959-c381282809de admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.117535 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 271/555] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:49:01.124339 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72387b-2586-4b34-a411-0db408f1eb92 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.140522 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72387b-2586-4b34-a411-0db408f1eb92 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.150489 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e53f72-aa2b-4219-bd85-821a1b13c686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.151264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e53f72-aa2b-4219-bd85-821a1b13c686 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.151553 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e53f72-aa2b-4219-bd85-821a1b13c686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.151823 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e53f72-aa2b-4219-bd85-821a1b13c686 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.167375 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e53f72-aa2b-4219-bd85-821a1b13c686 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.169205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e53f72-aa2b-4219-bd85-821a1b13c686 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.189158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-01e53f72-aa2b-4219-bd85-821a1b13c686 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:01.190743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 285/556] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:01.196747 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889c610-d7d9-488e-b959-c381282809de admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.212245 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889c610-d7d9-488e-b959-c381282809de admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.219936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178828f1-2f96-4404-b3b7-6690bd9f8afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.220617 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178828f1-2f96-4404-b3b7-6690bd9f8afb admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.221062 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178828f1-2f96-4404-b3b7-6690bd9f8afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.221430 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178828f1-2f96-4404-b3b7-6690bd9f8afb admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.222183 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178828f1-2f96-4404-b3b7-6690bd9f8afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:01.222490 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178828f1-2f96-4404-b3b7-6690bd9f8afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.224207 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178828f1-2f96-4404-b3b7-6690bd9f8afb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.237929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3391a-0436-4906-8784-17d5e888ceec None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.238130 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3391a-0436-4906-8784-17d5e888ceec None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.238376 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3391a-0436-4906-8784-17d5e888ceec None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.240172 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 286/557] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:49:01.240903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 272/558] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:01.246540 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178828f1-2f96-4404-b3b7-6690bd9f8afb admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.246702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcfdcf-6aa6-41ce-a883-09fb612078c5 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.246996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcfdcf-6aa6-41ce-a883-09fb612078c5 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.247325 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcfdcf-6aa6-41ce-a883-09fb612078c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.257137 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178828f1-2f96-4404-b3b7-6690bd9f8afb admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.264787 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f4313-dab0-4498-bfec-08e584a55234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.265631 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f4313-dab0-4498-bfec-08e584a55234 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.265908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f4313-dab0-4498-bfec-08e584a55234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.266240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f4313-dab0-4498-bfec-08e584a55234 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.276453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-a5fcfdcf-6aa6-41ce-a883-09fb612078c5 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:01.277739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a5fcfdcf-6aa6-41ce-a883-09fb612078c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:01.279364 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f4313-dab0-4498-bfec-08e584a55234 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.281672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f4313-dab0-4498-bfec-08e584a55234 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.292489 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 287/559] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:49:01.307097 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-176f4313-dab0-4498-bfec-08e584a55234 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:01.308948 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 273/560] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:01.315752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcfdcf-6aa6-41ce-a883-09fb612078c5 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.325136 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f4313-dab0-4498-bfec-08e584a55234 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.326263 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcfdcf-6aa6-41ce-a883-09fb612078c5 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.335898 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f4313-dab0-4498-bfec-08e584a55234 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.339570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635957d-4103-461a-be9c-21b41ea17794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.340245 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635957d-4103-461a-be9c-21b41ea17794 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.340531 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635957d-4103-461a-be9c-21b41ea17794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.340808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635957d-4103-461a-be9c-21b41ea17794 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.341730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635957d-4103-461a-be9c-21b41ea17794 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:01.342026 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cfd25-ce9f-48cd-8bd7-ffc6416834b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.342152 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635957d-4103-461a-be9c-21b41ea17794 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.343246 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cfd25-ce9f-48cd-8bd7-ffc6416834b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.343747 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cfd25-ce9f-48cd-8bd7-ffc6416834b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.344109 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635957d-4103-461a-be9c-21b41ea17794 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.344579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cfd25-ce9f-48cd-8bd7-ffc6416834b5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.356371 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cfd25-ce9f-48cd-8bd7-ffc6416834b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:01.363933 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-085cfd25-ce9f-48cd-8bd7-ffc6416834b5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:49:01.365694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 274/561] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:01.373221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 288/562] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:01.375478 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cfd25-ce9f-48cd-8bd7-ffc6416834b5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.375868 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635957d-4103-461a-be9c-21b41ea17794 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.384620 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635957d-4103-461a-be9c-21b41ea17794 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.388705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cfd25-ce9f-48cd-8bd7-ffc6416834b5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.394268 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e203c-2e28-4d7d-ad80-ef534f25bc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.394942 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e203c-2e28-4d7d-ad80-ef534f25bc94 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.395268 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e203c-2e28-4d7d-ad80-ef534f25bc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.395550 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e203c-2e28-4d7d-ad80-ef534f25bc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.396310 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e203c-2e28-4d7d-ad80-ef534f25bc94 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:01.396619 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e203c-2e28-4d7d-ad80-ef534f25bc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.398206 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e203c-2e28-4d7d-ad80-ef534f25bc94 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.406520 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e46673-74f8-40eb-9534-5516fcc25393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.407134 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e46673-74f8-40eb-9534-5516fcc25393 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.407427 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e46673-74f8-40eb-9534-5516fcc25393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.407704 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e46673-74f8-40eb-9534-5516fcc25393 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.408731 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e46673-74f8-40eb-9534-5516fcc25393 admin admin] RBAC: Adding query filter params (role.id=2ba23f9ef2de43a6bf86f97ccf919c68, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=0e134083351e4493b2a05bea95233f5c) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:01.409050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e46673-74f8-40eb-9534-5516fcc25393 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.410959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e46673-74f8-40eb-9534-5516fcc25393 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.417650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 289/563] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:01.425799 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e203c-2e28-4d7d-ad80-ef534f25bc94 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.432612 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 275/564] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/role_assignments?user.id=0e134083351e4493b2a05bea95233f5c&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=2ba23f9ef2de43a6bf86f97ccf919c68 => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:01.437648 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e203c-2e28-4d7d-ad80-ef534f25bc94 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.442728 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e7f9f-1fce-4812-b257-c8a9292f7671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.443613 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e7f9f-1fce-4812-b257-c8a9292f7671 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.443898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e7f9f-1fce-4812-b257-c8a9292f7671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.444174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e7f9f-1fce-4812-b257-c8a9292f7671 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.456632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e7f9f-1fce-4812-b257-c8a9292f7671 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.458615 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e7f9f-1fce-4812-b257-c8a9292f7671 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.477178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-f22e7f9f-1fce-4812-b257-c8a9292f7671 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:01.478795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 290/565] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:01.485445 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e46673-74f8-40eb-9534-5516fcc25393 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.496274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e46673-74f8-40eb-9534-5516fcc25393 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.501003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05ee5e-61bb-4aa6-8c77-0f6499596118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.501727 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05ee5e-61bb-4aa6-8c77-0f6499596118 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.502075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05ee5e-61bb-4aa6-8c77-0f6499596118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.502383 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05ee5e-61bb-4aa6-8c77-0f6499596118 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.503184 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05ee5e-61bb-4aa6-8c77-0f6499596118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:01.503584 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05ee5e-61bb-4aa6-8c77-0f6499596118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.505251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05ee5e-61bb-4aa6-8c77-0f6499596118 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.522575 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 276/566] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:01.529166 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e7f9f-1fce-4812-b257-c8a9292f7671 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.541086 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e7f9f-1fce-4812-b257-c8a9292f7671 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.554036 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fef9c-5840-46e8-919f-75d540445916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.554916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fef9c-5840-46e8-919f-75d540445916 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.555224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fef9c-5840-46e8-919f-75d540445916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.555499 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fef9c-5840-46e8-919f-75d540445916 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.565761 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fef9c-5840-46e8-919f-75d540445916 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.568065 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fef9c-5840-46e8-919f-75d540445916 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.583368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-290fef9c-5840-46e8-919f-75d540445916 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 08 10:49:01.584986 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 291/567] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:01.591613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05ee5e-61bb-4aa6-8c77-0f6499596118 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.602914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05ee5e-61bb-4aa6-8c77-0f6499596118 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.608379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0da107-c347-4184-aa72-55f58413a3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.609095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0da107-c347-4184-aa72-55f58413a3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.609375 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0da107-c347-4184-aa72-55f58413a3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.609696 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0da107-c347-4184-aa72-55f58413a3c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.610594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0da107-c347-4184-aa72-55f58413a3c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:01.610940 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0da107-c347-4184-aa72-55f58413a3c0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.613203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0da107-c347-4184-aa72-55f58413a3c0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.634383 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 277/568] 10.222.0.20 () {56 vars in 1156 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:01.641148 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fef9c-5840-46e8-919f-75d540445916 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.653638 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fef9c-5840-46e8-919f-75d540445916 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.658727 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b459a2-87c7-43d7-86a8-158ececce362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.659813 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b459a2-87c7-43d7-86a8-158ececce362 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.660096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b459a2-87c7-43d7-86a8-158ececce362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.660415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b459a2-87c7-43d7-86a8-158ececce362 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.673077 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b459a2-87c7-43d7-86a8-158ececce362 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.675506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b459a2-87c7-43d7-86a8-158ececce362 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.693493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-42b459a2-87c7-43d7-86a8-158ececce362 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:01.695039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 292/569] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:01.701368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0da107-c347-4184-aa72-55f58413a3c0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.712383 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0da107-c347-4184-aa72-55f58413a3c0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.717094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decae15-8b13-4762-9f74-8a0cfec6bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.717820 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decae15-8b13-4762-9f74-8a0cfec6bdcb admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.718099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decae15-8b13-4762-9f74-8a0cfec6bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.718371 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decae15-8b13-4762-9f74-8a0cfec6bdcb admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.719184 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decae15-8b13-4762-9f74-8a0cfec6bdcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:01.719492 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decae15-8b13-4762-9f74-8a0cfec6bdcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.721429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decae15-8b13-4762-9f74-8a0cfec6bdcb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.733640 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 278/570] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:01.741264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b459a2-87c7-43d7-86a8-158ececce362 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.753204 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b459a2-87c7-43d7-86a8-158ececce362 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.762975 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316c93d-b849-4e32-884f-4096d578e535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.763848 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c93d-b849-4e32-884f-4096d578e535 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.764129 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c93d-b849-4e32-884f-4096d578e535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.764469 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c93d-b849-4e32-884f-4096d578e535 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.775053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316c93d-b849-4e32-884f-4096d578e535 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.777199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316c93d-b849-4e32-884f-4096d578e535 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.791928 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-8316c93d-b849-4e32-884f-4096d578e535 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:01.793536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 293/571] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:01.800129 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decae15-8b13-4762-9f74-8a0cfec6bdcb admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.812429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decae15-8b13-4762-9f74-8a0cfec6bdcb admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.817930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb603c-8c71-4909-8e42-a6600d285a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.818594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb603c-8c71-4909-8e42-a6600d285a96 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.818872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb603c-8c71-4909-8e42-a6600d285a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.819192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb603c-8c71-4909-8e42-a6600d285a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.820015 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb603c-8c71-4909-8e42-a6600d285a96 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:01.820324 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb603c-8c71-4909-8e42-a6600d285a96 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.822251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb603c-8c71-4909-8e42-a6600d285a96 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.835737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 279/572] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:01.842524 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316c93d-b849-4e32-884f-4096d578e535 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:01.861451 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316c93d-b849-4e32-884f-4096d578e535 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:01.867298 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493fd63-7e16-45fb-96a7-75c7b906d7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:01.868252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493fd63-7e16-45fb-96a7-75c7b906d7da admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:01.868559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493fd63-7e16-45fb-96a7-75c7b906d7da admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:01.868797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493fd63-7e16-45fb-96a7-75c7b906d7da admin admin] PATH_INFO: `/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/029506cc966a44c9bbe83eb084ac6feb/roles/2ba23f9ef2de43a6bf86f97ccf919c68` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:01.886079 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493fd63-7e16-45fb-96a7-75c7b906d7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ae5e80b1f745dfaedd81a2c0ded718, user_id=029506cc966a44c9bbe83eb084ac6feb, role_id=2ba23f9ef2de43a6bf86f97ccf919c68)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:01.888994 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493fd63-7e16-45fb-96a7-75c7b906d7da admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:01.905437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 294/573] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:49:01 2021] PUT /identity/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/029506cc966a44c9bbe83eb084ac6feb/roles/2ba23f9ef2de43a6bf86f97ccf919c68 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:49:03.529850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9dc2d-38d2-4cbb-a068-9a3168438306 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:03.530555 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9dc2d-38d2-4cbb-a068-9a3168438306 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:03.530555 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9dc2d-38d2-4cbb-a068-9a3168438306 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:03.532599 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 280/574] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:03.537289 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a083-3160-45e0-867a-665834085a56 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:03.537749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a083-3160-45e0-867a-665834085a56 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:03.537822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a083-3160-45e0-867a-665834085a56 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:03.539836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 295/575] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:03.541268 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a97b-6997-4d77-a3ae-638e32688567 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:03.541549 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a97b-6997-4d77-a3ae-638e32688567 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:03.541819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a97b-6997-4d77-a3ae-638e32688567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:03.545338 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7cfa5-b3bc-4f36-9d81-a6f6cc98d54e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:03.545620 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7cfa5-b3bc-4f36-9d81-a6f6cc98d54e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:03.545888 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7cfa5-b3bc-4f36-9d81-a6f6cc98d54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:03.561038 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-66e1a97b-6997-4d77-a3ae-638e32688567 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:03.562228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-66e1a97b-6997-4d77-a3ae-638e32688567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:03.573640 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-e0b7cfa5-b3bc-4f36-9d81-a6f6cc98d54e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:03.579159 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e0b7cfa5-b3bc-4f36-9d81-a6f6cc98d54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:03.621417 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 281/576] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:49:03.647033 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1a97b-6997-4d77-a3ae-638e32688567 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:03.656074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1a97b-6997-4d77-a3ae-638e32688567 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:03.660735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f88bd-ec78-4949-a935-8bba8f7fe08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:03.661547 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f88bd-ec78-4949-a935-8bba8f7fe08c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:03.661827 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f88bd-ec78-4949-a935-8bba8f7fe08c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:03.662097 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f88bd-ec78-4949-a935-8bba8f7fe08c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:03.673492 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f88bd-ec78-4949-a935-8bba8f7fe08c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:03.675657 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f88bd-ec78-4949-a935-8bba8f7fe08c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:03.694300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-a45f88bd-ec78-4949-a935-8bba8f7fe08c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:03.695941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 282/577] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:03.702810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f88bd-ec78-4949-a935-8bba8f7fe08c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:03.704021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 296/578] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:49:03.719935 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f88bd-ec78-4949-a935-8bba8f7fe08c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:03.731053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910e605-ccf3-494c-8ba0-16e15dca0114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:03.731782 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910e605-ccf3-494c-8ba0-16e15dca0114 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:03.732060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910e605-ccf3-494c-8ba0-16e15dca0114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:03.732335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910e605-ccf3-494c-8ba0-16e15dca0114 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:03.733090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910e605-ccf3-494c-8ba0-16e15dca0114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:03.733396 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910e605-ccf3-494c-8ba0-16e15dca0114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:03.735032 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910e605-ccf3-494c-8ba0-16e15dca0114 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:03.751784 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 283/579] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:03.757927 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7cfa5-b3bc-4f36-9d81-a6f6cc98d54e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:03.765192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910e605-ccf3-494c-8ba0-16e15dca0114 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:03.775155 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910e605-ccf3-494c-8ba0-16e15dca0114 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:03.778575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7cfa5-b3bc-4f36-9d81-a6f6cc98d54e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:03.779810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e52382-4b9e-4852-8a80-679c49ceeb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:03.780605 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e52382-4b9e-4852-8a80-679c49ceeb9d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:03.780886 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e52382-4b9e-4852-8a80-679c49ceeb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:03.781152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e52382-4b9e-4852-8a80-679c49ceeb9d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:03.795810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d93c6c-3a2a-497d-904e-775951b7e7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:03.796497 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d93c6c-3a2a-497d-904e-775951b7e7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:03.796779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d93c6c-3a2a-497d-904e-775951b7e7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:03.797054 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d93c6c-3a2a-497d-904e-775951b7e7d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:03.797722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e52382-4b9e-4852-8a80-679c49ceeb9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:03.797849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d93c6c-3a2a-497d-904e-775951b7e7d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:03.799945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d93c6c-3a2a-497d-904e-775951b7e7d4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:03.805413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-41e52382-4b9e-4852-8a80-679c49ceeb9d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:49:03.806926 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 284/580] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:49:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:03.813428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e52382-4b9e-4852-8a80-679c49ceeb9d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:03.825449 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e52382-4b9e-4852-8a80-679c49ceeb9d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:03.830320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38319070-be70-4f45-bf32-eaaac2795946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:03.830929 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38319070-be70-4f45-bf32-eaaac2795946 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:03.831239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38319070-be70-4f45-bf32-eaaac2795946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:03.831578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38319070-be70-4f45-bf32-eaaac2795946 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:03.832342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38319070-be70-4f45-bf32-eaaac2795946 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:03.832643 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38319070-be70-4f45-bf32-eaaac2795946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:03.834301 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38319070-be70-4f45-bf32-eaaac2795946 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:03.843778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 285/581] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:49:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:03.844954 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 297/582] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Nov 8 10:49:03 2021] POST /identity/v3/users => generated 254 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:49:03.862300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858c156-200b-4ade-89aa-8239e3c87d56 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:03.862673 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858c156-200b-4ade-89aa-8239e3c87d56 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:03.862833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858c156-200b-4ade-89aa-8239e3c87d56 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:03.864930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 286/583] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:03.868570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d93c6c-3a2a-497d-904e-775951b7e7d4 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:03.874744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e8832-e06f-4bd5-8a41-30803d1752fa None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:03.874744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e8832-e06f-4bd5-8a41-30803d1752fa None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:03.874744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e8832-e06f-4bd5-8a41-30803d1752fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:03.880862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d93c6c-3a2a-497d-904e-775951b7e7d4 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:03.886177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741de16-227e-4cc0-ba2a-a4faed881b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:03.887268 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741de16-227e-4cc0-ba2a-a4faed881b8c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:03.887757 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741de16-227e-4cc0-ba2a-a4faed881b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:03.888395 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741de16-227e-4cc0-ba2a-a4faed881b8c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:03.904321 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-df6e8832-e06f-4bd5-8a41-30803d1752fa None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:03.908368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-df6e8832-e06f-4bd5-8a41-30803d1752fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:03.916118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741de16-227e-4cc0-ba2a-a4faed881b8c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:03.920713 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741de16-227e-4cc0-ba2a-a4faed881b8c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:03.936279 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 287/584] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:49:03.958938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-f741de16-227e-4cc0-ba2a-a4faed881b8c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:03.965756 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 298/585] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:03.967670 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e8832-e06f-4bd5-8a41-30803d1752fa None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:03.978959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741de16-227e-4cc0-ba2a-a4faed881b8c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:03.989715 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e8832-e06f-4bd5-8a41-30803d1752fa None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:03.992316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741de16-227e-4cc0-ba2a-a4faed881b8c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:04.001561 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd9544-5209-4e94-9ef1-4572bb7b097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.002938 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48b4f1-5f62-42a9-a1bf-c83c1c03c6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.004258 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd9544-5209-4e94-9ef1-4572bb7b097d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.005236 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48b4f1-5f62-42a9-a1bf-c83c1c03c6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.005722 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd9544-5209-4e94-9ef1-4572bb7b097d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.006192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48b4f1-5f62-42a9-a1bf-c83c1c03c6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.006700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd9544-5209-4e94-9ef1-4572bb7b097d admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.007226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48b4f1-5f62-42a9-a1bf-c83c1c03c6e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.008919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd9544-5209-4e94-9ef1-4572bb7b097d admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.009603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48b4f1-5f62-42a9-a1bf-c83c1c03c6e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:04.010513 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48b4f1-5f62-42a9-a1bf-c83c1c03c6e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.011250 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-2fdd9544-5209-4e94-9ef1-4572bb7b097d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:49:04.011250 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:49:04.011250 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:49:04.013307 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd9544-5209-4e94-9ef1-4572bb7b097d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.014459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48b4f1-5f62-42a9-a1bf-c83c1c03c6e5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.040906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 288/586] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:04.042682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-2fdd9544-5209-4e94-9ef1-4572bb7b097d admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 08 10:49:04.050052 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48b4f1-5f62-42a9-a1bf-c83c1c03c6e5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:04.051353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 299/587] 10.222.0.20 () {56 vars in 1150 bytes} [Mon Nov 8 10:49:03 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:04.060199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd9544-5209-4e94-9ef1-4572bb7b097d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:04.071019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48b4f1-5f62-42a9-a1bf-c83c1c03c6e5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:04.073158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd9544-5209-4e94-9ef1-4572bb7b097d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:04.078373 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be71ac-75fe-4e0a-9128-e7e86f7f37ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.079453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be71ac-75fe-4e0a-9128-e7e86f7f37ca admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.079936 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be71ac-75fe-4e0a-9128-e7e86f7f37ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.080637 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be71ac-75fe-4e0a-9128-e7e86f7f37ca admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.081991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be71ac-75fe-4e0a-9128-e7e86f7f37ca admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:04.082506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be71ac-75fe-4e0a-9128-e7e86f7f37ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.083797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-f8be71ac-75fe-4e0a-9128-e7e86f7f37ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:49:04.083797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:49:04.083797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:49:04.085525 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be71ac-75fe-4e0a-9128-e7e86f7f37ca admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.088608 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f0a1-fb81-490a-a8a4-70ad575ecab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.090392 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f0a1-fb81-490a-a8a4-70ad575ecab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.091226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f0a1-fb81-490a-a8a4-70ad575ecab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.091908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f0a1-fb81-490a-a8a4-70ad575ecab5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.094584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 300/588] 10.222.0.20 () {56 vars in 1145 bytes} [Mon Nov 8 10:49:04 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:04.104559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be71ac-75fe-4e0a-9128-e7e86f7f37ca admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:04.117060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814f0a1-fb81-490a-a8a4-70ad575ecab5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.119588 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814f0a1-fb81-490a-a8a4-70ad575ecab5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.120355 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be71ac-75fe-4e0a-9128-e7e86f7f37ca admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:04.127339 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9b1e-b8f4-410a-b582-503c60f28d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.128252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9b1e-b8f4-410a-b582-503c60f28d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.128632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9b1e-b8f4-410a-b582-503c60f28d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.128913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9b1e-b8f4-410a-b582-503c60f28d54 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.129767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9b1e-b8f4-410a-b582-503c60f28d54 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:04.130072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9b1e-b8f4-410a-b582-503c60f28d54 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.132103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9b1e-b8f4-410a-b582-503c60f28d54 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.136849 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-a814f0a1-fb81-490a-a8a4-70ad575ecab5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 08 10:49:04.138213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 289/589] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Nov 8 10:49:04 2021] GET /identity/v3/users/nova => generated 82 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:04.138872 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 301/590] 10.222.0.20 () {56 vars in 1145 bytes} [Mon Nov 8 10:49:04 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:04.148367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f0a1-fb81-490a-a8a4-70ad575ecab5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:04.161344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f0a1-fb81-490a-a8a4-70ad575ecab5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:04.177033 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a08c3-d036-44f0-82d4-3f9d7104e3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.177741 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a08c3-d036-44f0-82d4-3f9d7104e3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.178020 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a08c3-d036-44f0-82d4-3f9d7104e3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.178292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a08c3-d036-44f0-82d4-3f9d7104e3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.179201 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a08c3-d036-44f0-82d4-3f9d7104e3a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:04.179508 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a08c3-d036-44f0-82d4-3f9d7104e3a1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.181438 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a08c3-d036-44f0-82d4-3f9d7104e3a1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.207689 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 290/591] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Nov 8 10:49:04 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:04.214170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9b1e-b8f4-410a-b582-503c60f28d54 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:04.233178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9b1e-b8f4-410a-b582-503c60f28d54 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:04.239319 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da8c48-1b58-41e9-85c4-5361587ae051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.240332 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8c48-1b58-41e9-85c4-5361587ae051 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.240810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8c48-1b58-41e9-85c4-5361587ae051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.241272 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8c48-1b58-41e9-85c4-5361587ae051 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.250391 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da8c48-1b58-41e9-85c4-5361587ae051 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.252912 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da8c48-1b58-41e9-85c4-5361587ae051 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.264054 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 302/592] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:49:04.273388 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a08c3-d036-44f0-82d4-3f9d7104e3a1 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:04.289585 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a08c3-d036-44f0-82d4-3f9d7104e3a1 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:04.300694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df25e78-57b2-485c-be86-d6113f6f3e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.301535 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df25e78-57b2-485c-be86-d6113f6f3e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.301812 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df25e78-57b2-485c-be86-d6113f6f3e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.302078 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df25e78-57b2-485c-be86-d6113f6f3e99 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.317481 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df25e78-57b2-485c-be86-d6113f6f3e99 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.319360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df25e78-57b2-485c-be86-d6113f6f3e99 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.337241 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-3df25e78-57b2-485c-be86-d6113f6f3e99 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:04.338865 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 291/593] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:04.345200 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da8c48-1b58-41e9-85c4-5361587ae051 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:04.357784 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da8c48-1b58-41e9-85c4-5361587ae051 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:04.366017 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8f48a-079f-499d-bb86-e416e755caee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.366795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8f48a-079f-499d-bb86-e416e755caee admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.367156 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8f48a-079f-499d-bb86-e416e755caee admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.367510 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8f48a-079f-499d-bb86-e416e755caee admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.368352 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8f48a-079f-499d-bb86-e416e755caee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:04.368737 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8f48a-079f-499d-bb86-e416e755caee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.370412 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8f48a-079f-499d-bb86-e416e755caee admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.388796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 303/594] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:04.395773 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df25e78-57b2-485c-be86-d6113f6f3e99 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:04.413153 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df25e78-57b2-485c-be86-d6113f6f3e99 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:04.421511 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73367812-28f6-4e3f-a570-838f75c69c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.422693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73367812-28f6-4e3f-a570-838f75c69c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.423192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73367812-28f6-4e3f-a570-838f75c69c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.423692 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73367812-28f6-4e3f-a570-838f75c69c11 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.434541 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73367812-28f6-4e3f-a570-838f75c69c11 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.436879 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73367812-28f6-4e3f-a570-838f75c69c11 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.453473 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-73367812-28f6-4e3f-a570-838f75c69c11 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:04.455390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 292/595] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:04.462023 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8f48a-079f-499d-bb86-e416e755caee admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:04.476187 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a414acf-9d37-4f0b-b994-0eb1abc7198f None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.476563 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a414acf-9d37-4f0b-b994-0eb1abc7198f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.476914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a414acf-9d37-4f0b-b994-0eb1abc7198f None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.478918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 293/596] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:04.481018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8f48a-079f-499d-bb86-e416e755caee admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:04.485000 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316008f-22d9-444f-9a70-eedef9f67af2 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.485231 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316008f-22d9-444f-9a70-eedef9f67af2 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.485508 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316008f-22d9-444f-9a70-eedef9f67af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.496898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d37168-c244-4076-8b23-a53d41b686ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.497577 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d37168-c244-4076-8b23-a53d41b686ca admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.497878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d37168-c244-4076-8b23-a53d41b686ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.498107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d37168-c244-4076-8b23-a53d41b686ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.498929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d37168-c244-4076-8b23-a53d41b686ca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:04.499262 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d37168-c244-4076-8b23-a53d41b686ca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.501074 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d37168-c244-4076-8b23-a53d41b686ca admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.507424 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-2316008f-22d9-444f-9a70-eedef9f67af2 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:04.508932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2316008f-22d9-444f-9a70-eedef9f67af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:04.519085 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 294/597] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 08 10:49:04.523585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 304/598] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:04.530805 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316008f-22d9-444f-9a70-eedef9f67af2 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:04.543073 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316008f-22d9-444f-9a70-eedef9f67af2 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:04.547269 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d37168-c244-4076-8b23-a53d41b686ca admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:04.560958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2540744-1e8a-44d4-9937-5f5594c835eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.561738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d37168-c244-4076-8b23-a53d41b686ca admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:04.562456 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2540744-1e8a-44d4-9937-5f5594c835eb admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.563681 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2540744-1e8a-44d4-9937-5f5594c835eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.564191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2540744-1e8a-44d4-9937-5f5594c835eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.565807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2540744-1e8a-44d4-9937-5f5594c835eb admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=d3421cf1bbb24423a2f24c4667adfdda) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:04.566789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2540744-1e8a-44d4-9937-5f5594c835eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.571243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2540744-1e8a-44d4-9937-5f5594c835eb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.572582 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f3ac0-7840-4d54-b06d-57a20152ca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.574318 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f3ac0-7840-4d54-b06d-57a20152ca12 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.576377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f3ac0-7840-4d54-b06d-57a20152ca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.576907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f3ac0-7840-4d54-b06d-57a20152ca12 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.577819 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f3ac0-7840-4d54-b06d-57a20152ca12 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.581144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f3ac0-7840-4d54-b06d-57a20152ca12 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.586506 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 295/599] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:04 2021] GET /identity/v3/role_assignments?user.id=d3421cf1bbb24423a2f24c4667adfdda&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 259 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:04.596847 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-168f3ac0-7840-4d54-b06d-57a20152ca12 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 08 10:49:04.598865 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 305/600] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:04 2021] GET /identity/v3/services/network => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:04.608558 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2540744-1e8a-44d4-9937-5f5594c835eb admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:04.622068 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2540744-1e8a-44d4-9937-5f5594c835eb admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:04.626833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408080c8-d1fc-4699-ba5d-64125ce2ebe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.627720 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408080c8-d1fc-4699-ba5d-64125ce2ebe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.628006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408080c8-d1fc-4699-ba5d-64125ce2ebe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.628335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408080c8-d1fc-4699-ba5d-64125ce2ebe8 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.629079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408080c8-d1fc-4699-ba5d-64125ce2ebe8 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:04.629451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408080c8-d1fc-4699-ba5d-64125ce2ebe8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.630482 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-408080c8-d1fc-4699-ba5d-64125ce2ebe8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:49:04.630482 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:49:04.630482 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:49:04.631498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408080c8-d1fc-4699-ba5d-64125ce2ebe8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.637118 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 296/601] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Nov 8 10:49:04 2021] GET /identity/v3/services?name=network => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:04.643879 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f3ac0-7840-4d54-b06d-57a20152ca12 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:04.657105 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f3ac0-7840-4d54-b06d-57a20152ca12 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:04.673195 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ecc64-e502-4c9b-bd87-b21ec940a12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:04.674352 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ecc64-e502-4c9b-bd87-b21ec940a12f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.674899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ecc64-e502-4c9b-bd87-b21ec940a12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.675404 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ecc64-e502-4c9b-bd87-b21ec940a12f admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.676389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ecc64-e502-4c9b-bd87-b21ec940a12f admin admin] RBAC: Adding query filter params (type=network) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:04.676903 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ecc64-e502-4c9b-bd87-b21ec940a12f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:04.678887 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ecc64-e502-4c9b-bd87-b21ec940a12f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:04.684896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 306/602] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Nov 8 10:49:04 2021] GET /identity/v3/services?type=network => generated 124 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:04.903471 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95560d-deaf-4191-bcf1-ae5684862267 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.903814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95560d-deaf-4191-bcf1-ae5684862267 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.904039 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95560d-deaf-4191-bcf1-ae5684862267 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.906579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 297/603] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:04.913148 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b678b6-fc93-4a1b-a97c-724fdd5f5d51 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:04.913707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b678b6-fc93-4a1b-a97c-724fdd5f5d51 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:04.914174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b678b6-fc93-4a1b-a97c-724fdd5f5d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:04.942443 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-89b678b6-fc93-4a1b-a97c-724fdd5f5d51 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:04.944070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-89b678b6-fc93-4a1b-a97c-724fdd5f5d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:04.952493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 307/604] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:49:04.990691 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95560d-deaf-4191-bcf1-ae5684862267 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:05.004979 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95560d-deaf-4191-bcf1-ae5684862267 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:05.009264 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce750ed6-4961-474a-bb34-ca390446de60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:05.010063 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce750ed6-4961-474a-bb34-ca390446de60 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:05.010342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce750ed6-4961-474a-bb34-ca390446de60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:05.010610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce750ed6-4961-474a-bb34-ca390446de60 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:05.022045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce750ed6-4961-474a-bb34-ca390446de60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:05.028976 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-ce750ed6-4961-474a-bb34-ca390446de60 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:49:05.030545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 298/605] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:49:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:05.037264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b678b6-fc93-4a1b-a97c-724fdd5f5d51 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:05.051171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b678b6-fc93-4a1b-a97c-724fdd5f5d51 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:05.056291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da834983-22ad-4d2d-9e6a-977af738abbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:05.057187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da834983-22ad-4d2d-9e6a-977af738abbe admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:05.057682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da834983-22ad-4d2d-9e6a-977af738abbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:05.058147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da834983-22ad-4d2d-9e6a-977af738abbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:05.059142 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da834983-22ad-4d2d-9e6a-977af738abbe admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:05.059640 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da834983-22ad-4d2d-9e6a-977af738abbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:05.061421 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da834983-22ad-4d2d-9e6a-977af738abbe admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:05.075151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 308/606] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:49:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:05.077247 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce750ed6-4961-474a-bb34-ca390446de60 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:05.093677 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce750ed6-4961-474a-bb34-ca390446de60 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:05.103857 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e78ea-49b2-45b1-a663-6a9898ac8330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:05.104661 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e78ea-49b2-45b1-a663-6a9898ac8330 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:05.104942 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e78ea-49b2-45b1-a663-6a9898ac8330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:05.105215 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e78ea-49b2-45b1-a663-6a9898ac8330 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:05.116633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e78ea-49b2-45b1-a663-6a9898ac8330 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:05.118588 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e78ea-49b2-45b1-a663-6a9898ac8330 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:05.135646 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-264e78ea-49b2-45b1-a663-6a9898ac8330 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:05.137137 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 299/607] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:05.143929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da834983-22ad-4d2d-9e6a-977af738abbe admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:05.156135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da834983-22ad-4d2d-9e6a-977af738abbe admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:05.160740 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333281d3-6d4e-4958-89db-c5c62ba7b658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:05.161456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333281d3-6d4e-4958-89db-c5c62ba7b658 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:05.161735 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333281d3-6d4e-4958-89db-c5c62ba7b658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:05.162006 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333281d3-6d4e-4958-89db-c5c62ba7b658 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:05.162796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333281d3-6d4e-4958-89db-c5c62ba7b658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:05.163103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333281d3-6d4e-4958-89db-c5c62ba7b658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:05.164870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333281d3-6d4e-4958-89db-c5c62ba7b658 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:05.184856 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 309/608] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:05.191239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e78ea-49b2-45b1-a663-6a9898ac8330 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:05.205657 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e78ea-49b2-45b1-a663-6a9898ac8330 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:05.210205 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672b70e-7d28-4d59-954c-ef5a7d00008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:05.211056 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672b70e-7d28-4d59-954c-ef5a7d00008a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:05.211368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672b70e-7d28-4d59-954c-ef5a7d00008a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:05.211680 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672b70e-7d28-4d59-954c-ef5a7d00008a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:05.223832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672b70e-7d28-4d59-954c-ef5a7d00008a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:05.225923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672b70e-7d28-4d59-954c-ef5a7d00008a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:05.240663 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-e672b70e-7d28-4d59-954c-ef5a7d00008a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 08 10:49:05.242176 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 300/609] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:49:05 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:05.248527 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333281d3-6d4e-4958-89db-c5c62ba7b658 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:05.264314 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333281d3-6d4e-4958-89db-c5c62ba7b658 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:05.269470 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb27454-b46b-458f-98c0-87b1203ffb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:05.270192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27454-b46b-458f-98c0-87b1203ffb30 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:05.270509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27454-b46b-458f-98c0-87b1203ffb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:05.270792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27454-b46b-458f-98c0-87b1203ffb30 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:05.271723 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb27454-b46b-458f-98c0-87b1203ffb30 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:05.272028 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb27454-b46b-458f-98c0-87b1203ffb30 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:05.273928 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb27454-b46b-458f-98c0-87b1203ffb30 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:05.297342 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 310/610] 10.222.0.20 () {56 vars in 1156 bytes} [Mon Nov 8 10:49:05 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:05.303834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672b70e-7d28-4d59-954c-ef5a7d00008a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:05.313951 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672b70e-7d28-4d59-954c-ef5a7d00008a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:05.326123 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edffe7e-eb84-48bd-82d0-f572467ec571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:05.326838 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edffe7e-eb84-48bd-82d0-f572467ec571 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:05.327148 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edffe7e-eb84-48bd-82d0-f572467ec571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:05.327413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edffe7e-eb84-48bd-82d0-f572467ec571 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:05.336607 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edffe7e-eb84-48bd-82d0-f572467ec571 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:05.338435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edffe7e-eb84-48bd-82d0-f572467ec571 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:05.352942 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 301/611] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:49:05.359516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb27454-b46b-458f-98c0-87b1203ffb30 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:05.369738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb27454-b46b-458f-98c0-87b1203ffb30 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:05.374181 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe73631-02b6-4ea2-a874-b876ea62fdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:05.374981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe73631-02b6-4ea2-a874-b876ea62fdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:05.375323 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe73631-02b6-4ea2-a874-b876ea62fdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:05.375600 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe73631-02b6-4ea2-a874-b876ea62fdf5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:05.386512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe73631-02b6-4ea2-a874-b876ea62fdf5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:05.388450 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe73631-02b6-4ea2-a874-b876ea62fdf5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:05.405867 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-bfe73631-02b6-4ea2-a874-b876ea62fdf5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:05.407446 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 311/612] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:05.414003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edffe7e-eb84-48bd-82d0-f572467ec571 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:05.423156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edffe7e-eb84-48bd-82d0-f572467ec571 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:05.427842 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97136cd2-1f25-451a-977b-13db4ed54662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:05.428541 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97136cd2-1f25-451a-977b-13db4ed54662 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:05.428816 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97136cd2-1f25-451a-977b-13db4ed54662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:05.429082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97136cd2-1f25-451a-977b-13db4ed54662 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:05.429877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97136cd2-1f25-451a-977b-13db4ed54662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:05.430181 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97136cd2-1f25-451a-977b-13db4ed54662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:05.431820 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97136cd2-1f25-451a-977b-13db4ed54662 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:05.444283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 302/613] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:05.450516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe73631-02b6-4ea2-a874-b876ea62fdf5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:05.477142 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe73631-02b6-4ea2-a874-b876ea62fdf5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:05.492302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bfdbf-c740-4d45-bbfb-0072bafd85a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:05.493114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bfdbf-c740-4d45-bbfb-0072bafd85a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:05.493400 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bfdbf-c740-4d45-bbfb-0072bafd85a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:05.493679 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bfdbf-c740-4d45-bbfb-0072bafd85a3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:05.502422 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bfdbf-c740-4d45-bbfb-0072bafd85a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:05.504525 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bfdbf-c740-4d45-bbfb-0072bafd85a3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:05.523065 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-3d5bfdbf-c740-4d45-bbfb-0072bafd85a3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:05.524585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 312/614] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:05.531189 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97136cd2-1f25-451a-977b-13db4ed54662 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:05.551635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97136cd2-1f25-451a-977b-13db4ed54662 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:05.561585 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37002cd-7f59-4f3a-8d6a-41918f883bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:05.562332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37002cd-7f59-4f3a-8d6a-41918f883bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:05.562620 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37002cd-7f59-4f3a-8d6a-41918f883bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:05.562901 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37002cd-7f59-4f3a-8d6a-41918f883bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:05.563743 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37002cd-7f59-4f3a-8d6a-41918f883bc0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:05.564057 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37002cd-7f59-4f3a-8d6a-41918f883bc0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:05.566139 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37002cd-7f59-4f3a-8d6a-41918f883bc0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:05.592494 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 303/615] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:05.599456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bfdbf-c740-4d45-bbfb-0072bafd85a3 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:05.610285 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bfdbf-c740-4d45-bbfb-0072bafd85a3 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:05.622799 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007be6c5-c7d3-4953-9f5d-d4f93ed6fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:05.623504 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007be6c5-c7d3-4953-9f5d-d4f93ed6fd09 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:05.623787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007be6c5-c7d3-4953-9f5d-d4f93ed6fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:05.624089 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007be6c5-c7d3-4953-9f5d-d4f93ed6fd09 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:05.624909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007be6c5-c7d3-4953-9f5d-d4f93ed6fd09 admin admin] RBAC: Adding query filter params (role.id=2ba23f9ef2de43a6bf86f97ccf919c68, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=029506cc966a44c9bbe83eb084ac6feb) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:05.625214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007be6c5-c7d3-4953-9f5d-d4f93ed6fd09 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:05.627216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007be6c5-c7d3-4953-9f5d-d4f93ed6fd09 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:05.633782 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 313/616] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:05 2021] GET /identity/v3/role_assignments?user.id=029506cc966a44c9bbe83eb084ac6feb&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=2ba23f9ef2de43a6bf86f97ccf919c68 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:06.715651 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73723496-cfa7-42de-b35b-5915b7bd4c97 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:06.716239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73723496-cfa7-42de-b35b-5915b7bd4c97 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:06.716239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73723496-cfa7-42de-b35b-5915b7bd4c97 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:06.718235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 304/617] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:06.724590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a43b9f-2b0c-48c2-8480-7f3cae847607 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:06.725046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a43b9f-2b0c-48c2-8480-7f3cae847607 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:06.725120 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a43b9f-2b0c-48c2-8480-7f3cae847607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:06.747431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-c2a43b9f-2b0c-48c2-8480-7f3cae847607 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:06.748886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c2a43b9f-2b0c-48c2-8480-7f3cae847607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:06.763841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 314/618] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:49:06.805094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73723496-cfa7-42de-b35b-5915b7bd4c97 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:06.821455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73723496-cfa7-42de-b35b-5915b7bd4c97 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:06.831529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c7867-8c7c-4060-926e-14db542aa28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:06.832671 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7867-8c7c-4060-926e-14db542aa28d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:06.833152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7867-8c7c-4060-926e-14db542aa28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:06.833616 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7867-8c7c-4060-926e-14db542aa28d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:06.849324 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c7867-8c7c-4060-926e-14db542aa28d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:06.856418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-957c7867-8c7c-4060-926e-14db542aa28d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:49:06.857864 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 305/619] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:49:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:06.864515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a43b9f-2b0c-48c2-8480-7f3cae847607 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:06.878574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a43b9f-2b0c-48c2-8480-7f3cae847607 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:06.893034 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607fb01-6ab9-403f-8f5c-f7dbd4f1834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:06.893710 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607fb01-6ab9-403f-8f5c-f7dbd4f1834c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:06.893989 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607fb01-6ab9-403f-8f5c-f7dbd4f1834c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:06.894260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607fb01-6ab9-403f-8f5c-f7dbd4f1834c admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:06.895031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607fb01-6ab9-403f-8f5c-f7dbd4f1834c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:06.895361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607fb01-6ab9-403f-8f5c-f7dbd4f1834c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:06.896962 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607fb01-6ab9-403f-8f5c-f7dbd4f1834c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:06.906142 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 315/620] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:49:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:06.912379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c7867-8c7c-4060-926e-14db542aa28d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:06.926612 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c7867-8c7c-4060-926e-14db542aa28d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:06.936614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7b626-4c76-4834-a42b-63fb4c56dd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:06.937855 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7b626-4c76-4834-a42b-63fb4c56dd72 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:06.938330 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7b626-4c76-4834-a42b-63fb4c56dd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:06.938806 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7b626-4c76-4834-a42b-63fb4c56dd72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:06.945546 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54328a-97f2-4281-b962-1562e281e7c5 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:06.945839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54328a-97f2-4281-b962-1562e281e7c5 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:06.946121 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54328a-97f2-4281-b962-1562e281e7c5 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:06.948202 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 316/621] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:49:06.953900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a327-a0ad-45a1-af25-77910c64ba00 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:06.954194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a327-a0ad-45a1-af25-77910c64ba00 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:06.954480 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a327-a0ad-45a1-af25-77910c64ba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:06.957326 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7b626-4c76-4834-a42b-63fb4c56dd72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:06.959636 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7b626-4c76-4834-a42b-63fb4c56dd72 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:06.985072 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-b1b7b626-4c76-4834-a42b-63fb4c56dd72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:06.990924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-4495a327-a0ad-45a1-af25-77910c64ba00 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:06.992374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4495a327-a0ad-45a1-af25-77910c64ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:06.993734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 306/622] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:06.995823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7b626-4c76-4834-a42b-63fb4c56dd72 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.008931 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 317/623] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 08 10:49:07.010294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7b626-4c76-4834-a42b-63fb4c56dd72 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.028381 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f67be-f359-4e20-961f-3d6655ce4991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.029391 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f67be-f359-4e20-961f-3d6655ce4991 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.029889 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f67be-f359-4e20-961f-3d6655ce4991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.030379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f67be-f359-4e20-961f-3d6655ce4991 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.031424 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f67be-f359-4e20-961f-3d6655ce4991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:07.031943 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f67be-f359-4e20-961f-3d6655ce4991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.033838 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f67be-f359-4e20-961f-3d6655ce4991 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.035742 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495a327-a0ad-45a1-af25-77910c64ba00 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.049101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 307/624] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:07.052389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495a327-a0ad-45a1-af25-77910c64ba00 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.055116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f67be-f359-4e20-961f-3d6655ce4991 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.057147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18429f-2db7-4d98-b051-47c3cb7539ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.058069 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18429f-2db7-4d98-b051-47c3cb7539ae admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.058672 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18429f-2db7-4d98-b051-47c3cb7539ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.059200 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18429f-2db7-4d98-b051-47c3cb7539ae admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.060206 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18429f-2db7-4d98-b051-47c3cb7539ae admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.061451 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-6d18429f-2db7-4d98-b051-47c3cb7539ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:49:07.061451 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:49:07.061451 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:49:07.062742 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18429f-2db7-4d98-b051-47c3cb7539ae admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.068583 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f67be-f359-4e20-961f-3d6655ce4991 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.073652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f76d56-3cda-49e3-b5d1-36e937a91b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.074821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f76d56-3cda-49e3-b5d1-36e937a91b7a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.075471 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f76d56-3cda-49e3-b5d1-36e937a91b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.076011 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f76d56-3cda-49e3-b5d1-36e937a91b7a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.089739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 318/625] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Nov 8 10:49:07 2021] POST /identity/v3/services => generated 251 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 10:49:07.093332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f76d56-3cda-49e3-b5d1-36e937a91b7a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.095845 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f76d56-3cda-49e3-b5d1-36e937a91b7a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.112671 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-b4f76d56-3cda-49e3-b5d1-36e937a91b7a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 08 10:49:07.114693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 308/626] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:07.121907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18429f-2db7-4d98-b051-47c3cb7539ae admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.168676 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18429f-2db7-4d98-b051-47c3cb7539ae admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.174182 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306e6a2-e772-49a1-b7b0-88cd00b1cd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.175810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306e6a2-e772-49a1-b7b0-88cd00b1cd94 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.176345 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306e6a2-e772-49a1-b7b0-88cd00b1cd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.176792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306e6a2-e772-49a1-b7b0-88cd00b1cd94 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.177897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306e6a2-e772-49a1-b7b0-88cd00b1cd94 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:07.178380 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306e6a2-e772-49a1-b7b0-88cd00b1cd94 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.180502 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306e6a2-e772-49a1-b7b0-88cd00b1cd94 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.211039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 319/627] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:07.217554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f76d56-3cda-49e3-b5d1-36e937a91b7a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.228615 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f76d56-3cda-49e3-b5d1-36e937a91b7a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.235366 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f72f39-e66c-44e1-827d-0986ec58945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.236365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f72f39-e66c-44e1-827d-0986ec58945f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.237536 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f72f39-e66c-44e1-827d-0986ec58945f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.237990 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f72f39-e66c-44e1-827d-0986ec58945f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.251447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f72f39-e66c-44e1-827d-0986ec58945f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.254372 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f72f39-e66c-44e1-827d-0986ec58945f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.270452 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 309/628] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/auth/tokens => generated 1018 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:49:07.276586 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306e6a2-e772-49a1-b7b0-88cd00b1cd94 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.288504 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306e6a2-e772-49a1-b7b0-88cd00b1cd94 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.296845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d35a9-e436-4e6c-9a36-3bd2b9d8b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.297745 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d35a9-e436-4e6c-9a36-3bd2b9d8b65c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.298100 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d35a9-e436-4e6c-9a36-3bd2b9d8b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.298455 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d35a9-e436-4e6c-9a36-3bd2b9d8b65c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.299957 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3dc6-6d79-434e-82c0-9437be4b34ab None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.300428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3dc6-6d79-434e-82c0-9437be4b34ab None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.300910 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3dc6-6d79-434e-82c0-9437be4b34ab None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.303138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 310/629] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:07.308921 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f4c5a-39c5-476f-8514-4786483f48d1 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.309451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f4c5a-39c5-476f-8514-4786483f48d1 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.309888 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f4c5a-39c5-476f-8514-4786483f48d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.310880 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d35a9-e436-4e6c-9a36-3bd2b9d8b65c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.312971 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d35a9-e436-4e6c-9a36-3bd2b9d8b65c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.331395 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-689d35a9-e436-4e6c-9a36-3bd2b9d8b65c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:07.333092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 320/630] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:07.339383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d35a9-e436-4e6c-9a36-3bd2b9d8b65c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.340401 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-de6f4c5a-39c5-476f-8514-4786483f48d1 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:07.341882 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-de6f4c5a-39c5-476f-8514-4786483f48d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:07.351470 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 311/631] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:07 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:07.353302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d35a9-e436-4e6c-9a36-3bd2b9d8b65c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.368326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bbeb6-6742-496d-9e39-9c562c6faaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.369458 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bbeb6-6742-496d-9e39-9c562c6faaed admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.369936 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bbeb6-6742-496d-9e39-9c562c6faaed admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.370454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bbeb6-6742-496d-9e39-9c562c6faaed admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.371486 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459bbeb6-6742-496d-9e39-9c562c6faaed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:07.371987 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459bbeb6-6742-496d-9e39-9c562c6faaed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.374893 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f4c5a-39c5-476f-8514-4786483f48d1 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.381150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459bbeb6-6742-496d-9e39-9c562c6faaed admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.388548 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f4c5a-39c5-476f-8514-4786483f48d1 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.399561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d766-89b0-413d-a8ef-c0cf62f3338a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.400823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d766-89b0-413d-a8ef-c0cf62f3338a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.402733 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d766-89b0-413d-a8ef-c0cf62f3338a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.403256 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d766-89b0-413d-a8ef-c0cf62f3338a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.412546 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 321/632] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:07.419230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bbeb6-6742-496d-9e39-9c562c6faaed admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.424337 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8d766-89b0-413d-a8ef-c0cf62f3338a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:07.431469 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bbeb6-6742-496d-9e39-9c562c6faaed admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.434113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-2dd8d766-89b0-413d-a8ef-c0cf62f3338a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:49:07.435187 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 312/633] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:07.438111 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0c4c1-b686-4ed9-b525-f7d825133b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.439388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0c4c1-b686-4ed9-b525-f7d825133b25 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.440514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0c4c1-b686-4ed9-b525-f7d825133b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.440952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0c4c1-b686-4ed9-b525-f7d825133b25 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.444526 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d766-89b0-413d-a8ef-c0cf62f3338a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.448452 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0c4c1-b686-4ed9-b525-f7d825133b25 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.450425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0c4c1-b686-4ed9-b525-f7d825133b25 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.462114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d766-89b0-413d-a8ef-c0cf62f3338a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.469112 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0f652-d338-45fe-9ad2-575a536a4768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.469768 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0f652-d338-45fe-9ad2-575a536a4768 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.470059 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0f652-d338-45fe-9ad2-575a536a4768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.470320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0f652-d338-45fe-9ad2-575a536a4768 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.471596 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0f652-d338-45fe-9ad2-575a536a4768 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:07.471904 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0f652-d338-45fe-9ad2-575a536a4768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.473538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0f652-d338-45fe-9ad2-575a536a4768 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.476501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-c6e0c4c1-b686-4ed9-b525-f7d825133b25 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:07.478284 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 322/634] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:07.487240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 313/635] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:07.487417 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0c4c1-b686-4ed9-b525-f7d825133b25 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.491339 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0f652-d338-45fe-9ad2-575a536a4768 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.496242 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0c4c1-b686-4ed9-b525-f7d825133b25 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.505472 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9846383-94c2-47a8-8010-ae2e87adbda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.505686 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0f652-d338-45fe-9ad2-575a536a4768 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.506205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9846383-94c2-47a8-8010-ae2e87adbda3 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.506590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9846383-94c2-47a8-8010-ae2e87adbda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.506974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9846383-94c2-47a8-8010-ae2e87adbda3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.508171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9846383-94c2-47a8-8010-ae2e87adbda3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:07.508613 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9846383-94c2-47a8-8010-ae2e87adbda3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.510220 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6f7b3-cce9-4d88-85f7-9cfd3c81f890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.510958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9846383-94c2-47a8-8010-ae2e87adbda3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.511065 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6f7b3-cce9-4d88-85f7-9cfd3c81f890 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.511332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6f7b3-cce9-4d88-85f7-9cfd3c81f890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.511604 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6f7b3-cce9-4d88-85f7-9cfd3c81f890 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.527161 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6f7b3-cce9-4d88-85f7-9cfd3c81f890 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.528259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 323/636] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:07.529404 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6f7b3-cce9-4d88-85f7-9cfd3c81f890 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.536607 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9846383-94c2-47a8-8010-ae2e87adbda3 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.550084 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9846383-94c2-47a8-8010-ae2e87adbda3 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.553033 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-daa6f7b3-cce9-4d88-85f7-9cfd3c81f890 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:07.554792 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 314/637] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:07.555409 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a593f2-3637-46d6-a500-9f17b1d29f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.556177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a593f2-3637-46d6-a500-9f17b1d29f18 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.556462 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a593f2-3637-46d6-a500-9f17b1d29f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.556738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a593f2-3637-46d6-a500-9f17b1d29f18 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.557633 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a593f2-3637-46d6-a500-9f17b1d29f18 admin admin] RBAC: Adding query filter params (role.id=2ba23f9ef2de43a6bf86f97ccf919c68, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=f9fc539f38364a648b9a4c25d3dbea8c) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:07.557947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a593f2-3637-46d6-a500-9f17b1d29f18 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.560481 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a593f2-3637-46d6-a500-9f17b1d29f18 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.561538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6f7b3-cce9-4d88-85f7-9cfd3c81f890 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.568623 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 324/638] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/role_assignments?user.id=f9fc539f38364a648b9a4c25d3dbea8c&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=2ba23f9ef2de43a6bf86f97ccf919c68 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:07.575472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6f7b3-cce9-4d88-85f7-9cfd3c81f890 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.580853 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa622b7-e013-4481-af25-c806b72f7366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.582131 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa622b7-e013-4481-af25-c806b72f7366 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.582644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa622b7-e013-4481-af25-c806b72f7366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.583103 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa622b7-e013-4481-af25-c806b72f7366 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.584240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa622b7-e013-4481-af25-c806b72f7366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:07.584755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa622b7-e013-4481-af25-c806b72f7366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.586739 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa622b7-e013-4481-af25-c806b72f7366 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.603911 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 315/639] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:07.612837 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a593f2-3637-46d6-a500-9f17b1d29f18 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.623605 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a593f2-3637-46d6-a500-9f17b1d29f18 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.630584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fe67c-2b92-4eaf-aa34-cef0238cbe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.631644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fe67c-2b92-4eaf-aa34-cef0238cbe60 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.632026 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fe67c-2b92-4eaf-aa34-cef0238cbe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.632446 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fe67c-2b92-4eaf-aa34-cef0238cbe60 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.644581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fe67c-2b92-4eaf-aa34-cef0238cbe60 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.646953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fe67c-2b92-4eaf-aa34-cef0238cbe60 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.661888 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-479fe67c-2b92-4eaf-aa34-cef0238cbe60 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 08 10:49:07.669084 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 325/640] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:07.676172 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa622b7-e013-4481-af25-c806b72f7366 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.689014 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa622b7-e013-4481-af25-c806b72f7366 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.700486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9259-a46f-4bfa-968e-6544a309dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.701429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9259-a46f-4bfa-968e-6544a309dd03 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.701851 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9259-a46f-4bfa-968e-6544a309dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.702260 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9259-a46f-4bfa-968e-6544a309dd03 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.703320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a9259-a46f-4bfa-968e-6544a309dd03 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:07.703786 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a9259-a46f-4bfa-968e-6544a309dd03 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.705936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a9259-a46f-4bfa-968e-6544a309dd03 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.712070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ce9e2-d636-43f4-891b-faebca83f483 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.712070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ce9e2-d636-43f4-891b-faebca83f483 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.712366 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ce9e2-d636-43f4-891b-faebca83f483 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.714309 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 326/641] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:49:07.733848 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 316/642] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:07.737378 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3426ce8-860f-4a0a-860a-2ff9d67d8c40 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.738140 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3426ce8-860f-4a0a-860a-2ff9d67d8c40 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.738567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3426ce8-860f-4a0a-860a-2ff9d67d8c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.740590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9259-a46f-4bfa-968e-6544a309dd03 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.757024 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9259-a46f-4bfa-968e-6544a309dd03 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.773825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e10a1e-6a2a-4354-8e2b-367ec74327d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.774205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-f3426ce8-860f-4a0a-860a-2ff9d67d8c40 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:07.775013 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e10a1e-6a2a-4354-8e2b-367ec74327d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.775441 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e10a1e-6a2a-4354-8e2b-367ec74327d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.775815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e10a1e-6a2a-4354-8e2b-367ec74327d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.776103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f3426ce8-860f-4a0a-860a-2ff9d67d8c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:07.785376 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 327/643] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:07 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:07.797231 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e10a1e-6a2a-4354-8e2b-367ec74327d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.800050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e10a1e-6a2a-4354-8e2b-367ec74327d9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.812749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3426ce8-860f-4a0a-860a-2ff9d67d8c40 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.824451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-e6e10a1e-6a2a-4354-8e2b-367ec74327d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:07.826526 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3426ce8-860f-4a0a-860a-2ff9d67d8c40 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.831655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 317/644] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:07.832582 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e10a1e-6a2a-4354-8e2b-367ec74327d9 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.836369 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efa73a-bef6-40bd-a9b5-d59f60174118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.837216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efa73a-bef6-40bd-a9b5-d59f60174118 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.837597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efa73a-bef6-40bd-a9b5-d59f60174118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.838057 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efa73a-bef6-40bd-a9b5-d59f60174118 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.838882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efa73a-bef6-40bd-a9b5-d59f60174118 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.840708 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efa73a-bef6-40bd-a9b5-d59f60174118 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.845633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e10a1e-6a2a-4354-8e2b-367ec74327d9 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.850980 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d3e14-1f7f-4d76-990e-00c2282f6e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.851913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d3e14-1f7f-4d76-990e-00c2282f6e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.852355 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d3e14-1f7f-4d76-990e-00c2282f6e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.852621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d3e14-1f7f-4d76-990e-00c2282f6e24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.853623 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d3e14-1f7f-4d76-990e-00c2282f6e24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:07.853967 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d3e14-1f7f-4d76-990e-00c2282f6e24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.856314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d3e14-1f7f-4d76-990e-00c2282f6e24 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.870821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 328/645] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Nov 8 10:49:07 2021] POST /identity/v3/services => generated 240 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:49:07.882887 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 318/646] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:07.889501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efa73a-bef6-40bd-a9b5-d59f60174118 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.914055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efa73a-bef6-40bd-a9b5-d59f60174118 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.921487 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bfafd-5c75-42d8-8059-0f6106b64881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.922392 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bfafd-5c75-42d8-8059-0f6106b64881 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.922669 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bfafd-5c75-42d8-8059-0f6106b64881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.922940 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bfafd-5c75-42d8-8059-0f6106b64881 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.931237 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bfafd-5c75-42d8-8059-0f6106b64881 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.933327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bfafd-5c75-42d8-8059-0f6106b64881 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:07.947874 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-f36bfafd-5c75-42d8-8059-0f6106b64881 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:07.949558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 329/647] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:07.956098 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d3e14-1f7f-4d76-990e-00c2282f6e24 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:07.969718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d3e14-1f7f-4d76-990e-00c2282f6e24 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:07.974517 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35146f6d-378e-4429-8b73-476e522505ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:07.975758 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146f6d-378e-4429-8b73-476e522505ab admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:07.975758 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146f6d-378e-4429-8b73-476e522505ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:07.975955 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146f6d-378e-4429-8b73-476e522505ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:07.977007 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35146f6d-378e-4429-8b73-476e522505ab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:07.977318 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35146f6d-378e-4429-8b73-476e522505ab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:07.979357 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35146f6d-378e-4429-8b73-476e522505ab admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:08.000303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 319/648] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:08.006546 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bfafd-5c75-42d8-8059-0f6106b64881 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:08.017438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bfafd-5c75-42d8-8059-0f6106b64881 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:08.025475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7840d04-077d-4df1-b581-24eaacd94896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:08.026552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7840d04-077d-4df1-b581-24eaacd94896 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:08.026836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7840d04-077d-4df1-b581-24eaacd94896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:08.027107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7840d04-077d-4df1-b581-24eaacd94896 admin admin] PATH_INFO: `/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/d3421cf1bbb24423a2f24c4667adfdda/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:08.029184 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7840d04-077d-4df1-b581-24eaacd94896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ae5e80b1f745dfaedd81a2c0ded718, user_id=d3421cf1bbb24423a2f24c4667adfdda, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:08.031958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7840d04-077d-4df1-b581-24eaacd94896 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:08.058940 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 330/649] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:49:08 2021] PUT /identity/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/d3421cf1bbb24423a2f24c4667adfdda/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:49:08.798712 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65e99c-f8ee-476b-a17e-9fd425d429bd None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:08.799971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65e99c-f8ee-476b-a17e-9fd425d429bd None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:08.799971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65e99c-f8ee-476b-a17e-9fd425d429bd None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:08.801221 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 320/650] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:08.809457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c2e5-95e1-4304-9b38-d0910ab3bb0f None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:08.809457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c2e5-95e1-4304-9b38-d0910ab3bb0f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:08.809457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c2e5-95e1-4304-9b38-d0910ab3bb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:08.836165 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-e586c2e5-95e1-4304-9b38-d0910ab3bb0f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:08.837391 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e586c2e5-95e1-4304-9b38-d0910ab3bb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:08.913742 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 331/651] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:08 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:08.950988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65e99c-f8ee-476b-a17e-9fd425d429bd None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:08.973292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65e99c-f8ee-476b-a17e-9fd425d429bd None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:08.983160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f4957-0687-40c7-8e7c-bca67c7fc06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:08.983981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f4957-0687-40c7-8e7c-bca67c7fc06d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:08.984262 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f4957-0687-40c7-8e7c-bca67c7fc06d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:08.984531 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f4957-0687-40c7-8e7c-bca67c7fc06d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:09.004121 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f4957-0687-40c7-8e7c-bca67c7fc06d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:09.010992 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-332f4957-0687-40c7-8e7c-bca67c7fc06d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:49:09.012325 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 321/652] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:49:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:09.019469 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586c2e5-95e1-4304-9b38-d0910ab3bb0f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:09.032095 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586c2e5-95e1-4304-9b38-d0910ab3bb0f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:09.043428 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c5509-dbc9-4fa7-abd2-0f1f659a3805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:09.044432 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c5509-dbc9-4fa7-abd2-0f1f659a3805 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:09.044910 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c5509-dbc9-4fa7-abd2-0f1f659a3805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:09.045380 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c5509-dbc9-4fa7-abd2-0f1f659a3805 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:09.046359 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c5509-dbc9-4fa7-abd2-0f1f659a3805 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:09.046869 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c5509-dbc9-4fa7-abd2-0f1f659a3805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:09.048778 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c5509-dbc9-4fa7-abd2-0f1f659a3805 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:09.063002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 332/653] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:49:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:09.069042 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f4957-0687-40c7-8e7c-bca67c7fc06d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:09.080933 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f4957-0687-40c7-8e7c-bca67c7fc06d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:09.089756 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb8741-9c82-4d1d-ad69-936e0773c0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:09.090591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb8741-9c82-4d1d-ad69-936e0773c0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:09.090868 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb8741-9c82-4d1d-ad69-936e0773c0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:09.091190 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb8741-9c82-4d1d-ad69-936e0773c0c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:09.107317 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb8741-9c82-4d1d-ad69-936e0773c0c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:09.109371 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb8741-9c82-4d1d-ad69-936e0773c0c5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:09.132237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-55bb8741-9c82-4d1d-ad69-936e0773c0c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:09.133557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 322/654] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:09.140057 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c5509-dbc9-4fa7-abd2-0f1f659a3805 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:09.156055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c5509-dbc9-4fa7-abd2-0f1f659a3805 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:09.167339 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c9076-eecb-4355-9e1b-ab8ad40ceac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:09.168321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c9076-eecb-4355-9e1b-ab8ad40ceac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:09.168805 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c9076-eecb-4355-9e1b-ab8ad40ceac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:09.169277 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c9076-eecb-4355-9e1b-ab8ad40ceac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:09.170213 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c9076-eecb-4355-9e1b-ab8ad40ceac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:09.170726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c9076-eecb-4355-9e1b-ab8ad40ceac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:09.172556 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c9076-eecb-4355-9e1b-ab8ad40ceac7 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:09.193320 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 333/655] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:09.199655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb8741-9c82-4d1d-ad69-936e0773c0c5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:09.213889 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb8741-9c82-4d1d-ad69-936e0773c0c5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:09.219462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b9ddd-a151-4c30-a9f7-c377ec6a680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:09.220305 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b9ddd-a151-4c30-a9f7-c377ec6a680f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:09.220817 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b9ddd-a151-4c30-a9f7-c377ec6a680f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:09.221334 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b9ddd-a151-4c30-a9f7-c377ec6a680f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:09.236350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b9ddd-a151-4c30-a9f7-c377ec6a680f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:09.238581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b9ddd-a151-4c30-a9f7-c377ec6a680f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:09.252401 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-0f5b9ddd-a151-4c30-a9f7-c377ec6a680f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 08 10:49:09.253550 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 323/656] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:49:09 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:09.260511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c9076-eecb-4355-9e1b-ab8ad40ceac7 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:09.277131 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c9076-eecb-4355-9e1b-ab8ad40ceac7 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:09.291788 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3964393-f628-4b88-9ad4-71e419994a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:09.292560 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3964393-f628-4b88-9ad4-71e419994a32 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:09.292914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3964393-f628-4b88-9ad4-71e419994a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:09.293259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3964393-f628-4b88-9ad4-71e419994a32 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:09.294201 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3964393-f628-4b88-9ad4-71e419994a32 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:09.294574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3964393-f628-4b88-9ad4-71e419994a32 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:09.296574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3964393-f628-4b88-9ad4-71e419994a32 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:09.315999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 334/657] 10.222.0.20 () {56 vars in 1156 bytes} [Mon Nov 8 10:49:09 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:09.328858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b9ddd-a151-4c30-a9f7-c377ec6a680f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:09.342496 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b9ddd-a151-4c30-a9f7-c377ec6a680f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:09.349274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e5bc0-3b03-4c04-a684-aa1b5d7da224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:09.350143 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e5bc0-3b03-4c04-a684-aa1b5d7da224 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:09.350560 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e5bc0-3b03-4c04-a684-aa1b5d7da224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:09.350966 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e5bc0-3b03-4c04-a684-aa1b5d7da224 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:09.363011 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e5bc0-3b03-4c04-a684-aa1b5d7da224 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:09.365060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e5bc0-3b03-4c04-a684-aa1b5d7da224 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:09.376661 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 324/658] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:09 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:49:09.386283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3964393-f628-4b88-9ad4-71e419994a32 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:09.401895 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3964393-f628-4b88-9ad4-71e419994a32 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:09.411784 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a5bae-b68b-424e-aae6-4985f76f3bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:09.412720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a5bae-b68b-424e-aae6-4985f76f3bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:09.413100 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a5bae-b68b-424e-aae6-4985f76f3bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:09.413474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a5bae-b68b-424e-aae6-4985f76f3bc9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:09.433150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a5bae-b68b-424e-aae6-4985f76f3bc9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:09.435171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a5bae-b68b-424e-aae6-4985f76f3bc9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:09.461199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-7c6a5bae-b68b-424e-aae6-4985f76f3bc9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:09.464540 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 335/659] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:09.480493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e5bc0-3b03-4c04-a684-aa1b5d7da224 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:09.491982 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e5bc0-3b03-4c04-a684-aa1b5d7da224 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:09.499111 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda89f60-bb44-4d21-85db-f092c622c5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:09.499958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda89f60-bb44-4d21-85db-f092c622c5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:09.500435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda89f60-bb44-4d21-85db-f092c622c5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:09.500844 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda89f60-bb44-4d21-85db-f092c622c5a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:09.501809 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda89f60-bb44-4d21-85db-f092c622c5a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:09.502274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda89f60-bb44-4d21-85db-f092c622c5a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:09.504222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda89f60-bb44-4d21-85db-f092c622c5a1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:09.524610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 325/660] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:09.530984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a5bae-b68b-424e-aae6-4985f76f3bc9 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:09.544186 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a5bae-b68b-424e-aae6-4985f76f3bc9 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:09.559543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909e131-9d52-43fd-9d4d-110468980ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:09.560484 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909e131-9d52-43fd-9d4d-110468980ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:09.560890 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909e131-9d52-43fd-9d4d-110468980ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:09.561256 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909e131-9d52-43fd-9d4d-110468980ffd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:09.572401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909e131-9d52-43fd-9d4d-110468980ffd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:09.574443 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909e131-9d52-43fd-9d4d-110468980ffd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:09.592276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-b909e131-9d52-43fd-9d4d-110468980ffd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:09.593925 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 336/661] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:09.600151 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda89f60-bb44-4d21-85db-f092c622c5a1 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:09.616488 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda89f60-bb44-4d21-85db-f092c622c5a1 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:09.626116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c7fef-cb20-46e4-a77f-7d3a35fec992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:09.626872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c7fef-cb20-46e4-a77f-7d3a35fec992 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:09.627251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c7fef-cb20-46e4-a77f-7d3a35fec992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:09.627534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c7fef-cb20-46e4-a77f-7d3a35fec992 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:09.628488 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c7fef-cb20-46e4-a77f-7d3a35fec992 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:09.628801 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c7fef-cb20-46e4-a77f-7d3a35fec992 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:09.630665 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c7fef-cb20-46e4-a77f-7d3a35fec992 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:09.656570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 326/662] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:09.664028 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909e131-9d52-43fd-9d4d-110468980ffd admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:09.678205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909e131-9d52-43fd-9d4d-110468980ffd admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:09.685833 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8eda0-c07c-4dcb-8ad5-50c699afde21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:09.686722 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8eda0-c07c-4dcb-8ad5-50c699afde21 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:09.687095 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8eda0-c07c-4dcb-8ad5-50c699afde21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:09.687534 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8eda0-c07c-4dcb-8ad5-50c699afde21 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:09.688479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8eda0-c07c-4dcb-8ad5-50c699afde21 admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=029506cc966a44c9bbe83eb084ac6feb) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:09.688929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8eda0-c07c-4dcb-8ad5-50c699afde21 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:09.691852 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8eda0-c07c-4dcb-8ad5-50c699afde21 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:09.704480 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 337/663] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:09 2021] GET /identity/v3/role_assignments?user.id=029506cc966a44c9bbe83eb084ac6feb&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:10.167979 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412c3cf-cc9a-4ab6-838d-3ac9d95f49f5 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.168878 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412c3cf-cc9a-4ab6-838d-3ac9d95f49f5 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.169312 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412c3cf-cc9a-4ab6-838d-3ac9d95f49f5 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.171516 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 327/664] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:10.178111 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a032f-8c13-4d9e-841c-b159a4ed7fb7 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.178926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a032f-8c13-4d9e-841c-b159a4ed7fb7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.179362 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a032f-8c13-4d9e-841c-b159a4ed7fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.198417 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-f70a032f-8c13-4d9e-841c-b159a4ed7fb7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:10.199955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f70a032f-8c13-4d9e-841c-b159a4ed7fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:10.208124 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 338/665] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:10 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:10.231752 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412c3cf-cc9a-4ab6-838d-3ac9d95f49f5 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.244393 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412c3cf-cc9a-4ab6-838d-3ac9d95f49f5 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.249072 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817cd5e-1ce5-4fe5-bf94-d6755737e63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.250081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817cd5e-1ce5-4fe5-bf94-d6755737e63f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.250532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817cd5e-1ce5-4fe5-bf94-d6755737e63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.250972 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817cd5e-1ce5-4fe5-bf94-d6755737e63f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.262104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817cd5e-1ce5-4fe5-bf94-d6755737e63f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:10.269551 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-6817cd5e-1ce5-4fe5-bf94-d6755737e63f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:49:10.271284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 328/666] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:10.278039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bb52e-59ec-4bde-a5b8-942f20a90290 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.278554 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bb52e-59ec-4bde-a5b8-942f20a90290 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.279276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bb52e-59ec-4bde-a5b8-942f20a90290 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.279894 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817cd5e-1ce5-4fe5-bf94-d6755737e63f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.281697 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 339/667] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:10.290775 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95b96b-58a7-4e7f-9e27-0c30a0345b51 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.291331 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95b96b-58a7-4e7f-9e27-0c30a0345b51 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.291800 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95b96b-58a7-4e7f-9e27-0c30a0345b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.294723 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817cd5e-1ce5-4fe5-bf94-d6755737e63f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.306223 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b8bbb-d67d-4345-9206-628eb8cfedb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.306900 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8bbb-d67d-4345-9206-628eb8cfedb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.307190 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8bbb-d67d-4345-9206-628eb8cfedb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.307474 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8bbb-d67d-4345-9206-628eb8cfedb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.308251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b8bbb-d67d-4345-9206-628eb8cfedb0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:10.308565 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b8bbb-d67d-4345-9206-628eb8cfedb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.310204 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b8bbb-d67d-4345-9206-628eb8cfedb0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.311894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-8b95b96b-58a7-4e7f-9e27-0c30a0345b51 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:10.313287 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8b95b96b-58a7-4e7f-9e27-0c30a0345b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:10.330198 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 340/669] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:10 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:10.330512 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 329/669] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:10.341907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95b96b-58a7-4e7f-9e27-0c30a0345b51 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.356388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95b96b-58a7-4e7f-9e27-0c30a0345b51 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.357790 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b8bbb-d67d-4345-9206-628eb8cfedb0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.363315 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e8300-3451-4994-a189-ec470e6a8a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.364122 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e8300-3451-4994-a189-ec470e6a8a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.364404 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e8300-3451-4994-a189-ec470e6a8a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.364679 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e8300-3451-4994-a189-ec470e6a8a00 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.369206 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b8bbb-d67d-4345-9206-628eb8cfedb0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.374456 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cfb27-9551-494b-8b3b-fda92f32b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.375547 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cfb27-9551-494b-8b3b-fda92f32b9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.376025 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cfb27-9551-494b-8b3b-fda92f32b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.376486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cfb27-9551-494b-8b3b-fda92f32b9e3 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.377500 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cfb27-9551-494b-8b3b-fda92f32b9e3 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.379469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-060cfb27-9551-494b-8b3b-fda92f32b9e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:49:10.379469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:49:10.379469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:49:10.380671 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cfb27-9551-494b-8b3b-fda92f32b9e3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.387360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e8300-3451-4994-a189-ec470e6a8a00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.389301 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e8300-3451-4994-a189-ec470e6a8a00 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.396226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-060cfb27-9551-494b-8b3b-fda92f32b9e3 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 08 10:49:10.397971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 330/670] 10.222.0.20 () {56 vars in 1150 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:10.405398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cfb27-9551-494b-8b3b-fda92f32b9e3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.410977 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-959e8300-3451-4994-a189-ec470e6a8a00 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:10.412576 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 341/671] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:10.419417 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e8300-3451-4994-a189-ec470e6a8a00 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.426556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cfb27-9551-494b-8b3b-fda92f32b9e3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.429956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e8300-3451-4994-a189-ec470e6a8a00 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.436262 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada8f5a-553d-414e-adcb-2e8bbb8e6b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.436933 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada8f5a-553d-414e-adcb-2e8bbb8e6b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.437215 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada8f5a-553d-414e-adcb-2e8bbb8e6b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.437489 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada8f5a-553d-414e-adcb-2e8bbb8e6b9d admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.438210 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada8f5a-553d-414e-adcb-2e8bbb8e6b9d admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:10.438512 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada8f5a-553d-414e-adcb-2e8bbb8e6b9d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.440348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada8f5a-553d-414e-adcb-2e8bbb8e6b9d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.442637 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455c899-b6fe-4751-b379-2a3de7b1d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.443315 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455c899-b6fe-4751-b379-2a3de7b1d83c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.443591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455c899-b6fe-4751-b379-2a3de7b1d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.443856 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455c899-b6fe-4751-b379-2a3de7b1d83c admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.444584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455c899-b6fe-4751-b379-2a3de7b1d83c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:10.444882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455c899-b6fe-4751-b379-2a3de7b1d83c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.446458 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455c899-b6fe-4751-b379-2a3de7b1d83c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.459287 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 331/672] 10.222.0.20 () {56 vars in 1145 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:10.466199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 342/673] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:10.470394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada8f5a-553d-414e-adcb-2e8bbb8e6b9d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.473948 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455c899-b6fe-4751-b379-2a3de7b1d83c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.486211 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada8f5a-553d-414e-adcb-2e8bbb8e6b9d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.492698 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455c899-b6fe-4751-b379-2a3de7b1d83c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.497622 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891a995-6769-4408-af62-39e485db9205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.498442 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891a995-6769-4408-af62-39e485db9205 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.498720 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891a995-6769-4408-af62-39e485db9205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.498989 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891a995-6769-4408-af62-39e485db9205 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.504140 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b939767-9b4f-45b5-ad06-45261e4ed80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.504797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b939767-9b4f-45b5-ad06-45261e4ed80a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.505075 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b939767-9b4f-45b5-ad06-45261e4ed80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.505342 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b939767-9b4f-45b5-ad06-45261e4ed80a admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.506060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b939767-9b4f-45b5-ad06-45261e4ed80a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:10.506366 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b939767-9b4f-45b5-ad06-45261e4ed80a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.512415 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891a995-6769-4408-af62-39e485db9205 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.514416 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891a995-6769-4408-af62-39e485db9205 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.515010 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b939767-9b4f-45b5-ad06-45261e4ed80a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.522436 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 343/674] 10.222.0.20 () {56 vars in 1145 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:10.528946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b939767-9b4f-45b5-ad06-45261e4ed80a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.537284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-d891a995-6769-4408-af62-39e485db9205 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 08 10:49:10.538777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 332/675] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:10.546000 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891a995-6769-4408-af62-39e485db9205 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.553042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b939767-9b4f-45b5-ad06-45261e4ed80a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.556999 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891a995-6769-4408-af62-39e485db9205 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.561404 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7c7cd-1282-4a32-80ba-44ae97112ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.562069 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7c7cd-1282-4a32-80ba-44ae97112ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.562345 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7c7cd-1282-4a32-80ba-44ae97112ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.562613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7c7cd-1282-4a32-80ba-44ae97112ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.563493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7c7cd-1282-4a32-80ba-44ae97112ec6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:10.563752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac05ee-27ea-4748-92ad-992763cd12cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.563865 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7c7cd-1282-4a32-80ba-44ae97112ec6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.564575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac05ee-27ea-4748-92ad-992763cd12cc admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.564863 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac05ee-27ea-4748-92ad-992763cd12cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.565274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac05ee-27ea-4748-92ad-992763cd12cc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.565930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7c7cd-1282-4a32-80ba-44ae97112ec6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.566093 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac05ee-27ea-4748-92ad-992763cd12cc admin admin] RBAC: Adding query filter params (interface=public, service_id=dc5bf58225b3447ba024d71035e157df, region_id=RegionOne) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:10.566401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac05ee-27ea-4748-92ad-992763cd12cc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.571598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-8dac05ee-27ea-4748-92ad-992763cd12cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:49:10.571598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:49:10.571598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:49:10.572557 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac05ee-27ea-4748-92ad-992763cd12cc admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.584078 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 333/676] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:10.590200 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7c7cd-1282-4a32-80ba-44ae97112ec6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.591384 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 344/677] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/endpoints?service_id=dc5bf58225b3447ba024d71035e157df&interface=public®ion_id=RegionOne => generated 194 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:10.597642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac05ee-27ea-4748-92ad-992763cd12cc admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.600223 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7c7cd-1282-4a32-80ba-44ae97112ec6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.610234 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43c8b3-fb1a-4238-b5e0-0d07ad722c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.611071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43c8b3-fb1a-4238-b5e0-0d07ad722c76 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.612802 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43c8b3-fb1a-4238-b5e0-0d07ad722c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.613080 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43c8b3-fb1a-4238-b5e0-0d07ad722c76 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.615900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac05ee-27ea-4748-92ad-992763cd12cc admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.627733 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb315a-ca5d-4682-9c5b-08722ccb05ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.628398 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb315a-ca5d-4682-9c5b-08722ccb05ad admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.628677 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb315a-ca5d-4682-9c5b-08722ccb05ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.630790 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb315a-ca5d-4682-9c5b-08722ccb05ad admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.631533 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb315a-ca5d-4682-9c5b-08722ccb05ad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.634581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43c8b3-fb1a-4238-b5e0-0d07ad722c76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.635884 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb315a-ca5d-4682-9c5b-08722ccb05ad admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.638311 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43c8b3-fb1a-4238-b5e0-0d07ad722c76 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.649538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 345/678] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/services => generated 772 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:10.661839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-4f43c8b3-fb1a-4238-b5e0-0d07ad722c76 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:10.667502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 334/679] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:10.669826 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb315a-ca5d-4682-9c5b-08722ccb05ad admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.679972 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb315a-ca5d-4682-9c5b-08722ccb05ad admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.684716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c92bd-4968-4c8c-9de3-7705f31acdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.685455 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c92bd-4968-4c8c-9de3-7705f31acdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.685736 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c92bd-4968-4c8c-9de3-7705f31acdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.686006 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c92bd-4968-4c8c-9de3-7705f31acdf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.686825 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c92bd-4968-4c8c-9de3-7705f31acdf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:10.687170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c92bd-4968-4c8c-9de3-7705f31acdf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.688891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c92bd-4968-4c8c-9de3-7705f31acdf5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.702138 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 346/680] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:10.708790 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43c8b3-fb1a-4238-b5e0-0d07ad722c76 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.719597 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43c8b3-fb1a-4238-b5e0-0d07ad722c76 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.724714 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df240d57-e77e-42c8-a728-86ab5d3572cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.725575 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df240d57-e77e-42c8-a728-86ab5d3572cc admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.725857 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df240d57-e77e-42c8-a728-86ab5d3572cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.726180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df240d57-e77e-42c8-a728-86ab5d3572cc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.734214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df240d57-e77e-42c8-a728-86ab5d3572cc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.736394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df240d57-e77e-42c8-a728-86ab5d3572cc admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.751340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-df240d57-e77e-42c8-a728-86ab5d3572cc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:10.753149 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 335/681] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:10.759945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c92bd-4968-4c8c-9de3-7705f31acdf5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.772383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c92bd-4968-4c8c-9de3-7705f31acdf5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.777737 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35530e3d-eeb2-4cd3-a63b-950200694035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.778479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35530e3d-eeb2-4cd3-a63b-950200694035 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.778766 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35530e3d-eeb2-4cd3-a63b-950200694035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.779091 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35530e3d-eeb2-4cd3-a63b-950200694035 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.779957 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35530e3d-eeb2-4cd3-a63b-950200694035 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:10.780315 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35530e3d-eeb2-4cd3-a63b-950200694035 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.782267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35530e3d-eeb2-4cd3-a63b-950200694035 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.797432 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 347/682] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:10.805122 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df240d57-e77e-42c8-a728-86ab5d3572cc admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:10.817062 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df240d57-e77e-42c8-a728-86ab5d3572cc admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:10.822338 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e0aec-30fe-4612-b3bb-91b04bc0c4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:10.823353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e0aec-30fe-4612-b3bb-91b04bc0c4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.823642 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e0aec-30fe-4612-b3bb-91b04bc0c4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.823919 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e0aec-30fe-4612-b3bb-91b04bc0c4ae admin admin] PATH_INFO: `/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/f9fc539f38364a648b9a4c25d3dbea8c/roles/2ba23f9ef2de43a6bf86f97ccf919c68` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.840553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e0aec-30fe-4612-b3bb-91b04bc0c4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ae5e80b1f745dfaedd81a2c0ded718, user_id=f9fc539f38364a648b9a4c25d3dbea8c, role_id=2ba23f9ef2de43a6bf86f97ccf919c68)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:10.843418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e0aec-30fe-4612-b3bb-91b04bc0c4ae admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:10.871569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 336/683] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:49:10 2021] PUT /identity/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/f9fc539f38364a648b9a4c25d3dbea8c/roles/2ba23f9ef2de43a6bf86f97ccf919c68 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:49:10.902550 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcfd95-5c5a-4ae5-8eeb-8466cf4d01e8 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.902876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcfd95-5c5a-4ae5-8eeb-8466cf4d01e8 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.903079 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcfd95-5c5a-4ae5-8eeb-8466cf4d01e8 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.905240 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 348/684] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:10.912750 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf5a03-222f-487d-893d-b4c2bb1dcd88 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:10.913089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf5a03-222f-487d-893d-b4c2bb1dcd88 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:10.913305 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf5a03-222f-487d-893d-b4c2bb1dcd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:10.935829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-a6cf5a03-222f-487d-893d-b4c2bb1dcd88 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:10.937227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-a6cf5a03-222f-487d-893d-b4c2bb1dcd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:11.008070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 337/685] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:10 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:11.033277 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfcfd95-5c5a-4ae5-8eeb-8466cf4d01e8 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.047102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfcfd95-5c5a-4ae5-8eeb-8466cf4d01e8 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.052362 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ea622-f999-4190-8e74-fbfce123ac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.053237 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ea622-f999-4190-8e74-fbfce123ac43 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.053571 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ea622-f999-4190-8e74-fbfce123ac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.053898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ea622-f999-4190-8e74-fbfce123ac43 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.054623 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ea622-f999-4190-8e74-fbfce123ac43 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.056338 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ea622-f999-4190-8e74-fbfce123ac43 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.069489 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-ef9ea622-f999-4190-8e74-fbfce123ac43 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 08 10:49:11.071044 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 349/686] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/services/network => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:11.077825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf5a03-222f-487d-893d-b4c2bb1dcd88 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.086614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdbfac-04e4-4fe6-8ab9-cf13c9c25c08 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.086919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdbfac-04e4-4fe6-8ab9-cf13c9c25c08 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.087203 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdbfac-04e4-4fe6-8ab9-cf13c9c25c08 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.088656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf5a03-222f-487d-893d-b4c2bb1dcd88 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.089165 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 350/687] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:49:11.094003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4ddd1-dc20-4e01-902c-90ef94058ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.094749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4ddd1-dc20-4e01-902c-90ef94058ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.095036 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4ddd1-dc20-4e01-902c-90ef94058ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.095333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4ddd1-dc20-4e01-902c-90ef94058ad3 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.095583 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e97ff-f326-45d1-bf54-bca78df3a240 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.095807 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e97ff-f326-45d1-bf54-bca78df3a240 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.096015 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e97ff-f326-45d1-bf54-bca78df3a240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.096923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4ddd1-dc20-4e01-902c-90ef94058ad3 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:11.097233 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4ddd1-dc20-4e01-902c-90ef94058ad3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.099275 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4ddd1-dc20-4e01-902c-90ef94058ad3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.108093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 338/688] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:11.116580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4ddd1-dc20-4e01-902c-90ef94058ad3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.118499 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-853e97ff-f326-45d1-bf54-bca78df3a240 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:11.119845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-853e97ff-f326-45d1-bf54-bca78df3a240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:11.129096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4ddd1-dc20-4e01-902c-90ef94058ad3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.130888 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 351/689] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:11 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:11.138823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9165eff-5bff-45e4-bbb4-edeeb6ccc6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.139530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165eff-5bff-45e4-bbb4-edeeb6ccc6fe admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.139870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165eff-5bff-45e4-bbb4-edeeb6ccc6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.140148 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165eff-5bff-45e4-bbb4-edeeb6ccc6fe admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.140889 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9165eff-5bff-45e4-bbb4-edeeb6ccc6fe admin admin] RBAC: Adding query filter params (type=network) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:11.141192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9165eff-5bff-45e4-bbb4-edeeb6ccc6fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.143652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9165eff-5bff-45e4-bbb4-edeeb6ccc6fe admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.150575 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 339/690] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/services?type=network => generated 350 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:11.154811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e97ff-f326-45d1-bf54-bca78df3a240 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.156924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9165eff-5bff-45e4-bbb4-edeeb6ccc6fe admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.166217 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e97ff-f326-45d1-bf54-bca78df3a240 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.167568 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9165eff-5bff-45e4-bbb4-edeeb6ccc6fe admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.172315 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c586c66-19b6-4945-904d-19bc9493413f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.173164 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c586c66-19b6-4945-904d-19bc9493413f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.173453 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c586c66-19b6-4945-904d-19bc9493413f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.173839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c586c66-19b6-4945-904d-19bc9493413f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.174175 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c863cf-a80d-49f6-bf3d-6318ff586e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.174975 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c863cf-a80d-49f6-bf3d-6318ff586e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.175297 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c863cf-a80d-49f6-bf3d-6318ff586e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.175573 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c863cf-a80d-49f6-bf3d-6318ff586e66 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.176276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c586c66-19b6-4945-904d-19bc9493413f admin admin] RBAC: Adding query filter params (interface=public, service_id=317ae00b6841466dbbb79a604216c92f, region_id=RegionOne) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:11.176603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c586c66-19b6-4945-904d-19bc9493413f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.177796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-9c586c66-19b6-4945-904d-19bc9493413f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:49:11.177796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:49:11.177796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:49:11.178690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c586c66-19b6-4945-904d-19bc9493413f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.187538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c863cf-a80d-49f6-bf3d-6318ff586e66 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:11.188085 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 340/691] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/endpoints?service_id=317ae00b6841466dbbb79a604216c92f&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:11.194646 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-a3c863cf-a80d-49f6-bf3d-6318ff586e66 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:49:11.194773 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c586c66-19b6-4945-904d-19bc9493413f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.195934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 352/692] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:11.203856 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c863cf-a80d-49f6-bf3d-6318ff586e66 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.205723 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c586c66-19b6-4945-904d-19bc9493413f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.211405 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0e7f-f2f7-45f7-8fba-9761ed50194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.212084 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0e7f-f2f7-45f7-8fba-9761ed50194d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.212364 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0e7f-f2f7-45f7-8fba-9761ed50194d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.212641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0e7f-f2f7-45f7-8fba-9761ed50194d admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.213349 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d0e7f-f2f7-45f7-8fba-9761ed50194d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.214634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c863cf-a80d-49f6-bf3d-6318ff586e66 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.214970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d0e7f-f2f7-45f7-8fba-9761ed50194d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.220005 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0318ae0-9dda-448b-af82-909cecc0339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.220720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318ae0-9dda-448b-af82-909cecc0339b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.220996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318ae0-9dda-448b-af82-909cecc0339b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.221265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318ae0-9dda-448b-af82-909cecc0339b admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.222023 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0318ae0-9dda-448b-af82-909cecc0339b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:11.222252 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 341/693] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/services => generated 772 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:11.222414 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0318ae0-9dda-448b-af82-909cecc0339b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.224017 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0318ae0-9dda-448b-af82-909cecc0339b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.234531 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 353/694] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:11.240651 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0e7f-f2f7-45f7-8fba-9761ed50194d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.256527 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0e7f-f2f7-45f7-8fba-9761ed50194d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.265913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43016e9-ad08-41eb-bee7-cb0b7a0c1e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.267177 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43016e9-ad08-41eb-bee7-cb0b7a0c1e33 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.267501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43016e9-ad08-41eb-bee7-cb0b7a0c1e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.267775 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43016e9-ad08-41eb-bee7-cb0b7a0c1e33 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.287511 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43016e9-ad08-41eb-bee7-cb0b7a0c1e33 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.289581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43016e9-ad08-41eb-bee7-cb0b7a0c1e33 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.312865 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-d43016e9-ad08-41eb-bee7-cb0b7a0c1e33 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:11.314534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 342/695] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:11.321506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0318ae0-9dda-448b-af82-909cecc0339b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.334223 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0318ae0-9dda-448b-af82-909cecc0339b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.341964 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838c95b-0f4d-46da-b14d-6bb27f91a2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.342646 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838c95b-0f4d-46da-b14d-6bb27f91a2df admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.342930 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838c95b-0f4d-46da-b14d-6bb27f91a2df admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.343308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838c95b-0f4d-46da-b14d-6bb27f91a2df admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.344057 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838c95b-0f4d-46da-b14d-6bb27f91a2df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:11.344414 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838c95b-0f4d-46da-b14d-6bb27f91a2df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.346557 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838c95b-0f4d-46da-b14d-6bb27f91a2df admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.362878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 354/696] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:11.369538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43016e9-ad08-41eb-bee7-cb0b7a0c1e33 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.380140 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43016e9-ad08-41eb-bee7-cb0b7a0c1e33 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.390412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d0c09-cd9e-4e12-9f20-d1b17e0be8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.391266 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d0c09-cd9e-4e12-9f20-d1b17e0be8ad admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.391920 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d0c09-cd9e-4e12-9f20-d1b17e0be8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.392192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d0c09-cd9e-4e12-9f20-d1b17e0be8ad admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.401048 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d0c09-cd9e-4e12-9f20-d1b17e0be8ad admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.403096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d0c09-cd9e-4e12-9f20-d1b17e0be8ad admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.421255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-326d0c09-cd9e-4e12-9f20-d1b17e0be8ad admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 08 10:49:11.422639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 343/697] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:11.429758 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838c95b-0f4d-46da-b14d-6bb27f91a2df admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.441305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838c95b-0f4d-46da-b14d-6bb27f91a2df admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.449170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3b473-39d4-4c54-a7f3-f337004b300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.449849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3b473-39d4-4c54-a7f3-f337004b300f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.450127 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3b473-39d4-4c54-a7f3-f337004b300f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.450399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3b473-39d4-4c54-a7f3-f337004b300f admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.451467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3b473-39d4-4c54-a7f3-f337004b300f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:11.451781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3b473-39d4-4c54-a7f3-f337004b300f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.453636 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3b473-39d4-4c54-a7f3-f337004b300f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.492842 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 355/698] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:11.499464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d0c09-cd9e-4e12-9f20-d1b17e0be8ad admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.509789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d0c09-cd9e-4e12-9f20-d1b17e0be8ad admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.514902 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069e00f-3fa3-4d9e-b3a3-efea300d47e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.515694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069e00f-3fa3-4d9e-b3a3-efea300d47e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.515984 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069e00f-3fa3-4d9e-b3a3-efea300d47e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.516245 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069e00f-3fa3-4d9e-b3a3-efea300d47e3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.525866 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069e00f-3fa3-4d9e-b3a3-efea300d47e3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.527721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069e00f-3fa3-4d9e-b3a3-efea300d47e3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.537378 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 344/699] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:49:11.545568 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3b473-39d4-4c54-a7f3-f337004b300f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.561102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3b473-39d4-4c54-a7f3-f337004b300f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.570427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349b6ec-6e11-4e3d-8fbe-28a22f4a1c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.571285 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b6ec-6e11-4e3d-8fbe-28a22f4a1c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.571573 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b6ec-6e11-4e3d-8fbe-28a22f4a1c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.571850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b6ec-6e11-4e3d-8fbe-28a22f4a1c69 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.592097 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349b6ec-6e11-4e3d-8fbe-28a22f4a1c69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.593970 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349b6ec-6e11-4e3d-8fbe-28a22f4a1c69 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.612713 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-9349b6ec-6e11-4e3d-8fbe-28a22f4a1c69 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:11.615553 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 356/700] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:11.620897 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069e00f-3fa3-4d9e-b3a3-efea300d47e3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.630410 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069e00f-3fa3-4d9e-b3a3-efea300d47e3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.636563 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2dbc-ae59-4f70-91f2-15dd7450d1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.637274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2dbc-ae59-4f70-91f2-15dd7450d1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.637556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2dbc-ae59-4f70-91f2-15dd7450d1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.637827 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2dbc-ae59-4f70-91f2-15dd7450d1e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.638569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a2dbc-ae59-4f70-91f2-15dd7450d1e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:11.638863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a2dbc-ae59-4f70-91f2-15dd7450d1e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.640481 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a2dbc-ae59-4f70-91f2-15dd7450d1e2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.656285 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 345/701] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:11.663093 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349b6ec-6e11-4e3d-8fbe-28a22f4a1c69 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.675535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349b6ec-6e11-4e3d-8fbe-28a22f4a1c69 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.681476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193b489-0cb9-491c-b445-db0369978093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.682575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193b489-0cb9-491c-b445-db0369978093 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.683024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193b489-0cb9-491c-b445-db0369978093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.683528 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193b489-0cb9-491c-b445-db0369978093 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.695850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193b489-0cb9-491c-b445-db0369978093 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.697822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193b489-0cb9-491c-b445-db0369978093 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.717557 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-e193b489-0cb9-491c-b445-db0369978093 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:11.718816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 357/702] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:11.725241 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2dbc-ae59-4f70-91f2-15dd7450d1e2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.738259 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2dbc-ae59-4f70-91f2-15dd7450d1e2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.752881 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b303e2-3ce9-421a-9222-5e247887eff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.753839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b303e2-3ce9-421a-9222-5e247887eff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.754311 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b303e2-3ce9-421a-9222-5e247887eff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.754938 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b303e2-3ce9-421a-9222-5e247887eff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.755965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b303e2-3ce9-421a-9222-5e247887eff4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:11.756480 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b303e2-3ce9-421a-9222-5e247887eff4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.758520 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b303e2-3ce9-421a-9222-5e247887eff4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.771954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 346/703] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:11.778329 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193b489-0cb9-491c-b445-db0369978093 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:11.792038 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193b489-0cb9-491c-b445-db0369978093 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:11.799396 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fda45-4719-4446-b01d-02c52a211bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:11.800096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fda45-4719-4446-b01d-02c52a211bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:11.800380 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fda45-4719-4446-b01d-02c52a211bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:11.800659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fda45-4719-4446-b01d-02c52a211bd8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:11.801512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284fda45-4719-4446-b01d-02c52a211bd8 admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=d3421cf1bbb24423a2f24c4667adfdda) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:11.801843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284fda45-4719-4446-b01d-02c52a211bd8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:11.803723 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284fda45-4719-4446-b01d-02c52a211bd8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:11.816018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 358/704] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:11 2021] GET /identity/v3/role_assignments?user.id=d3421cf1bbb24423a2f24c4667adfdda&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:12.696229 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce19f7e-25b5-473c-8e30-a4aefe8f0eed None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:12.696780 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce19f7e-25b5-473c-8e30-a4aefe8f0eed None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:12.696780 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce19f7e-25b5-473c-8e30-a4aefe8f0eed None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:12.698685 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 347/705] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:12.705311 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837752b-5249-4270-8995-41c6033400ae None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:12.706179 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837752b-5249-4270-8995-41c6033400ae None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:12.706651 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837752b-5249-4270-8995-41c6033400ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:12.732172 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-1837752b-5249-4270-8995-41c6033400ae None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:12.733676 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1837752b-5249-4270-8995-41c6033400ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:12.745291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 359/706] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:12 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:12.793923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce19f7e-25b5-473c-8e30-a4aefe8f0eed None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:12.808874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce19f7e-25b5-473c-8e30-a4aefe8f0eed None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:12.813682 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f3f5-d757-45dc-bb3c-777c3be9a58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:12.815408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f3f5-d757-45dc-bb3c-777c3be9a58a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:12.815895 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f3f5-d757-45dc-bb3c-777c3be9a58a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:12.816367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f3f5-d757-45dc-bb3c-777c3be9a58a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:12.829247 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08f3f5-d757-45dc-bb3c-777c3be9a58a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:12.836877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-5f08f3f5-d757-45dc-bb3c-777c3be9a58a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:49:12.838323 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 348/707] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:49:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:12.845040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837752b-5249-4270-8995-41c6033400ae None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:12.856862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837752b-5249-4270-8995-41c6033400ae None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:12.862391 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178be95-4689-4cfc-accb-6927413801a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:12.863334 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178be95-4689-4cfc-accb-6927413801a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:12.863815 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178be95-4689-4cfc-accb-6927413801a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:12.864281 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178be95-4689-4cfc-accb-6927413801a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:12.865289 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178be95-4689-4cfc-accb-6927413801a5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:12.865806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178be95-4689-4cfc-accb-6927413801a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:12.867639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178be95-4689-4cfc-accb-6927413801a5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:12.881228 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 360/708] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:49:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:12.887916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f3f5-d757-45dc-bb3c-777c3be9a58a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:12.902324 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f3f5-d757-45dc-bb3c-777c3be9a58a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:12.907180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f3cf3-60d6-46f9-b047-f77b79a736b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:12.908872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3cf3-60d6-46f9-b047-f77b79a736b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:12.909360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3cf3-60d6-46f9-b047-f77b79a736b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:12.909831 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3cf3-60d6-46f9-b047-f77b79a736b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:12.923322 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f3cf3-60d6-46f9-b047-f77b79a736b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:12.925792 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f3cf3-60d6-46f9-b047-f77b79a736b6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:12.944240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-e68f3cf3-60d6-46f9-b047-f77b79a736b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:12.946131 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 349/709] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:12.952379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178be95-4689-4cfc-accb-6927413801a5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:12.964380 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178be95-4689-4cfc-accb-6927413801a5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:12.974885 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b0d90-52ab-4c91-b1cf-49e55da6330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:12.975894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b0d90-52ab-4c91-b1cf-49e55da6330f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:12.976394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b0d90-52ab-4c91-b1cf-49e55da6330f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:12.976876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b0d90-52ab-4c91-b1cf-49e55da6330f admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:12.977816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b0d90-52ab-4c91-b1cf-49e55da6330f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:12.978351 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b0d90-52ab-4c91-b1cf-49e55da6330f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:12.980238 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b0d90-52ab-4c91-b1cf-49e55da6330f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:12.997319 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 361/710] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:13.004053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f3cf3-60d6-46f9-b047-f77b79a736b6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:13.016211 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f3cf3-60d6-46f9-b047-f77b79a736b6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:13.026116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e64f1b-ff89-4ecc-b18e-b4e668c2a134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:13.026920 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e64f1b-ff89-4ecc-b18e-b4e668c2a134 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.027231 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e64f1b-ff89-4ecc-b18e-b4e668c2a134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.027512 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e64f1b-ff89-4ecc-b18e-b4e668c2a134 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.038496 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e64f1b-ff89-4ecc-b18e-b4e668c2a134 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:13.040572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e64f1b-ff89-4ecc-b18e-b4e668c2a134 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:13.062934 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-99e64f1b-ff89-4ecc-b18e-b4e668c2a134 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 08 10:49:13.069566 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 350/711] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:49:13 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:13.070999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b0d90-52ab-4c91-b1cf-49e55da6330f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:13.090658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b0d90-52ab-4c91-b1cf-49e55da6330f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:13.100104 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe8658-336e-45c3-aa41-51cdfed95bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:13.101110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe8658-336e-45c3-aa41-51cdfed95bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.101654 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe8658-336e-45c3-aa41-51cdfed95bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.102188 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe8658-336e-45c3-aa41-51cdfed95bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.103373 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe8658-336e-45c3-aa41-51cdfed95bf2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:13.103897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe8658-336e-45c3-aa41-51cdfed95bf2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:13.106295 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe8658-336e-45c3-aa41-51cdfed95bf2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:13.136705 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 362/712] 10.222.0.20 () {56 vars in 1156 bytes} [Mon Nov 8 10:49:13 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:13.143938 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e64f1b-ff89-4ecc-b18e-b4e668c2a134 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:13.161402 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e64f1b-ff89-4ecc-b18e-b4e668c2a134 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:13.175800 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e9e56-455a-4366-9bf0-1eecf802b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:13.176649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e9e56-455a-4366-9bf0-1eecf802b26d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.176900 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e9e56-455a-4366-9bf0-1eecf802b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.177169 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e9e56-455a-4366-9bf0-1eecf802b26d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.190853 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e9e56-455a-4366-9bf0-1eecf802b26d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:13.192740 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e9e56-455a-4366-9bf0-1eecf802b26d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:13.217165 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-130e9e56-455a-4366-9bf0-1eecf802b26d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:13.218669 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 351/713] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:13.224937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe8658-336e-45c3-aa41-51cdfed95bf2 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:13.240617 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe8658-336e-45c3-aa41-51cdfed95bf2 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:13.247765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca6a62-16eb-4e79-8f98-b9469ae5c594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:13.248738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6a62-16eb-4e79-8f98-b9469ae5c594 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.249215 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6a62-16eb-4e79-8f98-b9469ae5c594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.249723 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6a62-16eb-4e79-8f98-b9469ae5c594 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.250658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca6a62-16eb-4e79-8f98-b9469ae5c594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:13.255232 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca6a62-16eb-4e79-8f98-b9469ae5c594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:13.257096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca6a62-16eb-4e79-8f98-b9469ae5c594 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:13.270650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 363/714] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:13.278791 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e9e56-455a-4366-9bf0-1eecf802b26d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:13.301042 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e9e56-455a-4366-9bf0-1eecf802b26d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:13.316404 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc35b7e-678c-4eb5-b7fc-a92953bbd85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:13.317224 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35b7e-678c-4eb5-b7fc-a92953bbd85f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.317504 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35b7e-678c-4eb5-b7fc-a92953bbd85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.317773 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35b7e-678c-4eb5-b7fc-a92953bbd85f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.328237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc35b7e-678c-4eb5-b7fc-a92953bbd85f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:13.330257 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc35b7e-678c-4eb5-b7fc-a92953bbd85f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:13.349786 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-4dc35b7e-678c-4eb5-b7fc-a92953bbd85f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:13.351187 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 352/715] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:13.357520 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca6a62-16eb-4e79-8f98-b9469ae5c594 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:13.371761 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca6a62-16eb-4e79-8f98-b9469ae5c594 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:13.380790 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591eeac-adc4-46c4-bb08-bbeba1a701eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:13.381726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591eeac-adc4-46c4-bb08-bbeba1a701eb admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.382232 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591eeac-adc4-46c4-bb08-bbeba1a701eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.382810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591eeac-adc4-46c4-bb08-bbeba1a701eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.383857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591eeac-adc4-46c4-bb08-bbeba1a701eb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:13.384423 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591eeac-adc4-46c4-bb08-bbeba1a701eb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:13.386530 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591eeac-adc4-46c4-bb08-bbeba1a701eb admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:13.403332 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 364/716] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:13.409810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc35b7e-678c-4eb5-b7fc-a92953bbd85f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:13.425536 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc35b7e-678c-4eb5-b7fc-a92953bbd85f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:13.434087 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e38d4-d848-48ed-93d9-7752b5be59dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:13.434979 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e38d4-d848-48ed-93d9-7752b5be59dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.435289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e38d4-d848-48ed-93d9-7752b5be59dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.435564 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e38d4-d848-48ed-93d9-7752b5be59dc admin admin] PATH_INFO: `/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/029506cc966a44c9bbe83eb084ac6feb/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.440481 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e38d4-d848-48ed-93d9-7752b5be59dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ae5e80b1f745dfaedd81a2c0ded718, user_id=029506cc966a44c9bbe83eb084ac6feb, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:13.443182 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e38d4-d848-48ed-93d9-7752b5be59dc admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:13.482102 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 353/717] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:49:13 2021] PUT /identity/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/029506cc966a44c9bbe83eb084ac6feb/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:49:13.678235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a6b3b-f317-4cca-82f9-00837c2d8936 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.678932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a6b3b-f317-4cca-82f9-00837c2d8936 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.679427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a6b3b-f317-4cca-82f9-00837c2d8936 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.681661 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 365/718] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:13.687795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e319cd-85a0-4aa9-a746-9807504ee034 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.688087 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e319cd-85a0-4aa9-a746-9807504ee034 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.688365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e319cd-85a0-4aa9-a746-9807504ee034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.715658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-c8e319cd-85a0-4aa9-a746-9807504ee034 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:13.716896 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c8e319cd-85a0-4aa9-a746-9807504ee034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:13.767060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e0341-9a7b-46b8-89e9-b76e184272bd None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.767792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e0341-9a7b-46b8-89e9-b76e184272bd None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.767792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e0341-9a7b-46b8-89e9-b76e184272bd None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.769905 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 366/719] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:49:13.777360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71665203-65d6-4256-a0c5-99835260bb73 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.777917 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71665203-65d6-4256-a0c5-99835260bb73 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.778536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71665203-65d6-4256-a0c5-99835260bb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.792574 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 354/720] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:13 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:13.803628 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-71665203-65d6-4256-a0c5-99835260bb73 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:13.805117 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-71665203-65d6-4256-a0c5-99835260bb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:13.813171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 367/721] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:13 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:13.829284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e319cd-85a0-4aa9-a746-9807504ee034 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:13.838043 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71665203-65d6-4256-a0c5-99835260bb73 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:13.843547 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e319cd-85a0-4aa9-a746-9807504ee034 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:13.849084 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71665203-65d6-4256-a0c5-99835260bb73 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:13.851566 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866bcb6-e308-4289-9542-b54baada36b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:13.852359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866bcb6-e308-4289-9542-b54baada36b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.852647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866bcb6-e308-4289-9542-b54baada36b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.852920 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866bcb6-e308-4289-9542-b54baada36b0 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.853778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866bcb6-e308-4289-9542-b54baada36b0 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:13.854973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b386c-f22e-484b-967a-08858111c51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:13.855432 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866bcb6-e308-4289-9542-b54baada36b0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:13.856273 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b386c-f22e-484b-967a-08858111c51f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.856821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b386c-f22e-484b-967a-08858111c51f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.857478 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b386c-f22e-484b-967a-08858111c51f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.869802 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b386c-f22e-484b-967a-08858111c51f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:13.873172 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-d866bcb6-e308-4289-9542-b54baada36b0 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 08 10:49:13.874707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 355/722] 10.222.0.20 () {56 vars in 1150 bytes} [Mon Nov 8 10:49:13 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:13.877918 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-7f8b386c-f22e-484b-967a-08858111c51f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:49:13.879918 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 368/723] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:49:13 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:13.883268 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866bcb6-e308-4289-9542-b54baada36b0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:13.886861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b386c-f22e-484b-967a-08858111c51f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:13.899497 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866bcb6-e308-4289-9542-b54baada36b0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:13.900609 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b386c-f22e-484b-967a-08858111c51f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:13.905654 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a50b0f-169a-4d25-a29d-1ded341cb649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:13.906849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a50b0f-169a-4d25-a29d-1ded341cb649 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.907396 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a50b0f-169a-4d25-a29d-1ded341cb649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.907989 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a50b0f-169a-4d25-a29d-1ded341cb649 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.909013 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a50b0f-169a-4d25-a29d-1ded341cb649 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:13.909514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a50b0f-169a-4d25-a29d-1ded341cb649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:13.911383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a50b0f-169a-4d25-a29d-1ded341cb649 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:13.912459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd6a0c-48a5-4da9-82bd-09f26763d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:13.913143 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd6a0c-48a5-4da9-82bd-09f26763d12b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.913423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd6a0c-48a5-4da9-82bd-09f26763d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.913696 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd6a0c-48a5-4da9-82bd-09f26763d12b admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.914698 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd6a0c-48a5-4da9-82bd-09f26763d12b admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:13.915003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd6a0c-48a5-4da9-82bd-09f26763d12b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:13.917061 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd6a0c-48a5-4da9-82bd-09f26763d12b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:13.923884 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 369/724] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:49:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:13.929303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 356/725] 10.222.0.20 () {56 vars in 1145 bytes} [Mon Nov 8 10:49:13 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:13.930545 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a50b0f-169a-4d25-a29d-1ded341cb649 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:13.935092 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd6a0c-48a5-4da9-82bd-09f26763d12b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:13.941316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a50b0f-169a-4d25-a29d-1ded341cb649 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:13.950609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd6a0c-48a5-4da9-82bd-09f26763d12b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:13.952702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de9a07-4e0b-42de-9d8c-053aa3f98980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:13.953737 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de9a07-4e0b-42de-9d8c-053aa3f98980 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.954243 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de9a07-4e0b-42de-9d8c-053aa3f98980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.954781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de9a07-4e0b-42de-9d8c-053aa3f98980 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.963923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5befb-5818-4487-b034-c7b1174d4af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:13.964941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5befb-5818-4487-b034-c7b1174d4af0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:13.966170 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5befb-5818-4487-b034-c7b1174d4af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:13.966648 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5befb-5818-4487-b034-c7b1174d4af0 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:13.969400 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5befb-5818-4487-b034-c7b1174d4af0 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:13.969908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5befb-5818-4487-b034-c7b1174d4af0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:13.973403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5befb-5818-4487-b034-c7b1174d4af0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:13.976898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de9a07-4e0b-42de-9d8c-053aa3f98980 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:13.981022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de9a07-4e0b-42de-9d8c-053aa3f98980 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:13.984919 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 357/726] 10.222.0.20 () {56 vars in 1145 bytes} [Mon Nov 8 10:49:13 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:13.989660 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5befb-5818-4487-b034-c7b1174d4af0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:14.004970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5befb-5818-4487-b034-c7b1174d4af0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:14.017596 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993d63d-7d59-4f6d-a774-7b827083e3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:14.018613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993d63d-7d59-4f6d-a774-7b827083e3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.019089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993d63d-7d59-4f6d-a774-7b827083e3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.019646 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993d63d-7d59-4f6d-a774-7b827083e3c5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.021459 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-31de9a07-4e0b-42de-9d8c-053aa3f98980 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:14.021692 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993d63d-7d59-4f6d-a774-7b827083e3c5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:14.024214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-6993d63d-7d59-4f6d-a774-7b827083e3c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:49:14.024214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:49:14.024214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:49:14.025430 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993d63d-7d59-4f6d-a774-7b827083e3c5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:14.025793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 370/727] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:14.037223 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de9a07-4e0b-42de-9d8c-053aa3f98980 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:14.051479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de9a07-4e0b-42de-9d8c-053aa3f98980 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:14.056983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce5278-a620-4b77-96d0-630c635ac5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:14.057928 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce5278-a620-4b77-96d0-630c635ac5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.058409 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce5278-a620-4b77-96d0-630c635ac5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.058899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce5278-a620-4b77-96d0-630c635ac5c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.060082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce5278-a620-4b77-96d0-630c635ac5c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:14.060572 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce5278-a620-4b77-96d0-630c635ac5c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:14.062690 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce5278-a620-4b77-96d0-630c635ac5c5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:14.082909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 371/728] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:14.083752 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 358/729] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Nov 8 10:49:13 2021] POST /identity/v3/endpoints => generated 346 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:49:14.100921 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993d63d-7d59-4f6d-a774-7b827083e3c5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:14.131744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993d63d-7d59-4f6d-a774-7b827083e3c5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:14.139938 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369d860-07f9-494f-bc27-86c9e08d5622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:14.141169 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369d860-07f9-494f-bc27-86c9e08d5622 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.142060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369d860-07f9-494f-bc27-86c9e08d5622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.142594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369d860-07f9-494f-bc27-86c9e08d5622 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.153921 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369d860-07f9-494f-bc27-86c9e08d5622 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:14.156464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369d860-07f9-494f-bc27-86c9e08d5622 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:14.176948 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-b369d860-07f9-494f-bc27-86c9e08d5622 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 08 10:49:14.179025 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 359/730] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Nov 8 10:49:14 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:14.185281 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce5278-a620-4b77-96d0-630c635ac5c5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:14.202017 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce5278-a620-4b77-96d0-630c635ac5c5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:14.217397 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8104c1-3860-4ef0-8f05-c25a535d4f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:14.218091 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8104c1-3860-4ef0-8f05-c25a535d4f6c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.218375 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8104c1-3860-4ef0-8f05-c25a535d4f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.218655 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8104c1-3860-4ef0-8f05-c25a535d4f6c admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.219554 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8104c1-3860-4ef0-8f05-c25a535d4f6c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:14.219863 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8104c1-3860-4ef0-8f05-c25a535d4f6c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:14.221812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8104c1-3860-4ef0-8f05-c25a535d4f6c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:14.255013 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 372/731] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Nov 8 10:49:14 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:14.261304 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369d860-07f9-494f-bc27-86c9e08d5622 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:14.274229 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369d860-07f9-494f-bc27-86c9e08d5622 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:14.284027 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606e5ff-eece-4e7f-9185-fb28150cbad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:14.285005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606e5ff-eece-4e7f-9185-fb28150cbad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.285483 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606e5ff-eece-4e7f-9185-fb28150cbad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.285988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606e5ff-eece-4e7f-9185-fb28150cbad6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.303435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606e5ff-eece-4e7f-9185-fb28150cbad6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:14.305224 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606e5ff-eece-4e7f-9185-fb28150cbad6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:14.321404 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 360/732] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:14 2021] GET /identity/v3/auth/tokens => generated 1303 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:49:14.328442 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8104c1-3860-4ef0-8f05-c25a535d4f6c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:14.342855 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87885-f13c-451a-b214-d1a90c06dcbf None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.343171 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87885-f13c-451a-b214-d1a90c06dcbf None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.343451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87885-f13c-451a-b214-d1a90c06dcbf None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.344556 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8104c1-3860-4ef0-8f05-c25a535d4f6c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:14.345552 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 361/733] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:14.352580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ec80-2af9-4c3e-9702-f101b92d8535 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.352580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ec80-2af9-4c3e-9702-f101b92d8535 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.352580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ec80-2af9-4c3e-9702-f101b92d8535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.353619 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8647aef-40a2-412e-9fe5-e6f00ff11b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:14.354434 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8647aef-40a2-412e-9fe5-e6f00ff11b70 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.354721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8647aef-40a2-412e-9fe5-e6f00ff11b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.354997 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8647aef-40a2-412e-9fe5-e6f00ff11b70 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.372062 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8992ec80-2af9-4c3e-9702-f101b92d8535 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:14.372355 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8647aef-40a2-412e-9fe5-e6f00ff11b70 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:14.373251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8992ec80-2af9-4c3e-9702-f101b92d8535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:14.374321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8647aef-40a2-412e-9fe5-e6f00ff11b70 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:14.384032 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 362/734] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:14 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:14.395551 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-a8647aef-40a2-412e-9fe5-e6f00ff11b70 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:14.396829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 373/735] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:14.403060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992ec80-2af9-4c3e-9702-f101b92d8535 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:14.408075 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8647aef-40a2-412e-9fe5-e6f00ff11b70 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:14.416138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992ec80-2af9-4c3e-9702-f101b92d8535 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:14.419028 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8647aef-40a2-412e-9fe5-e6f00ff11b70 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:14.421097 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1fd93-5c0a-421b-a617-2beaff026df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:14.421776 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1fd93-5c0a-421b-a617-2beaff026df9 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.422068 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1fd93-5c0a-421b-a617-2beaff026df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.422340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1fd93-5c0a-421b-a617-2beaff026df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.423090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1fd93-5c0a-421b-a617-2beaff026df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:14.423591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1fd93-5c0a-421b-a617-2beaff026df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:14.424844 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51f7b6-788e-4b7f-a81d-b3a3a6af0db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:14.425482 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1fd93-5c0a-421b-a617-2beaff026df9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:14.426015 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51f7b6-788e-4b7f-a81d-b3a3a6af0db6 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.426437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51f7b6-788e-4b7f-a81d-b3a3a6af0db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.426846 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51f7b6-788e-4b7f-a81d-b3a3a6af0db6 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.427727 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51f7b6-788e-4b7f-a81d-b3a3a6af0db6 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:14.429543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51f7b6-788e-4b7f-a81d-b3a3a6af0db6 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:14.438900 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 363/736] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:14.442733 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-8d51f7b6-788e-4b7f-a81d-b3a3a6af0db6 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 08 10:49:14.448678 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 374/737] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:14 2021] GET /identity/v3/services/network => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:14.449719 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1fd93-5c0a-421b-a617-2beaff026df9 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:14.455015 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51f7b6-788e-4b7f-a81d-b3a3a6af0db6 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:14.459686 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1fd93-5c0a-421b-a617-2beaff026df9 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:14.466974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5598d-f8d7-4325-8b78-a4fe638aa79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:14.468971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5598d-f8d7-4325-8b78-a4fe638aa79e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.468971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5598d-f8d7-4325-8b78-a4fe638aa79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.468971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5598d-f8d7-4325-8b78-a4fe638aa79e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.471984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51f7b6-788e-4b7f-a81d-b3a3a6af0db6 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:14.480929 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5598d-f8d7-4325-8b78-a4fe638aa79e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:14.480929 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5598d-f8d7-4325-8b78-a4fe638aa79e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:14.486885 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c0407-428c-4c26-89dd-f0ceab5ee206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:14.487589 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c0407-428c-4c26-89dd-f0ceab5ee206 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.487866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c0407-428c-4c26-89dd-f0ceab5ee206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.488135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c0407-428c-4c26-89dd-f0ceab5ee206 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.488858 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c0407-428c-4c26-89dd-f0ceab5ee206 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:14.489163 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c0407-428c-4c26-89dd-f0ceab5ee206 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:14.490760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c0407-428c-4c26-89dd-f0ceab5ee206 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:14.499061 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-aca5598d-f8d7-4325-8b78-a4fe638aa79e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:14.500904 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 364/738] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:14.502257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 375/739] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Nov 8 10:49:14 2021] GET /identity/v3/services?name=network => generated 124 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:14.507403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c0407-428c-4c26-89dd-f0ceab5ee206 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:14.507528 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5598d-f8d7-4325-8b78-a4fe638aa79e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:14.518359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5598d-f8d7-4325-8b78-a4fe638aa79e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:14.523200 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d40129-9e93-478b-9ac0-7cdde456ef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:14.523544 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c0407-428c-4c26-89dd-f0ceab5ee206 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:14.524144 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40129-9e93-478b-9ac0-7cdde456ef67 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.524665 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40129-9e93-478b-9ac0-7cdde456ef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.525005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40129-9e93-478b-9ac0-7cdde456ef67 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.526204 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d40129-9e93-478b-9ac0-7cdde456ef67 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:14.526630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d40129-9e93-478b-9ac0-7cdde456ef67 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:14.528844 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d40129-9e93-478b-9ac0-7cdde456ef67 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:14.529192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f0761-fe31-418e-a931-b6dd7436a432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:14.529992 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f0761-fe31-418e-a931-b6dd7436a432 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.530407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f0761-fe31-418e-a931-b6dd7436a432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.530816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f0761-fe31-418e-a931-b6dd7436a432 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.531791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f0761-fe31-418e-a931-b6dd7436a432 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:14.532226 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f0761-fe31-418e-a931-b6dd7436a432 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:14.534574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f0761-fe31-418e-a931-b6dd7436a432 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:14.539156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 365/740] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Nov 8 10:49:14 2021] GET /identity/v3/services?type=network => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:14.541513 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d40129-9e93-478b-9ac0-7cdde456ef67 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:14.559995 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d40129-9e93-478b-9ac0-7cdde456ef67 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:14.563409 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 376/741] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:14.571585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f0761-fe31-418e-a931-b6dd7436a432 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:14.575868 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868b344-2b4f-4fd8-8396-b6b7744c8269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:14.576560 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868b344-2b4f-4fd8-8396-b6b7744c8269 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.576852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868b344-2b4f-4fd8-8396-b6b7744c8269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.577132 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868b344-2b4f-4fd8-8396-b6b7744c8269 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.577909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868b344-2b4f-4fd8-8396-b6b7744c8269 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:14.583259 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868b344-2b4f-4fd8-8396-b6b7744c8269 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:14.587266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f0761-fe31-418e-a931-b6dd7436a432 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:14.597753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6e0d6-1f47-4cc5-a7bf-d4b38057eca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:14.598420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6e0d6-1f47-4cc5-a7bf-d4b38057eca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:14.598715 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6e0d6-1f47-4cc5-a7bf-d4b38057eca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:14.598999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6e0d6-1f47-4cc5-a7bf-d4b38057eca3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:14.599896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6e0d6-1f47-4cc5-a7bf-d4b38057eca3 admin admin] RBAC: Adding query filter params (role.id=2ba23f9ef2de43a6bf86f97ccf919c68, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=f9fc539f38364a648b9a4c25d3dbea8c) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:14.600224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6e0d6-1f47-4cc5-a7bf-d4b38057eca3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:14.602328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6e0d6-1f47-4cc5-a7bf-d4b38057eca3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:14.611199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 377/742] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:14 2021] GET /identity/v3/role_assignments?user.id=f9fc539f38364a648b9a4c25d3dbea8c&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=2ba23f9ef2de43a6bf86f97ccf919c68 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:14.623967 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 366/743] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Nov 8 10:49:14 2021] POST /identity/v3/endpoints => generated 327 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:49:15.123782 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6babaf9-4f35-4416-a26c-15ee36e9dc1e None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:15.124311 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6babaf9-4f35-4416-a26c-15ee36e9dc1e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:15.124393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6babaf9-4f35-4416-a26c-15ee36e9dc1e None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:15.126138 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 378/744] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:49:15.133199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689bf36-1dc8-41ff-a86e-fb79c3c8d0c7 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:15.134000 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689bf36-1dc8-41ff-a86e-fb79c3c8d0c7 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:15.134454 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689bf36-1dc8-41ff-a86e-fb79c3c8d0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:15.153245 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-2689bf36-1dc8-41ff-a86e-fb79c3c8d0c7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:15.154631 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2689bf36-1dc8-41ff-a86e-fb79c3c8d0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:15.175228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 367/745] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:15 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:15.195572 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6babaf9-4f35-4416-a26c-15ee36e9dc1e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:15.208584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6babaf9-4f35-4416-a26c-15ee36e9dc1e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:15.213333 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ad68-67c4-4c43-8283-6087a0704b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:15.214358 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ad68-67c4-4c43-8283-6087a0704b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:15.214785 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ad68-67c4-4c43-8283-6087a0704b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:15.215303 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ad68-67c4-4c43-8283-6087a0704b41 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:15.216116 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75ad68-67c4-4c43-8283-6087a0704b41 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:15.217931 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75ad68-67c4-4c43-8283-6087a0704b41 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:15.229870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-ee75ad68-67c4-4c43-8283-6087a0704b41 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 08 10:49:15.235235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 379/746] 10.222.0.20 () {56 vars in 1153 bytes} [Mon Nov 8 10:49:15 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:15.238545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689bf36-1dc8-41ff-a86e-fb79c3c8d0c7 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:15.247894 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689bf36-1dc8-41ff-a86e-fb79c3c8d0c7 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:15.252892 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09089b0a-1b75-435f-aaaf-ab85328f8bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:15.253740 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09089b0a-1b75-435f-aaaf-ab85328f8bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:15.254214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09089b0a-1b75-435f-aaaf-ab85328f8bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:15.254652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09089b0a-1b75-435f-aaaf-ab85328f8bc0 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:15.255613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09089b0a-1b75-435f-aaaf-ab85328f8bc0 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:15.256062 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09089b0a-1b75-435f-aaaf-ab85328f8bc0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:15.257825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09089b0a-1b75-435f-aaaf-ab85328f8bc0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:15.267291 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 368/747] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Nov 8 10:49:15 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:15.270147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ad68-67c4-4c43-8283-6087a0704b41 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:15.280630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ad68-67c4-4c43-8283-6087a0704b41 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:15.285609 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee18d9-66f4-428b-aacf-d70a2d3a1791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:15.286478 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee18d9-66f4-428b-aacf-d70a2d3a1791 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:15.286949 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee18d9-66f4-428b-aacf-d70a2d3a1791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:15.287425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee18d9-66f4-428b-aacf-d70a2d3a1791 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:15.288292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee18d9-66f4-428b-aacf-d70a2d3a1791 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:15.288783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee18d9-66f4-428b-aacf-d70a2d3a1791 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:15.290584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee18d9-66f4-428b-aacf-d70a2d3a1791 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:15.303310 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 380/748] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Nov 8 10:49:15 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:16.013528 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6727025-af24-4775-9fe2-14f8db52dd65 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.013914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6727025-af24-4775-9fe2-14f8db52dd65 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.014089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6727025-af24-4775-9fe2-14f8db52dd65 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.016203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 369/749] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:16.023036 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eec1f4-317c-4263-ac6a-744890e2d4f2 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.023360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eec1f4-317c-4263-ac6a-744890e2d4f2 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.023639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eec1f4-317c-4263-ac6a-744890e2d4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.042737 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-d3eec1f4-317c-4263-ac6a-744890e2d4f2 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:16.044057 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d3eec1f4-317c-4263-ac6a-744890e2d4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:16.059014 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 381/750] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:16 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:16.078174 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6727025-af24-4775-9fe2-14f8db52dd65 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.090614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6727025-af24-4775-9fe2-14f8db52dd65 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.094969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173de90b-a4c1-409f-b253-b4642fcf25cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.095879 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173de90b-a4c1-409f-b253-b4642fcf25cd admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.096160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173de90b-a4c1-409f-b253-b4642fcf25cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.096431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173de90b-a4c1-409f-b253-b4642fcf25cd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.107591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173de90b-a4c1-409f-b253-b4642fcf25cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:16.114872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-173de90b-a4c1-409f-b253-b4642fcf25cd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:49:16.121621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 370/751] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:16.123487 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eec1f4-317c-4263-ac6a-744890e2d4f2 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.133190 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eec1f4-317c-4263-ac6a-744890e2d4f2 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.137816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28fc7a-176f-4809-8943-2fd246669058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.138485 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28fc7a-176f-4809-8943-2fd246669058 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.138768 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28fc7a-176f-4809-8943-2fd246669058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.139040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28fc7a-176f-4809-8943-2fd246669058 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.139851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28fc7a-176f-4809-8943-2fd246669058 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:16.140154 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28fc7a-176f-4809-8943-2fd246669058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:16.142144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28fc7a-176f-4809-8943-2fd246669058 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:16.155259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 382/752] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:16.158417 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173de90b-a4c1-409f-b253-b4642fcf25cd admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.169037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173de90b-a4c1-409f-b253-b4642fcf25cd admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.173662 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60885eaf-8c5a-476c-b1ba-0707cd7bd337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.174497 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60885eaf-8c5a-476c-b1ba-0707cd7bd337 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.174813 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60885eaf-8c5a-476c-b1ba-0707cd7bd337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.175099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60885eaf-8c5a-476c-b1ba-0707cd7bd337 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.185972 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60885eaf-8c5a-476c-b1ba-0707cd7bd337 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:16.187909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60885eaf-8c5a-476c-b1ba-0707cd7bd337 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:16.205172 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-60885eaf-8c5a-476c-b1ba-0707cd7bd337 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:16.211236 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 371/753] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:16.213594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28fc7a-176f-4809-8943-2fd246669058 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.223999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28fc7a-176f-4809-8943-2fd246669058 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.228690 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60e9ee-c88d-48c9-8934-65fa86461e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.229359 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60e9ee-c88d-48c9-8934-65fa86461e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.229643 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60e9ee-c88d-48c9-8934-65fa86461e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.229923 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60e9ee-c88d-48c9-8934-65fa86461e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.230727 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60e9ee-c88d-48c9-8934-65fa86461e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:16.231038 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60e9ee-c88d-48c9-8934-65fa86461e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:16.232851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60e9ee-c88d-48c9-8934-65fa86461e34 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:16.250576 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 383/754] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:16.252830 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60885eaf-8c5a-476c-b1ba-0707cd7bd337 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.263152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60885eaf-8c5a-476c-b1ba-0707cd7bd337 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.268389 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46d4b1-5f34-4b58-90e6-bd61fad571f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.269132 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46d4b1-5f34-4b58-90e6-bd61fad571f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.269415 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46d4b1-5f34-4b58-90e6-bd61fad571f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.269739 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46d4b1-5f34-4b58-90e6-bd61fad571f2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.277617 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46d4b1-5f34-4b58-90e6-bd61fad571f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:16.279775 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46d4b1-5f34-4b58-90e6-bd61fad571f2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:16.296109 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-9d46d4b1-5f34-4b58-90e6-bd61fad571f2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 08 10:49:16.302191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 372/755] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:16.304697 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60e9ee-c88d-48c9-8934-65fa86461e34 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.315480 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60e9ee-c88d-48c9-8934-65fa86461e34 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.320233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd375807-54ec-4507-bffe-c64c862b1070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.320953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd375807-54ec-4507-bffe-c64c862b1070 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.321235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd375807-54ec-4507-bffe-c64c862b1070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.321508 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd375807-54ec-4507-bffe-c64c862b1070 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.322475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd375807-54ec-4507-bffe-c64c862b1070 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:16.322787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd375807-54ec-4507-bffe-c64c862b1070 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:16.324805 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd375807-54ec-4507-bffe-c64c862b1070 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:16.346783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 384/756] 10.222.0.20 () {56 vars in 1156 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:16.350123 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46d4b1-5f34-4b58-90e6-bd61fad571f2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.360462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46d4b1-5f34-4b58-90e6-bd61fad571f2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.365358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51045-624c-49f5-a156-c7d1967be031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.366003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51045-624c-49f5-a156-c7d1967be031 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.366329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51045-624c-49f5-a156-c7d1967be031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.366606 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51045-624c-49f5-a156-c7d1967be031 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.374891 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f51045-624c-49f5-a156-c7d1967be031 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:16.376913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f51045-624c-49f5-a156-c7d1967be031 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:16.386264 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 373/757] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:49:16.393605 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd375807-54ec-4507-bffe-c64c862b1070 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.403675 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd375807-54ec-4507-bffe-c64c862b1070 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.408556 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29465c2-1c9c-4a34-9536-b7fb80f4752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.409425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29465c2-1c9c-4a34-9536-b7fb80f4752c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.409714 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29465c2-1c9c-4a34-9536-b7fb80f4752c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.409987 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29465c2-1c9c-4a34-9536-b7fb80f4752c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.422476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29465c2-1c9c-4a34-9536-b7fb80f4752c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:16.424945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29465c2-1c9c-4a34-9536-b7fb80f4752c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:16.443066 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-e29465c2-1c9c-4a34-9536-b7fb80f4752c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:16.449215 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 385/758] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:16.451110 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51045-624c-49f5-a156-c7d1967be031 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.460476 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51045-624c-49f5-a156-c7d1967be031 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.466843 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ea84a-60c8-4752-ba7d-149b9fc57f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.467594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ea84a-60c8-4752-ba7d-149b9fc57f75 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.467879 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ea84a-60c8-4752-ba7d-149b9fc57f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.468163 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ea84a-60c8-4752-ba7d-149b9fc57f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.468906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ea84a-60c8-4752-ba7d-149b9fc57f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:16.469211 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ea84a-60c8-4752-ba7d-149b9fc57f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:16.470952 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ea84a-60c8-4752-ba7d-149b9fc57f75 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:16.491237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 374/759] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:16.493417 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29465c2-1c9c-4a34-9536-b7fb80f4752c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.503597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29465c2-1c9c-4a34-9536-b7fb80f4752c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.508506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea079d-686d-42e2-829f-061e1371e1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.509368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea079d-686d-42e2-829f-061e1371e1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.509653 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea079d-686d-42e2-829f-061e1371e1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.509981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea079d-686d-42e2-829f-061e1371e1f5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.518702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea079d-686d-42e2-829f-061e1371e1f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:16.520791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea079d-686d-42e2-829f-061e1371e1f5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:16.536590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-98ea079d-686d-42e2-829f-061e1371e1f5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:16.542661 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 386/760] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:16.545467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ea84a-60c8-4752-ba7d-149b9fc57f75 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.556764 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ea84a-60c8-4752-ba7d-149b9fc57f75 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.561679 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefe032-d566-4c23-b939-5de8fcfb0db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.562418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefe032-d566-4c23-b939-5de8fcfb0db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.562699 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefe032-d566-4c23-b939-5de8fcfb0db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.563027 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefe032-d566-4c23-b939-5de8fcfb0db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.563884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefe032-d566-4c23-b939-5de8fcfb0db2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:16.564397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefe032-d566-4c23-b939-5de8fcfb0db2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:16.566789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefe032-d566-4c23-b939-5de8fcfb0db2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:16.585415 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 375/761] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:16.586794 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea079d-686d-42e2-829f-061e1371e1f5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.598958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea079d-686d-42e2-829f-061e1371e1f5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.603731 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd13a13-5451-43e7-86d2-cd0389a9eb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.604380 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd13a13-5451-43e7-86d2-cd0389a9eb1a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.604707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd13a13-5451-43e7-86d2-cd0389a9eb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.605079 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd13a13-5451-43e7-86d2-cd0389a9eb1a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.605923 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd13a13-5451-43e7-86d2-cd0389a9eb1a admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=029506cc966a44c9bbe83eb084ac6feb) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:16.606236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd13a13-5451-43e7-86d2-cd0389a9eb1a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:16.608412 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd13a13-5451-43e7-86d2-cd0389a9eb1a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:16.619267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 387/762] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/role_assignments?user.id=029506cc966a44c9bbe83eb084ac6feb&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:16.675334 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379638e-3cc7-4792-b630-9cb807e27279 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.675655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379638e-3cc7-4792-b630-9cb807e27279 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.675884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379638e-3cc7-4792-b630-9cb807e27279 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.678004 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 376/763] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:16.684609 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faae80-bb78-4fca-a347-228471be1320 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.684951 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faae80-bb78-4fca-a347-228471be1320 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.685164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faae80-bb78-4fca-a347-228471be1320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.704100 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-b3faae80-bb78-4fca-a347-228471be1320 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:16.705357 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b3faae80-bb78-4fca-a347-228471be1320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:16.713582 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 388/764] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:16 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:16.736619 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379638e-3cc7-4792-b630-9cb807e27279 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.749499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379638e-3cc7-4792-b630-9cb807e27279 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.754196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c149d2c-0f34-41a1-88f3-99751eee5d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.755034 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149d2c-0f34-41a1-88f3-99751eee5d59 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.755362 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149d2c-0f34-41a1-88f3-99751eee5d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.755636 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149d2c-0f34-41a1-88f3-99751eee5d59 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.756327 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c149d2c-0f34-41a1-88f3-99751eee5d59 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:16.757986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c149d2c-0f34-41a1-88f3-99751eee5d59 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:16.770502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-9c149d2c-0f34-41a1-88f3-99751eee5d59 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 08 10:49:16.772105 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 377/765] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:16.778913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faae80-bb78-4fca-a347-228471be1320 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.788474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faae80-bb78-4fca-a347-228471be1320 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.793304 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba3eaa-c2ba-4113-809b-43a5bf67a93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.793990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba3eaa-c2ba-4113-809b-43a5bf67a93f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.794313 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba3eaa-c2ba-4113-809b-43a5bf67a93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.794590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba3eaa-c2ba-4113-809b-43a5bf67a93f admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.795360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba3eaa-c2ba-4113-809b-43a5bf67a93f admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:16.795718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba3eaa-c2ba-4113-809b-43a5bf67a93f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:16.797390 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba3eaa-c2ba-4113-809b-43a5bf67a93f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:16.803087 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 389/766] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:16.809591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c149d2c-0f34-41a1-88f3-99751eee5d59 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:16.820519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c149d2c-0f34-41a1-88f3-99751eee5d59 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:16.825353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977597-30f8-40ef-a3ec-bd7acdaaf16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:16.826147 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977597-30f8-40ef-a3ec-bd7acdaaf16e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:16.826429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977597-30f8-40ef-a3ec-bd7acdaaf16e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:16.826705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977597-30f8-40ef-a3ec-bd7acdaaf16e admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:16.827528 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f977597-30f8-40ef-a3ec-bd7acdaaf16e admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:16.827833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f977597-30f8-40ef-a3ec-bd7acdaaf16e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:16.829532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f977597-30f8-40ef-a3ec-bd7acdaaf16e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:16.835362 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 378/767] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:49:16 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:17.158375 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce98587-d27e-4111-8c42-bd9dfc3b6434 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.159049 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce98587-d27e-4111-8c42-bd9dfc3b6434 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.159049 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce98587-d27e-4111-8c42-bd9dfc3b6434 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.160878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 390/768] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:17.167072 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9bf3-2bf5-4544-bdd3-449535fda148 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.167640 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9bf3-2bf5-4544-bdd3-449535fda148 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.167640 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9bf3-2bf5-4544-bdd3-449535fda148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.185641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-ccab9bf3-2bf5-4544-bdd3-449535fda148 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:17.186824 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-ccab9bf3-2bf5-4544-bdd3-449535fda148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:17.194852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 379/769] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:17 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:17.218493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce98587-d27e-4111-8c42-bd9dfc3b6434 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:17.231041 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce98587-d27e-4111-8c42-bd9dfc3b6434 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:17.235429 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76997-f9c0-4ba2-a3d5-01790774d209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:17.236288 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76997-f9c0-4ba2-a3d5-01790774d209 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.236570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76997-f9c0-4ba2-a3d5-01790774d209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.236839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76997-f9c0-4ba2-a3d5-01790774d209 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.247245 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d76997-f9c0-4ba2-a3d5-01790774d209 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:17.254675 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-a4d76997-f9c0-4ba2-a3d5-01790774d209 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 08 10:49:17.256280 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 391/770] 10.222.0.20 () {56 vars in 1141 bytes} [Mon Nov 8 10:49:17 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:17.262666 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab9bf3-2bf5-4544-bdd3-449535fda148 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:17.272487 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab9bf3-2bf5-4544-bdd3-449535fda148 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:17.277039 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70517dff-e094-4e7b-afb3-b83e5e25b8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:17.277741 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70517dff-e094-4e7b-afb3-b83e5e25b8fb admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.278023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70517dff-e094-4e7b-afb3-b83e5e25b8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.278294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70517dff-e094-4e7b-afb3-b83e5e25b8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.279060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70517dff-e094-4e7b-afb3-b83e5e25b8fb admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:17.279390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70517dff-e094-4e7b-afb3-b83e5e25b8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:17.280991 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70517dff-e094-4e7b-afb3-b83e5e25b8fb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:17.289685 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 380/771] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Nov 8 10:49:17 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:17.295859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76997-f9c0-4ba2-a3d5-01790774d209 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:17.305694 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76997-f9c0-4ba2-a3d5-01790774d209 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:17.310256 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209ae41-131a-40e2-9b39-9504899c04ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:17.311092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209ae41-131a-40e2-9b39-9504899c04ff admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.311410 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209ae41-131a-40e2-9b39-9504899c04ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.311736 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209ae41-131a-40e2-9b39-9504899c04ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.322796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209ae41-131a-40e2-9b39-9504899c04ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:17.324773 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209ae41-131a-40e2-9b39-9504899c04ff admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:17.341533 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-f209ae41-131a-40e2-9b39-9504899c04ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:17.343006 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 392/772] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:17.349622 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70517dff-e094-4e7b-afb3-b83e5e25b8fb admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:17.359687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70517dff-e094-4e7b-afb3-b83e5e25b8fb admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:17.364656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b21ee6-d4e2-42d9-b279-e95f7b45491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:17.365354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21ee6-d4e2-42d9-b279-e95f7b45491d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.365633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21ee6-d4e2-42d9-b279-e95f7b45491d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.365902 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21ee6-d4e2-42d9-b279-e95f7b45491d admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.366696 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b21ee6-d4e2-42d9-b279-e95f7b45491d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:17.367000 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b21ee6-d4e2-42d9-b279-e95f7b45491d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:17.368718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b21ee6-d4e2-42d9-b279-e95f7b45491d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:17.381068 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 381/773] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:17.387238 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209ae41-131a-40e2-9b39-9504899c04ff admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:17.397725 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209ae41-131a-40e2-9b39-9504899c04ff admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:17.403725 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cff87-191b-4e3d-a79c-a96eeeb936ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:17.404592 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cff87-191b-4e3d-a79c-a96eeeb936ab admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.404876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cff87-191b-4e3d-a79c-a96eeeb936ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.405148 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cff87-191b-4e3d-a79c-a96eeeb936ab admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.414010 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cff87-191b-4e3d-a79c-a96eeeb936ab admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:17.416115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cff87-191b-4e3d-a79c-a96eeeb936ab admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:17.430403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-7b7cff87-191b-4e3d-a79c-a96eeeb936ab admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 08 10:49:17.432127 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 393/774] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Nov 8 10:49:17 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:17.437948 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b21ee6-d4e2-42d9-b279-e95f7b45491d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:17.448955 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b21ee6-d4e2-42d9-b279-e95f7b45491d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:17.454254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde221b6-27b7-403c-9e66-2b9de91c7d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:17.455160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde221b6-27b7-403c-9e66-2b9de91c7d6e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.455683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde221b6-27b7-403c-9e66-2b9de91c7d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.455970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde221b6-27b7-403c-9e66-2b9de91c7d6e admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.457069 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde221b6-27b7-403c-9e66-2b9de91c7d6e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:17.457390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde221b6-27b7-403c-9e66-2b9de91c7d6e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:17.459537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde221b6-27b7-403c-9e66-2b9de91c7d6e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:17.480618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 382/775] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Nov 8 10:49:17 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:17.488244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cff87-191b-4e3d-a79c-a96eeeb936ab admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:17.498707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cff87-191b-4e3d-a79c-a96eeeb936ab admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:17.503864 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96fdde-3fbd-4c73-8cba-894f70f793ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:17.504529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96fdde-3fbd-4c73-8cba-894f70f793ae admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.504857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96fdde-3fbd-4c73-8cba-894f70f793ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.505127 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96fdde-3fbd-4c73-8cba-894f70f793ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.514525 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96fdde-3fbd-4c73-8cba-894f70f793ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:17.516405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96fdde-3fbd-4c73-8cba-894f70f793ae admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:17.527780 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 394/776] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:17 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:49:17.534666 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde221b6-27b7-403c-9e66-2b9de91c7d6e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:17.544908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde221b6-27b7-403c-9e66-2b9de91c7d6e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:17.549789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755b644-3100-4b60-b420-0d823836636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:17.550693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755b644-3100-4b60-b420-0d823836636b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.550981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755b644-3100-4b60-b420-0d823836636b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.551293 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755b644-3100-4b60-b420-0d823836636b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.562212 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755b644-3100-4b60-b420-0d823836636b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:17.564156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755b644-3100-4b60-b420-0d823836636b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:17.582835 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-d755b644-3100-4b60-b420-0d823836636b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:17.584416 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 383/777] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:17.590699 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96fdde-3fbd-4c73-8cba-894f70f793ae admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:17.599956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96fdde-3fbd-4c73-8cba-894f70f793ae admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:17.604565 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6cc37-85da-4987-996b-0540a9a72271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:17.605230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6cc37-85da-4987-996b-0540a9a72271 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.605509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6cc37-85da-4987-996b-0540a9a72271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.605784 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6cc37-85da-4987-996b-0540a9a72271 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.606514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6cc37-85da-4987-996b-0540a9a72271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:17.606816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6cc37-85da-4987-996b-0540a9a72271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:17.608447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6cc37-85da-4987-996b-0540a9a72271 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:17.621344 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 395/778] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:17.627520 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755b644-3100-4b60-b420-0d823836636b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:17.637734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755b644-3100-4b60-b420-0d823836636b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:17.642796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d17db5-df01-4ef7-8c5a-9130632da20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:17.643711 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d17db5-df01-4ef7-8c5a-9130632da20e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.643988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d17db5-df01-4ef7-8c5a-9130632da20e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.644257 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d17db5-df01-4ef7-8c5a-9130632da20e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.653479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d17db5-df01-4ef7-8c5a-9130632da20e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:17.655955 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d17db5-df01-4ef7-8c5a-9130632da20e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:17.661308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f904d-fecc-48ac-a570-568d1a2f5d05 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.661308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f904d-fecc-48ac-a570-568d1a2f5d05 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.661308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f904d-fecc-48ac-a570-568d1a2f5d05 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.662661 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 396/779] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:17 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:49:17.669283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5c2d5-b730-4949-8e94-a3852d769767 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.669614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5c2d5-b730-4949-8e94-a3852d769767 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.669981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5c2d5-b730-4949-8e94-a3852d769767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.674563 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-06d17db5-df01-4ef7-8c5a-9130632da20e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:17.676325 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 384/780] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:17.682143 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d17db5-df01-4ef7-8c5a-9130632da20e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:17.691603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-70a5c2d5-b730-4949-8e94-a3852d769767 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:17.692424 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d17db5-df01-4ef7-8c5a-9130632da20e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:17.693253 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-70a5c2d5-b730-4949-8e94-a3852d769767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:17.697111 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13437512-176d-4227-9d46-0a0ea2507bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:17.697759 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13437512-176d-4227-9d46-0a0ea2507bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.698093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13437512-176d-4227-9d46-0a0ea2507bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.698367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13437512-176d-4227-9d46-0a0ea2507bb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.699310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13437512-176d-4227-9d46-0a0ea2507bb6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:17.699618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13437512-176d-4227-9d46-0a0ea2507bb6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:17.701451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13437512-176d-4227-9d46-0a0ea2507bb6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:17.703674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 397/781] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:17 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:17.714016 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 385/782] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:17.720567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5c2d5-b730-4949-8e94-a3852d769767 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:17.727669 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13437512-176d-4227-9d46-0a0ea2507bb6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:17.729834 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5c2d5-b730-4949-8e94-a3852d769767 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:17.734534 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9545147-9e1d-49a7-aa32-d5952c5bd95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:17.735369 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9545147-9e1d-49a7-aa32-d5952c5bd95c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.735720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9545147-9e1d-49a7-aa32-d5952c5bd95c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.736121 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9545147-9e1d-49a7-aa32-d5952c5bd95c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.737032 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9545147-9e1d-49a7-aa32-d5952c5bd95c admin admin] RBAC: Adding query filter params (role.id=84142a61c6044699aebb0fc5df7f6922, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=f9fc539f38364a648b9a4c25d3dbea8c) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:17.737407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9545147-9e1d-49a7-aa32-d5952c5bd95c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:17.737817 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13437512-176d-4227-9d46-0a0ea2507bb6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:17.739602 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9545147-9e1d-49a7-aa32-d5952c5bd95c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:17.742492 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7f9e5-cd21-41e2-abc4-8d5bebfa6ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:17.743175 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7f9e5-cd21-41e2-abc4-8d5bebfa6ffb admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:17.743466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7f9e5-cd21-41e2-abc4-8d5bebfa6ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:17.743740 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7f9e5-cd21-41e2-abc4-8d5bebfa6ffb admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:17.744477 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7f9e5-cd21-41e2-abc4-8d5bebfa6ffb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:17.745493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-78f7f9e5-cd21-41e2-abc4-8d5bebfa6ffb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:49:17.745493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:49:17.745493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:49:17.746360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7f9e5-cd21-41e2-abc4-8d5bebfa6ffb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:17.747035 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 398/783] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:17 2021] GET /identity/v3/role_assignments?user.id=f9fc539f38364a648b9a4c25d3dbea8c&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=84142a61c6044699aebb0fc5df7f6922 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:17.764767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 386/784] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Nov 8 10:49:17 2021] POST /identity/v3/services => generated 269 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 10:49:19.048375 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c06e47-2923-4c74-92ef-1b7fe11d008a None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:19.049538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c06e47-2923-4c74-92ef-1b7fe11d008a None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:19.049538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c06e47-2923-4c74-92ef-1b7fe11d008a None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:19.051116 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 399/785] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:19.057534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae03b73-53d4-42ed-9b69-d1f9168274eb None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:19.057959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae03b73-53d4-42ed-9b69-d1f9168274eb None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:19.058128 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae03b73-53d4-42ed-9b69-d1f9168274eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:19.076584 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-5ae03b73-53d4-42ed-9b69-d1f9168274eb None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:19.077794 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5ae03b73-53d4-42ed-9b69-d1f9168274eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:19.099243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 387/786] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:19 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:19.118963 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c06e47-2923-4c74-92ef-1b7fe11d008a None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:19.137848 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aa037-3354-4cd3-8af1-86d5c1aaea14 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:19.138163 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aa037-3354-4cd3-8af1-86d5c1aaea14 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:19.138400 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aa037-3354-4cd3-8af1-86d5c1aaea14 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:19.140401 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 388/787] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:19.141977 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c06e47-2923-4c74-92ef-1b7fe11d008a None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:19.147335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce3a12-b32d-4dc3-803e-c5cb2e7c9ae4 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:19.147621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce3a12-b32d-4dc3-803e-c5cb2e7c9ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:19.147851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d0d69-487e-4507-88cc-41a588e58d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:19.147984 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce3a12-b32d-4dc3-803e-c5cb2e7c9ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:19.148670 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d0d69-487e-4507-88cc-41a588e58d61 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:19.148950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d0d69-487e-4507-88cc-41a588e58d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:19.149216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d0d69-487e-4507-88cc-41a588e58d61 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:19.149881 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d0d69-487e-4507-88cc-41a588e58d61 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:19.151558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d0d69-487e-4507-88cc-41a588e58d61 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:19.166348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-d9ce3a12-b32d-4dc3-803e-c5cb2e7c9ae4 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:19.167573 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d9ce3a12-b32d-4dc3-803e-c5cb2e7c9ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:19.168000 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-a62d0d69-487e-4507-88cc-41a588e58d61 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 08 10:49:19.175492 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 400/788] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Nov 8 10:49:19 2021] GET /identity/v3/services/object-store => generated 93 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:19.175861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 389/789] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:19 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:19.177496 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d0d69-487e-4507-88cc-41a588e58d61 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:19.188147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d0d69-487e-4507-88cc-41a588e58d61 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:19.193016 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82191c7e-1b00-42c6-a0fd-c7251aea9926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:19.193665 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191c7e-1b00-42c6-a0fd-c7251aea9926 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:19.193947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191c7e-1b00-42c6-a0fd-c7251aea9926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:19.194224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191c7e-1b00-42c6-a0fd-c7251aea9926 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:19.194949 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82191c7e-1b00-42c6-a0fd-c7251aea9926 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:19.195305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82191c7e-1b00-42c6-a0fd-c7251aea9926 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:19.196908 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82191c7e-1b00-42c6-a0fd-c7251aea9926 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:19.201952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 401/790] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Nov 8 10:49:19 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:19.208244 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce3a12-b32d-4dc3-803e-c5cb2e7c9ae4 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:19.210131 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82191c7e-1b00-42c6-a0fd-c7251aea9926 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:19.218681 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce3a12-b32d-4dc3-803e-c5cb2e7c9ae4 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:19.221223 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82191c7e-1b00-42c6-a0fd-c7251aea9926 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:19.224300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548c3f0-b06c-406c-ab7f-a291c26b600f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:19.225212 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548c3f0-b06c-406c-ab7f-a291c26b600f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:19.225570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548c3f0-b06c-406c-ab7f-a291c26b600f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:19.225914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548c3f0-b06c-406c-ab7f-a291c26b600f admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:19.226767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652820a-034b-46cd-874f-2636fc004f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:19.226895 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548c3f0-b06c-406c-ab7f-a291c26b600f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:19.227215 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548c3f0-b06c-406c-ab7f-a291c26b600f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:19.227929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652820a-034b-46cd-874f-2636fc004f62 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:19.228384 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652820a-034b-46cd-874f-2636fc004f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:19.228852 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652820a-034b-46cd-874f-2636fc004f62 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:19.229088 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548c3f0-b06c-406c-ab7f-a291c26b600f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:19.229960 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652820a-034b-46cd-874f-2636fc004f62 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:19.232525 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652820a-034b-46cd-874f-2636fc004f62 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:19.239156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 390/791] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Nov 8 10:49:19 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:19.256341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 402/792] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Nov 8 10:49:19 2021] POST /identity/v3/services => generated 251 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 10:49:20.059511 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81634b0-573c-49d1-80a2-5bd4c96c24b6 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.060038 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81634b0-573c-49d1-80a2-5bd4c96c24b6 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.060038 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81634b0-573c-49d1-80a2-5bd4c96c24b6 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.062070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 391/793] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:20.068646 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6f6a-ea67-421b-92fd-1d15e9aa8ace None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.069119 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6f6a-ea67-421b-92fd-1d15e9aa8ace None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.069196 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6f6a-ea67-421b-92fd-1d15e9aa8ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.087455 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-ebff6f6a-ea67-421b-92fd-1d15e9aa8ace None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:20.088651 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ebff6f6a-ea67-421b-92fd-1d15e9aa8ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:20.105555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 403/794] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:20 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:20.125029 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1a67e-f4d8-412e-8405-202ff0d0b167 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.125327 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1a67e-f4d8-412e-8405-202ff0d0b167 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.125580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1a67e-f4d8-412e-8405-202ff0d0b167 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.127801 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 392/795] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:20.130477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff6f6a-ea67-421b-92fd-1d15e9aa8ace None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.136080 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4bfd4-7ea6-449a-9c31-29fa81090b8f None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.136635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4bfd4-7ea6-449a-9c31-29fa81090b8f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.137101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4bfd4-7ea6-449a-9c31-29fa81090b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.140179 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff6f6a-ea67-421b-92fd-1d15e9aa8ace None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.145267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a892d74-dec7-42f0-820c-af4b64fa184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.146086 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892d74-dec7-42f0-820c-af4b64fa184a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.146365 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892d74-dec7-42f0-820c-af4b64fa184a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.146637 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892d74-dec7-42f0-820c-af4b64fa184a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.156315 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-7fb4bfd4-7ea6-449a-9c31-29fa81090b8f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:20.157364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a892d74-dec7-42f0-820c-af4b64fa184a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:20.158349 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-7fb4bfd4-7ea6-449a-9c31-29fa81090b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:20.165410 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-9a892d74-dec7-42f0-820c-af4b64fa184a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 08 10:49:20.166911 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 404/797] 10.222.0.20 () {56 vars in 1141 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:20.167108 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 393/797] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:20 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:20.173216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a892d74-dec7-42f0-820c-af4b64fa184a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.182995 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a892d74-dec7-42f0-820c-af4b64fa184a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.187503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d2968-c0a9-4b45-8a9f-451fc4f0ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.188156 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2968-c0a9-4b45-8a9f-451fc4f0ca42 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.188435 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2968-c0a9-4b45-8a9f-451fc4f0ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.188706 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2968-c0a9-4b45-8a9f-451fc4f0ca42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.189621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d2968-c0a9-4b45-8a9f-451fc4f0ca42 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:20.189922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d2968-c0a9-4b45-8a9f-451fc4f0ca42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.191537 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d2968-c0a9-4b45-8a9f-451fc4f0ca42 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.193636 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4bfd4-7ea6-449a-9c31-29fa81090b8f None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.201088 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 405/798] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:20.203272 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4bfd4-7ea6-449a-9c31-29fa81090b8f None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.207768 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d2968-c0a9-4b45-8a9f-451fc4f0ca42 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.210872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec137b-6167-42f2-b561-9501ed501225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.211947 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec137b-6167-42f2-b561-9501ed501225 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.212444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec137b-6167-42f2-b561-9501ed501225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.212916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec137b-6167-42f2-b561-9501ed501225 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.213774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec137b-6167-42f2-b561-9501ed501225 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.215619 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec137b-6167-42f2-b561-9501ed501225 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.217424 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d2968-c0a9-4b45-8a9f-451fc4f0ca42 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.222141 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03e0c-6a03-4b54-a7ca-38e827a71f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.222928 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03e0c-6a03-4b54-a7ca-38e827a71f46 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.223247 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03e0c-6a03-4b54-a7ca-38e827a71f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.223519 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03e0c-6a03-4b54-a7ca-38e827a71f46 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.228840 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-b6ec137b-6167-42f2-b561-9501ed501225 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 08 10:49:20.230545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 394/799] 10.222.0.20 () {56 vars in 1153 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:20.235203 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e03e0c-6a03-4b54-a7ca-38e827a71f46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.236432 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e03e0c-6a03-4b54-a7ca-38e827a71f46 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.237486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec137b-6167-42f2-b561-9501ed501225 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.247994 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec137b-6167-42f2-b561-9501ed501225 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.252777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db776218-b6bf-4704-92f1-32970940d82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.253526 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776218-b6bf-4704-92f1-32970940d82e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.253931 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776218-b6bf-4704-92f1-32970940d82e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.254299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776218-b6bf-4704-92f1-32970940d82e admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.255112 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db776218-b6bf-4704-92f1-32970940d82e admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:20.255561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db776218-b6bf-4704-92f1-32970940d82e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.256633 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-45e03e0c-6a03-4b54-a7ca-38e827a71f46 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:20.257330 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db776218-b6bf-4704-92f1-32970940d82e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.258416 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 406/800] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:20.264775 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03e0c-6a03-4b54-a7ca-38e827a71f46 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.267198 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 395/801] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:20.269455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db776218-b6bf-4704-92f1-32970940d82e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.277122 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03e0c-6a03-4b54-a7ca-38e827a71f46 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.279991 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db776218-b6bf-4704-92f1-32970940d82e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.282144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e237165-fa4a-4f15-8692-2164285c6425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.283293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e237165-fa4a-4f15-8692-2164285c6425 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.283863 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e237165-fa4a-4f15-8692-2164285c6425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.284326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e237165-fa4a-4f15-8692-2164285c6425 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.284707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07050e2f-a5d3-4eee-8088-07a6243ef0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.285449 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07050e2f-a5d3-4eee-8088-07a6243ef0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.285680 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e237165-fa4a-4f15-8692-2164285c6425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:20.285785 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07050e2f-a5d3-4eee-8088-07a6243ef0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.285987 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07050e2f-a5d3-4eee-8088-07a6243ef0c0 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.286450 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e237165-fa4a-4f15-8692-2164285c6425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.286753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07050e2f-a5d3-4eee-8088-07a6243ef0c0 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:20.287061 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07050e2f-a5d3-4eee-8088-07a6243ef0c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.288661 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e237165-fa4a-4f15-8692-2164285c6425 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.288764 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07050e2f-a5d3-4eee-8088-07a6243ef0c0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.299193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 396/802] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:20.302091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07050e2f-a5d3-4eee-8088-07a6243ef0c0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.305665 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 407/803] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:20.311703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e237165-fa4a-4f15-8692-2164285c6425 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.313686 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07050e2f-a5d3-4eee-8088-07a6243ef0c0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.319493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698b7b7-cae2-4e96-950e-97ee3c4eed4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.320408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698b7b7-cae2-4e96-950e-97ee3c4eed4f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.320881 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698b7b7-cae2-4e96-950e-97ee3c4eed4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.321333 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e237165-fa4a-4f15-8692-2164285c6425 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.321531 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698b7b7-cae2-4e96-950e-97ee3c4eed4f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.322618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698b7b7-cae2-4e96-950e-97ee3c4eed4f admin admin] RBAC: Adding query filter params (interface=public, service_id=317124fe28b542eea5c334b09c262ab8, region_id=RegionOne) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:20.323281 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698b7b7-cae2-4e96-950e-97ee3c4eed4f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.325552 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698b7b7-cae2-4e96-950e-97ee3c4eed4f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.326158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1d5cb-ebe5-4e3a-a5e9-4bd3f7481838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.327068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d5cb-ebe5-4e3a-a5e9-4bd3f7481838 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.327487 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d5cb-ebe5-4e3a-a5e9-4bd3f7481838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.327827 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d5cb-ebe5-4e3a-a5e9-4bd3f7481838 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.338271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 397/804] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/endpoints?service_id=317124fe28b542eea5c334b09c262ab8&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:20.339062 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1d5cb-ebe5-4e3a-a5e9-4bd3f7481838 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.339621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698b7b7-cae2-4e96-950e-97ee3c4eed4f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.341317 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1d5cb-ebe5-4e3a-a5e9-4bd3f7481838 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.351422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698b7b7-cae2-4e96-950e-97ee3c4eed4f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.356140 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384ea75-d340-419b-b3b5-5438defa5b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.356671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-f8b1d5cb-ebe5-4e3a-a5e9-4bd3f7481838 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 08 10:49:20.357190 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384ea75-d340-419b-b3b5-5438defa5b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.357639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384ea75-d340-419b-b3b5-5438defa5b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.358105 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384ea75-d340-419b-b3b5-5438defa5b54 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.358461 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 408/805] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:20.359166 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384ea75-d340-419b-b3b5-5438defa5b54 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.361111 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384ea75-d340-419b-b3b5-5438defa5b54 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.364779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1d5cb-ebe5-4e3a-a5e9-4bd3f7481838 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.368031 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 398/806] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/services => generated 1268 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 10:49:20.381091 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1d5cb-ebe5-4e3a-a5e9-4bd3f7481838 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.385948 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058a42a-fa0f-4ab9-806e-34926e7dba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.386693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058a42a-fa0f-4ab9-806e-34926e7dba92 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.386969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058a42a-fa0f-4ab9-806e-34926e7dba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.387314 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058a42a-fa0f-4ab9-806e-34926e7dba92 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.388198 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058a42a-fa0f-4ab9-806e-34926e7dba92 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:20.388555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058a42a-fa0f-4ab9-806e-34926e7dba92 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.390571 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058a42a-fa0f-4ab9-806e-34926e7dba92 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.411851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 409/807] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:20.418223 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384ea75-d340-419b-b3b5-5438defa5b54 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.428996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384ea75-d340-419b-b3b5-5438defa5b54 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.433804 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adcd25-1476-443c-8a4a-a469f6b3e3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.434682 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adcd25-1476-443c-8a4a-a469f6b3e3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.434956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adcd25-1476-443c-8a4a-a469f6b3e3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.435289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adcd25-1476-443c-8a4a-a469f6b3e3bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.448527 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8adcd25-1476-443c-8a4a-a469f6b3e3bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.450508 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8adcd25-1476-443c-8a4a-a469f6b3e3bf admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.469322 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-d8adcd25-1476-443c-8a4a-a469f6b3e3bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:20.472944 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 399/808] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:20.479884 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058a42a-fa0f-4ab9-806e-34926e7dba92 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.490368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058a42a-fa0f-4ab9-806e-34926e7dba92 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.495377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39788e7-8feb-48cd-80ac-383acd4d335e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.496128 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39788e7-8feb-48cd-80ac-383acd4d335e admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.496414 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39788e7-8feb-48cd-80ac-383acd4d335e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.496742 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39788e7-8feb-48cd-80ac-383acd4d335e admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.497529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39788e7-8feb-48cd-80ac-383acd4d335e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:20.497886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39788e7-8feb-48cd-80ac-383acd4d335e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.499702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39788e7-8feb-48cd-80ac-383acd4d335e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.513525 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 410/809] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:20.520650 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adcd25-1476-443c-8a4a-a469f6b3e3bf admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.531380 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adcd25-1476-443c-8a4a-a469f6b3e3bf admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.536581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833853c-af7a-4b50-babe-2205e70b8229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.537410 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833853c-af7a-4b50-babe-2205e70b8229 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.537688 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833853c-af7a-4b50-babe-2205e70b8229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.537958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833853c-af7a-4b50-babe-2205e70b8229 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.546959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833853c-af7a-4b50-babe-2205e70b8229 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.549508 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833853c-af7a-4b50-babe-2205e70b8229 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.564102 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-8833853c-af7a-4b50-babe-2205e70b8229 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:20.565658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 400/810] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:20.572293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39788e7-8feb-48cd-80ac-383acd4d335e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.585647 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39788e7-8feb-48cd-80ac-383acd4d335e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.591379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6339f-4428-4dae-995b-d6a6b2cba64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.592063 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6339f-4428-4dae-995b-d6a6b2cba64a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.592397 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6339f-4428-4dae-995b-d6a6b2cba64a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.592671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6339f-4428-4dae-995b-d6a6b2cba64a admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.593535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6339f-4428-4dae-995b-d6a6b2cba64a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:20.593842 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6339f-4428-4dae-995b-d6a6b2cba64a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.595889 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6339f-4428-4dae-995b-d6a6b2cba64a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.609768 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 411/811] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:20.616563 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833853c-af7a-4b50-babe-2205e70b8229 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:20.627385 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833853c-af7a-4b50-babe-2205e70b8229 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:20.631931 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddcab2-9db1-454c-816c-a710699be207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:20.632825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddcab2-9db1-454c-816c-a710699be207 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:20.633100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddcab2-9db1-454c-816c-a710699be207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:20.633370 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddcab2-9db1-454c-816c-a710699be207 admin admin] PATH_INFO: `/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/f9fc539f38364a648b9a4c25d3dbea8c/roles/84142a61c6044699aebb0fc5df7f6922` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:20.635581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddcab2-9db1-454c-816c-a710699be207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ae5e80b1f745dfaedd81a2c0ded718, user_id=f9fc539f38364a648b9a4c25d3dbea8c, role_id=84142a61c6044699aebb0fc5df7f6922)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:20.638213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddcab2-9db1-454c-816c-a710699be207 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:20.653159 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 401/812] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:49:20 2021] PUT /identity/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/f9fc539f38364a648b9a4c25d3dbea8c/roles/84142a61c6044699aebb0fc5df7f6922 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:49:21.607635 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcac90-a47f-481f-b206-77589609eaf3 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:21.608288 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcac90-a47f-481f-b206-77589609eaf3 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:21.608288 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcac90-a47f-481f-b206-77589609eaf3 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:21.608961 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51670a-459d-4a83-851a-90bea6a0ad1e None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:21.609400 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51670a-459d-4a83-851a-90bea6a0ad1e None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:21.609548 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51670a-459d-4a83-851a-90bea6a0ad1e None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:21.610398 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 412/813] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:21.612019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 402/814] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:21.617438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa345bcb-e021-4e9f-a450-dd4aabca4745 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:21.617726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa345bcb-e021-4e9f-a450-dd4aabca4745 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:21.618000 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa345bcb-e021-4e9f-a450-dd4aabca4745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:21.620522 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccdbee-b450-49c8-bdb3-c2c95852d9ea None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:21.621018 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccdbee-b450-49c8-bdb3-c2c95852d9ea None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:21.621488 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccdbee-b450-49c8-bdb3-c2c95852d9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:21.637007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-fa345bcb-e021-4e9f-a450-dd4aabca4745 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:21.638280 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-fa345bcb-e021-4e9f-a450-dd4aabca4745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:21.643418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-edccdbee-b450-49c8-bdb3-c2c95852d9ea None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:21.645579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-edccdbee-b450-49c8-bdb3-c2c95852d9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:21.706052 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 413/815] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:21 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:21.724045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 403/816] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:21 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:21.729763 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa345bcb-e021-4e9f-a450-dd4aabca4745 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:21.738959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa345bcb-e021-4e9f-a450-dd4aabca4745 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:21.743449 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9620bc2-fe4a-469b-a703-7d990f1e234c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:21.744243 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9620bc2-fe4a-469b-a703-7d990f1e234c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:21.744518 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9620bc2-fe4a-469b-a703-7d990f1e234c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:21.744786 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9620bc2-fe4a-469b-a703-7d990f1e234c admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:21.745450 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9620bc2-fe4a-469b-a703-7d990f1e234c admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:21.747039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9620bc2-fe4a-469b-a703-7d990f1e234c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:21.749677 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccdbee-b450-49c8-bdb3-c2c95852d9ea None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:21.758399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-f9620bc2-fe4a-469b-a703-7d990f1e234c admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 08 10:49:21.759142 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccdbee-b450-49c8-bdb3-c2c95852d9ea None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:21.760645 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 414/817] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:49:21 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:21.766345 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbb599-4fed-4ff7-a2da-2c731fa5f31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:21.767638 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9620bc2-fe4a-469b-a703-7d990f1e234c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:21.767930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb599-4fed-4ff7-a2da-2c731fa5f31b admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:21.768543 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb599-4fed-4ff7-a2da-2c731fa5f31b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:21.769023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb599-4fed-4ff7-a2da-2c731fa5f31b admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:21.769958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbb599-4fed-4ff7-a2da-2c731fa5f31b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:21.771814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbb599-4fed-4ff7-a2da-2c731fa5f31b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:21.778706 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9620bc2-fe4a-469b-a703-7d990f1e234c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:21.783850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482932b-04b8-454c-a93e-5030c72c06fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:21.784513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482932b-04b8-454c-a93e-5030c72c06fb admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:21.784796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482932b-04b8-454c-a93e-5030c72c06fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:21.785074 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482932b-04b8-454c-a93e-5030c72c06fb admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:21.785802 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482932b-04b8-454c-a93e-5030c72c06fb admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:21.786108 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482932b-04b8-454c-a93e-5030c72c06fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:21.787746 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482932b-04b8-454c-a93e-5030c72c06fb admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:21.790306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 404/818] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Nov 8 10:49:21 2021] POST /identity/v3/services => generated 241 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 10:49:21.792926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 415/819] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:49:21 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:21.803198 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbb599-4fed-4ff7-a2da-2c731fa5f31b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:21.824683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbb599-4fed-4ff7-a2da-2c731fa5f31b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:21.830786 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92729f0-8b0f-4ebb-83d6-7361562c736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:21.831820 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92729f0-8b0f-4ebb-83d6-7361562c736a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:21.832285 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92729f0-8b0f-4ebb-83d6-7361562c736a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:21.832733 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92729f0-8b0f-4ebb-83d6-7361562c736a admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:21.833761 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92729f0-8b0f-4ebb-83d6-7361562c736a admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:21.834265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92729f0-8b0f-4ebb-83d6-7361562c736a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:21.836226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92729f0-8b0f-4ebb-83d6-7361562c736a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:21.842688 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 405/820] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:49:21 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:21.852332 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482932b-04b8-454c-a93e-5030c72c06fb admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:21.864473 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482932b-04b8-454c-a93e-5030c72c06fb admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:21.870005 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97073ae4-3ea0-4eb6-8245-44a6615f4e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:21.870912 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97073ae4-3ea0-4eb6-8245-44a6615f4e10 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:21.871421 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97073ae4-3ea0-4eb6-8245-44a6615f4e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:21.871897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97073ae4-3ea0-4eb6-8245-44a6615f4e10 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:21.872904 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97073ae4-3ea0-4eb6-8245-44a6615f4e10 admin admin] RBAC: Adding query filter params (interface=public, service_id=06237af07502456d92016ace78b78c6d, region_id=RegionOne) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:21.873390 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97073ae4-3ea0-4eb6-8245-44a6615f4e10 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:21.875297 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97073ae4-3ea0-4eb6-8245-44a6615f4e10 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:21.881966 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 416/821] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Nov 8 10:49:21 2021] GET /identity/v3/endpoints?service_id=06237af07502456d92016ace78b78c6d&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:21.888854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92729f0-8b0f-4ebb-83d6-7361562c736a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:21.900422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92729f0-8b0f-4ebb-83d6-7361562c736a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:21.905580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355eeba1-6f3d-415e-8329-f78b59e88ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:21.906493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eeba1-6f3d-415e-8329-f78b59e88ada admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:21.906964 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eeba1-6f3d-415e-8329-f78b59e88ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:21.907424 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eeba1-6f3d-415e-8329-f78b59e88ada admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:21.908387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355eeba1-6f3d-415e-8329-f78b59e88ada admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:21.910327 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355eeba1-6f3d-415e-8329-f78b59e88ada admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:21.917781 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 406/822] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Nov 8 10:49:21 2021] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 10:49:22.788126 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c7e3-816b-4570-8776-90c5a7126fc7 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:22.788635 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c7e3-816b-4570-8776-90c5a7126fc7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:22.788635 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c7e3-816b-4570-8776-90c5a7126fc7 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:22.790792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 417/823] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:22.797655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c4431-bf6c-4810-b44d-35fba17d166e None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:22.798206 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c4431-bf6c-4810-b44d-35fba17d166e None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:22.798206 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c4431-bf6c-4810-b44d-35fba17d166e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:22.817091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-563c4431-bf6c-4810-b44d-35fba17d166e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:22.818307 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-563c4431-bf6c-4810-b44d-35fba17d166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:22.826377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 407/824] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:22 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:22.849953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048c7e3-816b-4570-8776-90c5a7126fc7 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:22.862462 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048c7e3-816b-4570-8776-90c5a7126fc7 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:22.866876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d1264-f7f1-4737-bef7-8639c1efe58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:22.867756 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d1264-f7f1-4737-bef7-8639c1efe58f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:22.868040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d1264-f7f1-4737-bef7-8639c1efe58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:22.868316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d1264-f7f1-4737-bef7-8639c1efe58f admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:22.868986 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d1264-f7f1-4737-bef7-8639c1efe58f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:22.870589 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d1264-f7f1-4737-bef7-8639c1efe58f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:22.882792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-e58d1264-f7f1-4737-bef7-8639c1efe58f admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 08 10:49:22.884341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 418/825] 10.222.0.20 () {56 vars in 1153 bytes} [Mon Nov 8 10:49:22 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:22.891000 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c4431-bf6c-4810-b44d-35fba17d166e None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:22.900642 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c4431-bf6c-4810-b44d-35fba17d166e None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:22.905228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f37fc-14ca-4f4e-8a5b-599ef73d1324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:22.905905 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f37fc-14ca-4f4e-8a5b-599ef73d1324 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:22.906188 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f37fc-14ca-4f4e-8a5b-599ef73d1324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:22.906464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f37fc-14ca-4f4e-8a5b-599ef73d1324 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:22.907226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f37fc-14ca-4f4e-8a5b-599ef73d1324 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:22.907536 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f37fc-14ca-4f4e-8a5b-599ef73d1324 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:22.909193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f37fc-14ca-4f4e-8a5b-599ef73d1324 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:22.918488 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 408/826] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Nov 8 10:49:22 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:22.919623 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279451f1-c1a5-4de5-b295-fac8b49b12d0 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:22.919917 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279451f1-c1a5-4de5-b295-fac8b49b12d0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:22.920193 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279451f1-c1a5-4de5-b295-fac8b49b12d0 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:22.922209 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 419/827] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:49:22.924918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f37fc-14ca-4f4e-8a5b-599ef73d1324 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:22.929437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35333e-1013-495b-b255-d263b1d6d74e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:22.929806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35333e-1013-495b-b255-d263b1d6d74e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:22.930157 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35333e-1013-495b-b255-d263b1d6d74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:22.934855 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f37fc-14ca-4f4e-8a5b-599ef73d1324 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:22.939533 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b56d8a-6239-40cc-b4b6-5b31340e4c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:22.940197 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b56d8a-6239-40cc-b4b6-5b31340e4c0a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:22.940475 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b56d8a-6239-40cc-b4b6-5b31340e4c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:22.940745 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b56d8a-6239-40cc-b4b6-5b31340e4c0a admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:22.941462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b56d8a-6239-40cc-b4b6-5b31340e4c0a admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:22.941762 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b56d8a-6239-40cc-b4b6-5b31340e4c0a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:22.943406 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b56d8a-6239-40cc-b4b6-5b31340e4c0a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:22.948917 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 409/828] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Nov 8 10:49:22 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:22.949907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-6a35333e-1013-495b-b255-d263b1d6d74e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:22.951246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6a35333e-1013-495b-b255-d263b1d6d74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:22.955066 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b56d8a-6239-40cc-b4b6-5b31340e4c0a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:22.959760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 420/829] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:22 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:22.964628 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b56d8a-6239-40cc-b4b6-5b31340e4c0a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:22.969293 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6196f-e221-4319-a324-8ce8db4b1b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:22.970175 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6196f-e221-4319-a324-8ce8db4b1b0b admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:22.970629 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6196f-e221-4319-a324-8ce8db4b1b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:22.971096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6196f-e221-4319-a324-8ce8db4b1b0b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:22.972034 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6196f-e221-4319-a324-8ce8db4b1b0b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:22.973780 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6196f-e221-4319-a324-8ce8db4b1b0b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:22.986051 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35333e-1013-495b-b255-d263b1d6d74e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:22.996297 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35333e-1013-495b-b255-d263b1d6d74e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:22.997163 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 410/830] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Nov 8 10:49:22 2021] POST /identity/v3/endpoints => generated 347 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 10:49:23.013184 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f11f5e-05ab-41d5-a292-d3a427ca776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:23.014278 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11f5e-05ab-41d5-a292-d3a427ca776c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:23.014632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11f5e-05ab-41d5-a292-d3a427ca776c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:23.014975 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11f5e-05ab-41d5-a292-d3a427ca776c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:23.029102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f11f5e-05ab-41d5-a292-d3a427ca776c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:23.037823 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-15f11f5e-05ab-41d5-a292-d3a427ca776c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 08 10:49:23.039639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 421/831] 10.222.0.20 () {56 vars in 1141 bytes} [Mon Nov 8 10:49:22 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:23.046713 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6196f-e221-4319-a324-8ce8db4b1b0b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:23.058057 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6196f-e221-4319-a324-8ce8db4b1b0b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:23.063117 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b21784-5a2f-49d6-a366-5a6b8cc656e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:23.063952 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b21784-5a2f-49d6-a366-5a6b8cc656e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:23.064293 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b21784-5a2f-49d6-a366-5a6b8cc656e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:23.064573 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b21784-5a2f-49d6-a366-5a6b8cc656e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:23.065421 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b21784-5a2f-49d6-a366-5a6b8cc656e9 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:23.065734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b21784-5a2f-49d6-a366-5a6b8cc656e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:23.067532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b21784-5a2f-49d6-a366-5a6b8cc656e9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:23.077647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 411/832] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Nov 8 10:49:23 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:23.084777 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f11f5e-05ab-41d5-a292-d3a427ca776c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:23.096424 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f11f5e-05ab-41d5-a292-d3a427ca776c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:23.101490 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030c844-648a-447a-b36f-19579fdf843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:23.102361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030c844-648a-447a-b36f-19579fdf843c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:23.102644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030c844-648a-447a-b36f-19579fdf843c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:23.102921 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030c844-648a-447a-b36f-19579fdf843c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:23.115394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030c844-648a-447a-b36f-19579fdf843c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:23.117255 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030c844-648a-447a-b36f-19579fdf843c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:23.135834 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-8030c844-648a-447a-b36f-19579fdf843c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:23.137499 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 422/833] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:23.144328 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b21784-5a2f-49d6-a366-5a6b8cc656e9 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:23.154849 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b21784-5a2f-49d6-a366-5a6b8cc656e9 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:23.160016 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6178b-8c21-47cc-8541-8b042064271b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:23.160759 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6178b-8c21-47cc-8541-8b042064271b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:23.161044 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6178b-8c21-47cc-8541-8b042064271b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:23.161318 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6178b-8c21-47cc-8541-8b042064271b admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:23.162121 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6178b-8c21-47cc-8541-8b042064271b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:23.162431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6178b-8c21-47cc-8541-8b042064271b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:23.164090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6178b-8c21-47cc-8541-8b042064271b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:23.177993 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 412/834] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:23.184592 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030c844-648a-447a-b36f-19579fdf843c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:23.195658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030c844-648a-447a-b36f-19579fdf843c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:23.200837 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b2026-3b6c-43ec-8d7c-4338d3c26726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:23.201711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b2026-3b6c-43ec-8d7c-4338d3c26726 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:23.202047 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b2026-3b6c-43ec-8d7c-4338d3c26726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:23.202326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b2026-3b6c-43ec-8d7c-4338d3c26726 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:23.211500 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b2026-3b6c-43ec-8d7c-4338d3c26726 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:23.213608 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b2026-3b6c-43ec-8d7c-4338d3c26726 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:23.229256 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-3d6b2026-3b6c-43ec-8d7c-4338d3c26726 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 08 10:49:23.230860 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 423/835] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Nov 8 10:49:23 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:23.237747 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6178b-8c21-47cc-8541-8b042064271b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:23.247610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6178b-8c21-47cc-8541-8b042064271b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:23.252461 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83895380-f235-4a98-a31c-32498bbbbc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:23.253201 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83895380-f235-4a98-a31c-32498bbbbc76 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:23.253479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83895380-f235-4a98-a31c-32498bbbbc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:23.253754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83895380-f235-4a98-a31c-32498bbbbc76 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:23.254618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83895380-f235-4a98-a31c-32498bbbbc76 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:23.254925 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83895380-f235-4a98-a31c-32498bbbbc76 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:23.256849 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83895380-f235-4a98-a31c-32498bbbbc76 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:23.275332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 413/836] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Nov 8 10:49:23 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:23.282326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b2026-3b6c-43ec-8d7c-4338d3c26726 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:23.293862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b2026-3b6c-43ec-8d7c-4338d3c26726 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:23.298764 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cff8d-3108-4e28-bbfa-089bf441279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:23.299683 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cff8d-3108-4e28-bbfa-089bf441279b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:23.300181 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cff8d-3108-4e28-bbfa-089bf441279b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:23.300647 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cff8d-3108-4e28-bbfa-089bf441279b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:23.311261 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cff8d-3108-4e28-bbfa-089bf441279b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:23.313140 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cff8d-3108-4e28-bbfa-089bf441279b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:23.323369 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 424/837] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:23 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:49:23.330059 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83895380-f235-4a98-a31c-32498bbbbc76 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:23.345663 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83895380-f235-4a98-a31c-32498bbbbc76 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:23.350341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e1ff5-3c6f-4c92-ae7b-7f5668bd1def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:23.351190 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e1ff5-3c6f-4c92-ae7b-7f5668bd1def admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:23.351470 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e1ff5-3c6f-4c92-ae7b-7f5668bd1def admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:23.351749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e1ff5-3c6f-4c92-ae7b-7f5668bd1def admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:23.362432 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e1ff5-3c6f-4c92-ae7b-7f5668bd1def admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:23.364367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e1ff5-3c6f-4c92-ae7b-7f5668bd1def admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:23.381453 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-456e1ff5-3c6f-4c92-ae7b-7f5668bd1def admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:23.382981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 414/838] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:23.389416 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cff8d-3108-4e28-bbfa-089bf441279b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:23.399298 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cff8d-3108-4e28-bbfa-089bf441279b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:23.403984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144474ac-1922-451d-9899-d108f3cac0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:23.404642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144474ac-1922-451d-9899-d108f3cac0aa admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:23.404922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144474ac-1922-451d-9899-d108f3cac0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:23.405199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144474ac-1922-451d-9899-d108f3cac0aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:23.405940 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144474ac-1922-451d-9899-d108f3cac0aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:23.406306 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144474ac-1922-451d-9899-d108f3cac0aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:23.408042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144474ac-1922-451d-9899-d108f3cac0aa admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:23.420513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 425/839] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:23.427007 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e1ff5-3c6f-4c92-ae7b-7f5668bd1def admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:23.437250 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e1ff5-3c6f-4c92-ae7b-7f5668bd1def admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:23.441981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2db4b-5640-4e84-81c1-7866b24cdef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:23.442870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2db4b-5640-4e84-81c1-7866b24cdef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:23.443207 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2db4b-5640-4e84-81c1-7866b24cdef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:23.443495 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2db4b-5640-4e84-81c1-7866b24cdef8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:23.450490 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2db4b-5640-4e84-81c1-7866b24cdef8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:23.452537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2db4b-5640-4e84-81c1-7866b24cdef8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:23.465656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-e2c2db4b-5640-4e84-81c1-7866b24cdef8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:23.467168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 415/840] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:23.473705 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144474ac-1922-451d-9899-d108f3cac0aa admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:23.483919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144474ac-1922-451d-9899-d108f3cac0aa admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:23.488721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89b90a-0e4d-4ca1-a509-760fbb9c943f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:23.489440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b90a-0e4d-4ca1-a509-760fbb9c943f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:23.489725 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b90a-0e4d-4ca1-a509-760fbb9c943f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:23.490005 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b90a-0e4d-4ca1-a509-760fbb9c943f admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:23.490810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89b90a-0e4d-4ca1-a509-760fbb9c943f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:23.491237 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89b90a-0e4d-4ca1-a509-760fbb9c943f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:23.493109 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89b90a-0e4d-4ca1-a509-760fbb9c943f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:23.506531 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 426/841] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:23.513211 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2db4b-5640-4e84-81c1-7866b24cdef8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:23.524519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2db4b-5640-4e84-81c1-7866b24cdef8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:23.529235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972af43-df0a-4db1-b064-5a31635ad6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:23.529877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972af43-df0a-4db1-b064-5a31635ad6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:23.530214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972af43-df0a-4db1-b064-5a31635ad6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:23.530496 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972af43-df0a-4db1-b064-5a31635ad6a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:23.531453 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972af43-df0a-4db1-b064-5a31635ad6a7 admin admin] RBAC: Adding query filter params (role.id=84142a61c6044699aebb0fc5df7f6922, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=f9fc539f38364a648b9a4c25d3dbea8c) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:23.531767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972af43-df0a-4db1-b064-5a31635ad6a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:23.533710 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972af43-df0a-4db1-b064-5a31635ad6a7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:23.539868 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 416/842] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:23 2021] GET /identity/v3/role_assignments?user.id=f9fc539f38364a648b9a4c25d3dbea8c&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=84142a61c6044699aebb0fc5df7f6922 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:24.116517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459a69e-95a5-48bd-87b6-2ceeaa65a700 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:24.117276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459a69e-95a5-48bd-87b6-2ceeaa65a700 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:24.117276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459a69e-95a5-48bd-87b6-2ceeaa65a700 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:24.119107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 427/843] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:24.125769 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e51dbe-886e-4f50-ba9e-43f432e65c5e None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:24.126268 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e51dbe-886e-4f50-ba9e-43f432e65c5e None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:24.126562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e51dbe-886e-4f50-ba9e-43f432e65c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:24.145352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-93e51dbe-886e-4f50-ba9e-43f432e65c5e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:24.146584 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-93e51dbe-886e-4f50-ba9e-43f432e65c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:24.159008 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 417/844] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:24 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:24.178865 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459a69e-95a5-48bd-87b6-2ceeaa65a700 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:24.191353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459a69e-95a5-48bd-87b6-2ceeaa65a700 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:24.195794 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf1bfa-67b4-4362-8972-fff5c0cedb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:24.196598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf1bfa-67b4-4362-8972-fff5c0cedb72 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:24.196879 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf1bfa-67b4-4362-8972-fff5c0cedb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:24.197151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf1bfa-67b4-4362-8972-fff5c0cedb72 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:24.197820 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf1bfa-67b4-4362-8972-fff5c0cedb72 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:24.199450 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf1bfa-67b4-4362-8972-fff5c0cedb72 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:24.211072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-aaaf1bfa-67b4-4362-8972-fff5c0cedb72 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 08 10:49:24.218164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 428/845] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Nov 8 10:49:24 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:24.219579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e51dbe-886e-4f50-ba9e-43f432e65c5e None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:24.228919 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e51dbe-886e-4f50-ba9e-43f432e65c5e None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:24.233591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527709fb-4598-4180-93d1-43bdbb3f0c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:24.234254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527709fb-4598-4180-93d1-43bdbb3f0c2b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:24.234534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527709fb-4598-4180-93d1-43bdbb3f0c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:24.234807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527709fb-4598-4180-93d1-43bdbb3f0c2b admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:24.235619 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527709fb-4598-4180-93d1-43bdbb3f0c2b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:24.235953 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527709fb-4598-4180-93d1-43bdbb3f0c2b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:24.237607 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527709fb-4598-4180-93d1-43bdbb3f0c2b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:24.247270 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 418/846] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Nov 8 10:49:24 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:24.249723 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf1bfa-67b4-4362-8972-fff5c0cedb72 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:24.260011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf1bfa-67b4-4362-8972-fff5c0cedb72 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:24.264757 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0685d5-c5f3-46bb-9e07-61010180b6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:24.265514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0685d5-c5f3-46bb-9e07-61010180b6bd admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:24.265796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0685d5-c5f3-46bb-9e07-61010180b6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:24.266073 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0685d5-c5f3-46bb-9e07-61010180b6bd admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:24.267282 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0685d5-c5f3-46bb-9e07-61010180b6bd admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:24.267597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0685d5-c5f3-46bb-9e07-61010180b6bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:24.269235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0685d5-c5f3-46bb-9e07-61010180b6bd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:24.279247 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 429/847] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Nov 8 10:49:24 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:24.281349 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527709fb-4598-4180-93d1-43bdbb3f0c2b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:24.291799 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527709fb-4598-4180-93d1-43bdbb3f0c2b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:24.293900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd904b-6600-411f-9d86-85f3654f0f8d None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:24.294402 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd904b-6600-411f-9d86-85f3654f0f8d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:24.294869 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd904b-6600-411f-9d86-85f3654f0f8d None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:24.296749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb9877-c824-4ee2-bebc-0f954423638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:24.297530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9877-c824-4ee2-bebc-0f954423638d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:24.297735 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 430/848] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:24.297839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9877-c824-4ee2-bebc-0f954423638d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:24.300283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9877-c824-4ee2-bebc-0f954423638d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:24.300283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb9877-c824-4ee2-bebc-0f954423638d admin admin] RBAC: Adding query filter params (interface=public, service_id=3f78e4429e77472eab694c5cada8b885, region_id=RegionOne) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:24.300283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb9877-c824-4ee2-bebc-0f954423638d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:24.301226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb9877-c824-4ee2-bebc-0f954423638d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:24.305095 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29696e-40d7-4651-b5f9-bc0e9e48c1b6 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:24.305631 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29696e-40d7-4651-b5f9-bc0e9e48c1b6 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:24.306027 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29696e-40d7-4651-b5f9-bc0e9e48c1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:24.311526 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 419/849] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Nov 8 10:49:24 2021] GET /identity/v3/endpoints?service_id=3f78e4429e77472eab694c5cada8b885&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:24.315411 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb9877-c824-4ee2-bebc-0f954423638d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:24.325611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-3e29696e-40d7-4651-b5f9-bc0e9e48c1b6 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:24.326207 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb9877-c824-4ee2-bebc-0f954423638d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:24.327220 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-3e29696e-40d7-4651-b5f9-bc0e9e48c1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:24.331599 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d4402-2ed9-45e7-bf79-7639869dec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:24.332462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d4402-2ed9-45e7-bf79-7639869dec2b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:24.332933 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d4402-2ed9-45e7-bf79-7639869dec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:24.333351 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d4402-2ed9-45e7-bf79-7639869dec2b admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:24.334254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d4402-2ed9-45e7-bf79-7639869dec2b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:24.335959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 431/850] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:24 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:24.336422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d4402-2ed9-45e7-bf79-7639869dec2b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:24.351292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 420/851] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Nov 8 10:49:24 2021] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 10:49:24.360163 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29696e-40d7-4651-b5f9-bc0e9e48c1b6 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:24.370121 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29696e-40d7-4651-b5f9-bc0e9e48c1b6 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:24.374946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561234e-ab84-4a8d-a2ab-c585d22a51fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:24.375979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561234e-ab84-4a8d-a2ab-c585d22a51fe admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:24.376415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561234e-ab84-4a8d-a2ab-c585d22a51fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:24.376783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561234e-ab84-4a8d-a2ab-c585d22a51fe admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:24.377590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561234e-ab84-4a8d-a2ab-c585d22a51fe admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:24.379382 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561234e-ab84-4a8d-a2ab-c585d22a51fe admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:24.391318 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-7561234e-ab84-4a8d-a2ab-c585d22a51fe admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 08 10:49:24.393609 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 432/852] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:49:24 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:24.400333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d4402-2ed9-45e7-bf79-7639869dec2b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:24.411296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d4402-2ed9-45e7-bf79-7639869dec2b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:24.416406 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175445a1-99ba-4af7-b23a-375e1fef134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:24.417086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175445a1-99ba-4af7-b23a-375e1fef134f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:24.417365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175445a1-99ba-4af7-b23a-375e1fef134f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:24.417639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175445a1-99ba-4af7-b23a-375e1fef134f admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:24.418369 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175445a1-99ba-4af7-b23a-375e1fef134f admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:24.418674 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175445a1-99ba-4af7-b23a-375e1fef134f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:24.420360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175445a1-99ba-4af7-b23a-375e1fef134f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:24.427050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 421/853] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:49:24 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:24.433461 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561234e-ab84-4a8d-a2ab-c585d22a51fe admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:24.443846 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561234e-ab84-4a8d-a2ab-c585d22a51fe admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:24.448522 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b440b69-ca5f-4759-8564-6694ee77d954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:24.449203 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b440b69-ca5f-4759-8564-6694ee77d954 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:24.449480 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b440b69-ca5f-4759-8564-6694ee77d954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:24.449751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b440b69-ca5f-4759-8564-6694ee77d954 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:24.450483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b440b69-ca5f-4759-8564-6694ee77d954 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:24.450784 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b440b69-ca5f-4759-8564-6694ee77d954 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:24.452446 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b440b69-ca5f-4759-8564-6694ee77d954 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:24.458869 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 433/854] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Nov 8 10:49:24 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:24.474457 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175445a1-99ba-4af7-b23a-375e1fef134f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:24.486993 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175445a1-99ba-4af7-b23a-375e1fef134f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:24.491860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ecc25-936c-4a4b-bc24-2afd3475043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:24.492541 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ecc25-936c-4a4b-bc24-2afd3475043c admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:24.492818 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ecc25-936c-4a4b-bc24-2afd3475043c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:24.493089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ecc25-936c-4a4b-bc24-2afd3475043c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:24.493861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ecc25-936c-4a4b-bc24-2afd3475043c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:24.495518 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ecc25-936c-4a4b-bc24-2afd3475043c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:24.520631 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 422/855] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Nov 8 10:49:24 2021] POST /identity/v3/endpoints => generated 346 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:49:25.389726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf53630-d747-4ef7-a331-97c9840b71d8 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:25.390438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf53630-d747-4ef7-a331-97c9840b71d8 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:25.390438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf53630-d747-4ef7-a331-97c9840b71d8 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:25.392741 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 434/856] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:25.398892 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29718f40-368c-47ce-860b-517f59f40748 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:25.399412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29718f40-368c-47ce-860b-517f59f40748 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:25.399560 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29718f40-368c-47ce-860b-517f59f40748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:25.419349 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-29718f40-368c-47ce-860b-517f59f40748 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:25.420562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-29718f40-368c-47ce-860b-517f59f40748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:25.437811 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 423/857] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:25 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:25.460553 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf53630-d747-4ef7-a331-97c9840b71d8 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:25.483576 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf53630-d747-4ef7-a331-97c9840b71d8 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:25.488024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d851cee-65e8-42e2-8c76-cb5712f50a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:25.488825 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d851cee-65e8-42e2-8c76-cb5712f50a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:25.489100 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d851cee-65e8-42e2-8c76-cb5712f50a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:25.489371 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d851cee-65e8-42e2-8c76-cb5712f50a8a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:25.490031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d851cee-65e8-42e2-8c76-cb5712f50a8a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:25.491676 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d851cee-65e8-42e2-8c76-cb5712f50a8a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:25.503012 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-2d851cee-65e8-42e2-8c76-cb5712f50a8a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 08 10:49:25.504557 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 435/858] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:25 2021] GET /identity/v3/services/compute => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:25.511299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29718f40-368c-47ce-860b-517f59f40748 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:25.520937 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29718f40-368c-47ce-860b-517f59f40748 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:25.525459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c382086-e27e-45fd-96e3-06a52fddb3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:25.526123 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c382086-e27e-45fd-96e3-06a52fddb3cb admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:25.526406 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c382086-e27e-45fd-96e3-06a52fddb3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:25.526681 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c382086-e27e-45fd-96e3-06a52fddb3cb admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:25.527436 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c382086-e27e-45fd-96e3-06a52fddb3cb admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:25.527739 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c382086-e27e-45fd-96e3-06a52fddb3cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:25.529480 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c382086-e27e-45fd-96e3-06a52fddb3cb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:25.534740 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 424/859] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Nov 8 10:49:25 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:25.541066 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d851cee-65e8-42e2-8c76-cb5712f50a8a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:25.550962 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d851cee-65e8-42e2-8c76-cb5712f50a8a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:25.555688 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55d050-b5b9-415b-a1e0-a311919498bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:25.556351 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55d050-b5b9-415b-a1e0-a311919498bd admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:25.556634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55d050-b5b9-415b-a1e0-a311919498bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:25.556914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55d050-b5b9-415b-a1e0-a311919498bd admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:25.557635 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55d050-b5b9-415b-a1e0-a311919498bd admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:25.557943 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55d050-b5b9-415b-a1e0-a311919498bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:25.559680 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55d050-b5b9-415b-a1e0-a311919498bd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:25.565643 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 436/860] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Nov 8 10:49:25 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:25.901533 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ef779-2418-4417-a53a-7d6f9f6cf934 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:25.901947 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ef779-2418-4417-a53a-7d6f9f6cf934 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:25.902116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ef779-2418-4417-a53a-7d6f9f6cf934 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:25.904184 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 425/861] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:25.910515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0c5bb-c8ba-42c6-943e-0bbb590dcb0e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:25.910803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0c5bb-c8ba-42c6-943e-0bbb590dcb0e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:25.911079 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0c5bb-c8ba-42c6-943e-0bbb590dcb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:25.928987 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-9db0c5bb-c8ba-42c6-943e-0bbb590dcb0e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:25.930166 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9db0c5bb-c8ba-42c6-943e-0bbb590dcb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:25.938112 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 437/862] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:25 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:25.961448 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ef779-2418-4417-a53a-7d6f9f6cf934 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:25.973980 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ef779-2418-4417-a53a-7d6f9f6cf934 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:25.978341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e891b-245e-45ae-b7fc-7253d09d2f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:25.979135 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e891b-245e-45ae-b7fc-7253d09d2f95 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:25.979420 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e891b-245e-45ae-b7fc-7253d09d2f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:25.979691 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e891b-245e-45ae-b7fc-7253d09d2f95 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:25.980351 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e891b-245e-45ae-b7fc-7253d09d2f95 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:25.981932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e891b-245e-45ae-b7fc-7253d09d2f95 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:25.992803 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-6c3e891b-245e-45ae-b7fc-7253d09d2f95 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 08 10:49:25.994279 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 426/863] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Nov 8 10:49:25 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:26.000900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0c5bb-c8ba-42c6-943e-0bbb590dcb0e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:26.009863 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0c5bb-c8ba-42c6-943e-0bbb590dcb0e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:26.014370 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb6905-623c-4d0a-89db-4a68cc5bac6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:26.015014 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb6905-623c-4d0a-89db-4a68cc5bac6b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:26.015324 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb6905-623c-4d0a-89db-4a68cc5bac6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:26.015595 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb6905-623c-4d0a-89db-4a68cc5bac6b admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:26.016313 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb6905-623c-4d0a-89db-4a68cc5bac6b admin admin] RBAC: Adding query filter params (name=image) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:26.017121 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb6905-623c-4d0a-89db-4a68cc5bac6b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:26.018824 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb6905-623c-4d0a-89db-4a68cc5bac6b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:26.023800 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 438/864] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:25 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:26.029891 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e891b-245e-45ae-b7fc-7253d09d2f95 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:26.039809 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e891b-245e-45ae-b7fc-7253d09d2f95 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:26.044314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd110304-b8ad-479b-b11b-db1d9187b06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:26.044965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110304-b8ad-479b-b11b-db1d9187b06b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:26.045243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110304-b8ad-479b-b11b-db1d9187b06b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:26.045572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd110304-b8ad-479b-b11b-db1d9187b06b admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:26.046290 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd110304-b8ad-479b-b11b-db1d9187b06b admin admin] RBAC: Adding query filter params (type=image) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:26.046590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd110304-b8ad-479b-b11b-db1d9187b06b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:26.048327 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd110304-b8ad-479b-b11b-db1d9187b06b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:26.053123 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 427/865] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:26 2021] GET /identity/v3/services?type=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:26.737752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52897610-8368-4d47-96bb-ee4e558e12e1 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:26.737752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52897610-8368-4d47-96bb-ee4e558e12e1 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:26.737752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52897610-8368-4d47-96bb-ee4e558e12e1 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:26.737752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 439/866] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:26.748162 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875cbbf-5869-4ab8-9984-0722d0122579 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:26.748162 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875cbbf-5869-4ab8-9984-0722d0122579 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:26.748162 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875cbbf-5869-4ab8-9984-0722d0122579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:26.768813 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-9875cbbf-5869-4ab8-9984-0722d0122579 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:26.770415 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9875cbbf-5869-4ab8-9984-0722d0122579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:26.783239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 428/867] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:26 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:26.803561 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52897610-8368-4d47-96bb-ee4e558e12e1 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:26.816754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52897610-8368-4d47-96bb-ee4e558e12e1 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:26.821558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7249e1-f0d3-4589-959d-fd7d9ada7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:26.822604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7249e1-f0d3-4589-959d-fd7d9ada7885 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:26.823106 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7249e1-f0d3-4589-959d-fd7d9ada7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:26.823621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7249e1-f0d3-4589-959d-fd7d9ada7885 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:26.824491 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7249e1-f0d3-4589-959d-fd7d9ada7885 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:26.826294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7249e1-f0d3-4589-959d-fd7d9ada7885 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:26.838749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-6c7249e1-f0d3-4589-959d-fd7d9ada7885 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 08 10:49:26.844401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 440/868] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Nov 8 10:49:26 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:26.848176 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875cbbf-5869-4ab8-9984-0722d0122579 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:26.857545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875cbbf-5869-4ab8-9984-0722d0122579 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:26.862649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c5d02-b521-4551-970d-e10fe07a10cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:26.863614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c5d02-b521-4551-970d-e10fe07a10cc admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:26.864099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c5d02-b521-4551-970d-e10fe07a10cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:26.864591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c5d02-b521-4551-970d-e10fe07a10cc admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:26.865521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c5d02-b521-4551-970d-e10fe07a10cc admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:26.866042 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c5d02-b521-4551-970d-e10fe07a10cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:26.867895 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c5d02-b521-4551-970d-e10fe07a10cc admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:26.874089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 429/869] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Nov 8 10:49:26 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:26.876916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaebaf7-5f68-4765-b5b7-13cc9bbeadb0 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:26.877425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaebaf7-5f68-4765-b5b7-13cc9bbeadb0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:26.877907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaebaf7-5f68-4765-b5b7-13cc9bbeadb0 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:26.880183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 441/870] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:26.881783 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c5d02-b521-4551-970d-e10fe07a10cc admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:26.886892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda2058-0e6c-4a63-8908-899fef7603da None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:26.887214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda2058-0e6c-4a63-8908-899fef7603da None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:26.887501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda2058-0e6c-4a63-8908-899fef7603da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:26.894574 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c5d02-b521-4551-970d-e10fe07a10cc admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:26.899498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608b1e0-053d-45f4-ba8f-02209c562d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:26.900445 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b1e0-053d-45f4-ba8f-02209c562d06 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:26.900937 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b1e0-053d-45f4-ba8f-02209c562d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:26.901408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b1e0-053d-45f4-ba8f-02209c562d06 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:26.902329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608b1e0-053d-45f4-ba8f-02209c562d06 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:26.902843 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608b1e0-053d-45f4-ba8f-02209c562d06 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:26.904707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608b1e0-053d-45f4-ba8f-02209c562d06 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:26.905951 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-4dda2058-0e6c-4a63-8908-899fef7603da None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:26.907188 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4dda2058-0e6c-4a63-8908-899fef7603da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:26.911027 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 430/871] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Nov 8 10:49:26 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:26.918115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608b1e0-053d-45f4-ba8f-02209c562d06 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:26.920495 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 442/872] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:26 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:26.928119 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608b1e0-053d-45f4-ba8f-02209c562d06 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:26.932842 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d7e73-f682-4095-aad1-899410485bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:26.933489 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d7e73-f682-4095-aad1-899410485bce admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:26.933769 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d7e73-f682-4095-aad1-899410485bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:26.934039 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d7e73-f682-4095-aad1-899410485bce admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:26.934836 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d7e73-f682-4095-aad1-899410485bce admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:26.936462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d7e73-f682-4095-aad1-899410485bce admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:26.947074 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda2058-0e6c-4a63-8908-899fef7603da None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:26.956758 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda2058-0e6c-4a63-8908-899fef7603da None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:26.958842 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 431/873] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Nov 8 10:49:26 2021] POST /identity/v3/endpoints => generated 349 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:49:26.972713 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7914b63-6df5-43f2-8e22-7a7604e0b6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:26.973541 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7914b63-6df5-43f2-8e22-7a7604e0b6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:26.973922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7914b63-6df5-43f2-8e22-7a7604e0b6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:26.974265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7914b63-6df5-43f2-8e22-7a7604e0b6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:26.975094 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7914b63-6df5-43f2-8e22-7a7604e0b6b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:26.977279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7914b63-6df5-43f2-8e22-7a7604e0b6b5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:26.978895 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.common [None req-e7914b63-6df5-43f2-8e22-7a7604e0b6b5 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 08 10:49:27.001018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.sql.core [None req-e7914b63-6df5-43f2-8e22-7a7604e0b6b5 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 08 10:49:27.001018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 08 10:49:27.001018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [parameters: {'id': '7b1aa12222b44e5d886999c7f8b082bd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 08 10:49:27.001018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79200) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 08 10:49:27.018647 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-e7914b63-6df5-43f2-8e22-7a7604e0b6b5 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7b1aa12222b44e5d886999c7f8b082bd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7b1aa12222b44e5d886999c7f8b082bd. Nov 08 10:49:27.020289 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 443/874] 10.222.0.20 () {60 vars in 1161 bytes} [Mon Nov 8 10:49:26 2021] POST /identity/v3/projects => generated 262 bytes in 74 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:49:27.027364 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d7e73-f682-4095-aad1-899410485bce admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:27.039195 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d7e73-f682-4095-aad1-899410485bce admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:27.044418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034c11d-4b29-4b03-9288-386a86390c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:27.045358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034c11d-4b29-4b03-9288-386a86390c4b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:27.045694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034c11d-4b29-4b03-9288-386a86390c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:27.045977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034c11d-4b29-4b03-9288-386a86390c4b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:27.054512 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034c11d-4b29-4b03-9288-386a86390c4b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:27.056836 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034c11d-4b29-4b03-9288-386a86390c4b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:27.072235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-d034c11d-4b29-4b03-9288-386a86390c4b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:27.073897 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 432/875] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:27.082071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7914b63-6df5-43f2-8e22-7a7604e0b6b5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:27.094771 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7914b63-6df5-43f2-8e22-7a7604e0b6b5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:27.100078 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2788d-6a15-494c-aa78-36d33a413378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:27.100817 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2788d-6a15-494c-aa78-36d33a413378 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:27.101105 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2788d-6a15-494c-aa78-36d33a413378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:27.101433 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2788d-6a15-494c-aa78-36d33a413378 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:27.102288 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2788d-6a15-494c-aa78-36d33a413378 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:27.102598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2788d-6a15-494c-aa78-36d33a413378 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:27.104916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2788d-6a15-494c-aa78-36d33a413378 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:27.130930 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 444/876] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Nov 8 10:49:27 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:27.879150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076bacb-027e-4358-9d4e-93b5a1d0bff5 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:27.879669 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076bacb-027e-4358-9d4e-93b5a1d0bff5 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:27.879669 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076bacb-027e-4358-9d4e-93b5a1d0bff5 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:27.881828 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 433/877] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:27.888204 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a78a40-77b9-4457-a906-05ae0ac3dab7 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:27.888620 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a78a40-77b9-4457-a906-05ae0ac3dab7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:27.888792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a78a40-77b9-4457-a906-05ae0ac3dab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:27.909347 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-b1a78a40-77b9-4457-a906-05ae0ac3dab7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:27.910047 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b1a78a40-77b9-4457-a906-05ae0ac3dab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:27.920914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 445/878] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:27 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:27.944427 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076bacb-027e-4358-9d4e-93b5a1d0bff5 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:27.957228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076bacb-027e-4358-9d4e-93b5a1d0bff5 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:27.961878 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d28587-e4b2-422b-9912-bafffc2119d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:27.962795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d28587-e4b2-422b-9912-bafffc2119d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:27.963329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d28587-e4b2-422b-9912-bafffc2119d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:27.963812 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d28587-e4b2-422b-9912-bafffc2119d6 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:27.964766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d28587-e4b2-422b-9912-bafffc2119d6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:27.966566 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d28587-e4b2-422b-9912-bafffc2119d6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:27.982003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 434/879] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Nov 8 10:49:27 2021] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:49:28.363571 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6d2ab-e8f5-4a39-b222-7fa9ac9399f7 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:28.364274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6d2ab-e8f5-4a39-b222-7fa9ac9399f7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:28.364784 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6d2ab-e8f5-4a39-b222-7fa9ac9399f7 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:28.367036 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 446/880] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:28.373246 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46508-eb43-4736-9716-30817659b5ac None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:28.373757 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46508-eb43-4736-9716-30817659b5ac None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:28.374241 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46508-eb43-4736-9716-30817659b5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:28.392911 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-e1d46508-eb43-4736-9716-30817659b5ac None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:28.394459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e1d46508-eb43-4736-9716-30817659b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:28.411308 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 435/881] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:28 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:28.435179 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6d2ab-e8f5-4a39-b222-7fa9ac9399f7 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:28.448214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6d2ab-e8f5-4a39-b222-7fa9ac9399f7 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:28.452877 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f662771-41e4-47ed-8574-b4622aee370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:28.453781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f662771-41e4-47ed-8574-b4622aee370c admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:28.454270 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f662771-41e4-47ed-8574-b4622aee370c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:28.454804 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f662771-41e4-47ed-8574-b4622aee370c admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:28.455783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f662771-41e4-47ed-8574-b4622aee370c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:28.457596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f662771-41e4-47ed-8574-b4622aee370c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:28.480135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 447/882] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Nov 8 10:49:28 2021] POST /identity/v3/services => generated 242 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:49:29.306479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459183e6-2212-40a6-ab14-59b067128bc0 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:29.307037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459183e6-2212-40a6-ab14-59b067128bc0 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:29.307037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459183e6-2212-40a6-ab14-59b067128bc0 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:29.309128 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 436/883] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:29.315663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35d416-0204-408e-b103-68c598c60aed None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:29.316083 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35d416-0204-408e-b103-68c598c60aed None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:29.316293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35d416-0204-408e-b103-68c598c60aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:29.334321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-6b35d416-0204-408e-b103-68c598c60aed None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:29.335624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6b35d416-0204-408e-b103-68c598c60aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:29.357583 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 448/884] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:29 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:29.377745 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459183e6-2212-40a6-ab14-59b067128bc0 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:29.390915 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459183e6-2212-40a6-ab14-59b067128bc0 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:29.396884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bd3ee-4bf7-4cdd-a8e0-b8ff8e90dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:29.397724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bd3ee-4bf7-4cdd-a8e0-b8ff8e90dfca admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:29.398009 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bd3ee-4bf7-4cdd-a8e0-b8ff8e90dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:29.398286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bd3ee-4bf7-4cdd-a8e0-b8ff8e90dfca admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:29.398966 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bd3ee-4bf7-4cdd-a8e0-b8ff8e90dfca admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:29.400665 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bd3ee-4bf7-4cdd-a8e0-b8ff8e90dfca admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:29.412683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-ee0bd3ee-4bf7-4cdd-a8e0-b8ff8e90dfca admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 08 10:49:29.419230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 437/885] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Nov 8 10:49:29 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:29.421103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35d416-0204-408e-b103-68c598c60aed None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:29.430388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35d416-0204-408e-b103-68c598c60aed None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:29.435113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa05f0e-a112-4106-bf38-4838bb6c2269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:29.435781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05f0e-a112-4106-bf38-4838bb6c2269 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:29.436066 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05f0e-a112-4106-bf38-4838bb6c2269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:29.436343 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05f0e-a112-4106-bf38-4838bb6c2269 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:29.437070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa05f0e-a112-4106-bf38-4838bb6c2269 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:29.437373 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa05f0e-a112-4106-bf38-4838bb6c2269 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:29.439144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa05f0e-a112-4106-bf38-4838bb6c2269 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:29.449916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 449/886] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Nov 8 10:49:29 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:29.451276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bd3ee-4bf7-4cdd-a8e0-b8ff8e90dfca admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:29.461151 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bd3ee-4bf7-4cdd-a8e0-b8ff8e90dfca admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:29.466104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5d5e6-d148-4f2b-88c1-c1aad21cfd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:29.466934 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d5e6-d148-4f2b-88c1-c1aad21cfd59 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:29.467084 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d5e6-d148-4f2b-88c1-c1aad21cfd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:29.467346 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d5e6-d148-4f2b-88c1-c1aad21cfd59 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:29.468088 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5d5e6-d148-4f2b-88c1-c1aad21cfd59 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:29.468390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5d5e6-d148-4f2b-88c1-c1aad21cfd59 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:29.470040 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5d5e6-d148-4f2b-88c1-c1aad21cfd59 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:29.481205 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 438/887] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Nov 8 10:49:29 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:29.482577 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa05f0e-a112-4106-bf38-4838bb6c2269 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:29.492891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa05f0e-a112-4106-bf38-4838bb6c2269 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:29.497505 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753faa41-9adf-4e5a-9405-45a538771701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:29.498158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753faa41-9adf-4e5a-9405-45a538771701 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:29.498441 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753faa41-9adf-4e5a-9405-45a538771701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:29.498717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753faa41-9adf-4e5a-9405-45a538771701 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:29.499564 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753faa41-9adf-4e5a-9405-45a538771701 admin admin] RBAC: Adding query filter params (interface=admin, service_id=3f78e4429e77472eab694c5cada8b885, region_id=RegionOne) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:29.499865 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753faa41-9adf-4e5a-9405-45a538771701 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:29.501555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753faa41-9adf-4e5a-9405-45a538771701 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:29.511231 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 450/888] 10.222.0.20 () {56 vars in 1270 bytes} [Mon Nov 8 10:49:29 2021] GET /identity/v3/endpoints?service_id=3f78e4429e77472eab694c5cada8b885&interface=admin®ion_id=RegionOne => generated 193 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:29.513650 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb958-03e1-4247-847d-3aa4f4671ae4 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:29.513938 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb958-03e1-4247-847d-3aa4f4671ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:29.514107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753faa41-9adf-4e5a-9405-45a538771701 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:29.514261 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb958-03e1-4247-847d-3aa4f4671ae4 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:29.516792 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 439/889] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:29.522430 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f4554-5e03-4d6a-8d10-ee43ed59ddbb None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:29.522718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f4554-5e03-4d6a-8d10-ee43ed59ddbb None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:29.522995 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f4554-5e03-4d6a-8d10-ee43ed59ddbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:29.524150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753faa41-9adf-4e5a-9405-45a538771701 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:29.528986 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33277c98-0964-4dbe-86df-b0692e4c32d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:29.529632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33277c98-0964-4dbe-86df-b0692e4c32d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:29.529932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33277c98-0964-4dbe-86df-b0692e4c32d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:29.530196 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33277c98-0964-4dbe-86df-b0692e4c32d4 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:29.530887 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33277c98-0964-4dbe-86df-b0692e4c32d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:29.532551 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33277c98-0964-4dbe-86df-b0692e4c32d4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:29.543218 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 451/890] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Nov 8 10:49:29 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 10:49:29.548626 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-eb1f4554-5e03-4d6a-8d10-ee43ed59ddbb None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:29.550274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-eb1f4554-5e03-4d6a-8d10-ee43ed59ddbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:29.559834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 440/891] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:29 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:29.586944 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33277c98-0964-4dbe-86df-b0692e4c32d4 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:29.597809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33277c98-0964-4dbe-86df-b0692e4c32d4 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:29.603354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96349c3f-655f-41c2-a5b2-93e5ca54696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:29.604514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349c3f-655f-41c2-a5b2-93e5ca54696e admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:29.604997 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349c3f-655f-41c2-a5b2-93e5ca54696e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:29.605468 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349c3f-655f-41c2-a5b2-93e5ca54696e admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:29.606537 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96349c3f-655f-41c2-a5b2-93e5ca54696e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:29.608780 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96349c3f-655f-41c2-a5b2-93e5ca54696e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:29.626955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.sql.core [None req-96349c3f-655f-41c2-a5b2-93e5ca54696e admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 08 10:49:29.626955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 08 10:49:29.626955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [parameters: {'user_id': '6c5bc7e7a51545abbc8f2cf2e4193574', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 08 10:49:29.626955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79200) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 08 10:49:29.633909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-96349c3f-655f-41c2-a5b2-93e5ca54696e admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 08 10:49:29.636105 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 452/892] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 10:49:29 2021] POST /identity/v3/users => generated 160 bytes in 50 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:29.644168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f4554-5e03-4d6a-8d10-ee43ed59ddbb None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:29.655047 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f4554-5e03-4d6a-8d10-ee43ed59ddbb None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:29.660690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae95e2-3a41-4cde-a09a-fedb3b8c9949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:29.661930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae95e2-3a41-4cde-a09a-fedb3b8c9949 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:29.662454 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae95e2-3a41-4cde-a09a-fedb3b8c9949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:29.662975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae95e2-3a41-4cde-a09a-fedb3b8c9949 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:29.672136 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae95e2-3a41-4cde-a09a-fedb3b8c9949 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:29.675231 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae95e2-3a41-4cde-a09a-fedb3b8c9949 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:29.692700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-f7ae95e2-3a41-4cde-a09a-fedb3b8c9949 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 08 10:49:29.694719 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 441/893] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:49:29 2021] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:29.702303 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96349c3f-655f-41c2-a5b2-93e5ca54696e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:29.714969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96349c3f-655f-41c2-a5b2-93e5ca54696e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:29.720625 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7579cee-3cac-415b-aa1a-a3d56da2ed4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:29.721654 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7579cee-3cac-415b-aa1a-a3d56da2ed4e admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:29.722117 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7579cee-3cac-415b-aa1a-a3d56da2ed4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:29.722539 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7579cee-3cac-415b-aa1a-a3d56da2ed4e admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:29.723720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7579cee-3cac-415b-aa1a-a3d56da2ed4e admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:29.724193 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7579cee-3cac-415b-aa1a-a3d56da2ed4e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:29.726809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7579cee-3cac-415b-aa1a-a3d56da2ed4e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:29.770355 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 453/894] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Nov 8 10:49:29 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:30.311977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6f899-5b18-4710-8077-dde42b6f7c0a None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:30.312573 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6f899-5b18-4710-8077-dde42b6f7c0a None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:30.312573 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6f899-5b18-4710-8077-dde42b6f7c0a None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:30.314555 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 442/895] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:30.320542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87150ffa-ecae-41e0-bf02-095ac19206a8 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:30.320982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87150ffa-ecae-41e0-bf02-095ac19206a8 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:30.321057 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87150ffa-ecae-41e0-bf02-095ac19206a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:30.339711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-87150ffa-ecae-41e0-bf02-095ac19206a8 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:30.341221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-87150ffa-ecae-41e0-bf02-095ac19206a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:30.349803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 454/896] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:30 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:30.373534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6f899-5b18-4710-8077-dde42b6f7c0a None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:30.386575 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6f899-5b18-4710-8077-dde42b6f7c0a None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:30.391343 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2922c2-cc69-4e2f-9df4-33cbd25a6d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:30.392638 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2922c2-cc69-4e2f-9df4-33cbd25a6d70 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:30.392923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2922c2-cc69-4e2f-9df4-33cbd25a6d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:30.393192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2922c2-cc69-4e2f-9df4-33cbd25a6d70 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:30.393855 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2922c2-cc69-4e2f-9df4-33cbd25a6d70 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:30.395484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2922c2-cc69-4e2f-9df4-33cbd25a6d70 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:30.406366 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-cc2922c2-cc69-4e2f-9df4-33cbd25a6d70 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 08 10:49:30.411348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 443/897] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:30 2021] GET /identity/v3/services/compute => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:30.414320 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87150ffa-ecae-41e0-bf02-095ac19206a8 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:30.423505 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87150ffa-ecae-41e0-bf02-095ac19206a8 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:30.428449 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5234568-d04c-41b0-96c8-135dfe5f0e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:30.429100 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5234568-d04c-41b0-96c8-135dfe5f0e17 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:30.429379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5234568-d04c-41b0-96c8-135dfe5f0e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:30.429665 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5234568-d04c-41b0-96c8-135dfe5f0e17 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:30.430337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5234568-d04c-41b0-96c8-135dfe5f0e17 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:30.430638 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5234568-d04c-41b0-96c8-135dfe5f0e17 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:30.432280 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5234568-d04c-41b0-96c8-135dfe5f0e17 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:30.437516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 455/898] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Nov 8 10:49:30 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:30.443728 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2922c2-cc69-4e2f-9df4-33cbd25a6d70 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:30.453755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2922c2-cc69-4e2f-9df4-33cbd25a6d70 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:30.458870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff3966-b679-49fd-8863-60f58d919067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:30.459592 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3966-b679-49fd-8863-60f58d919067 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:30.459843 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3966-b679-49fd-8863-60f58d919067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:30.460138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3966-b679-49fd-8863-60f58d919067 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:30.460919 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff3966-b679-49fd-8863-60f58d919067 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:30.464428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff3966-b679-49fd-8863-60f58d919067 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:30.466076 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff3966-b679-49fd-8863-60f58d919067 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:30.476850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 444/899] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Nov 8 10:49:30 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:30.483438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5234568-d04c-41b0-96c8-135dfe5f0e17 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:30.493953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5234568-d04c-41b0-96c8-135dfe5f0e17 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:30.499755 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704fe86-1b60-4d6f-b806-8d64d7bbf584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:30.500510 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704fe86-1b60-4d6f-b806-8d64d7bbf584 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:30.500854 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704fe86-1b60-4d6f-b806-8d64d7bbf584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:30.501217 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704fe86-1b60-4d6f-b806-8d64d7bbf584 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:30.502097 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704fe86-1b60-4d6f-b806-8d64d7bbf584 admin admin] RBAC: Adding query filter params (interface=public, service_id=197f7ac1cba04e3ea2cc5963307e7642, region_id=RegionOne) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:30.502476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704fe86-1b60-4d6f-b806-8d64d7bbf584 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:30.504171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704fe86-1b60-4d6f-b806-8d64d7bbf584 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:30.510071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 456/900] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Nov 8 10:49:30 2021] GET /identity/v3/endpoints?service_id=197f7ac1cba04e3ea2cc5963307e7642&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:30.517570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff3966-b679-49fd-8863-60f58d919067 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:30.527814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff3966-b679-49fd-8863-60f58d919067 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:30.532386 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8b266-e4c5-4310-aab0-df5b5dbc3292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:30.533068 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8b266-e4c5-4310-aab0-df5b5dbc3292 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:30.533354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8b266-e4c5-4310-aab0-df5b5dbc3292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:30.533627 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8b266-e4c5-4310-aab0-df5b5dbc3292 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:30.534314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8b266-e4c5-4310-aab0-df5b5dbc3292 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:30.535988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8b266-e4c5-4310-aab0-df5b5dbc3292 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:30.542575 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 445/901] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Nov 8 10:49:30 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 10:49:30.845460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb453fb3-5f66-4dbb-b14e-99d846e8e98b None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:30.845847 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb453fb3-5f66-4dbb-b14e-99d846e8e98b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:30.846022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb453fb3-5f66-4dbb-b14e-99d846e8e98b None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:30.847886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 457/902] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:30.854239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1977b9-7d1a-45ba-84fb-8242b4fab3b1 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:30.854515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1977b9-7d1a-45ba-84fb-8242b4fab3b1 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:30.854807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1977b9-7d1a-45ba-84fb-8242b4fab3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:30.873369 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8c1977b9-7d1a-45ba-84fb-8242b4fab3b1 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:30.874571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8c1977b9-7d1a-45ba-84fb-8242b4fab3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:30.883219 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 446/903] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:30 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:30.908052 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb453fb3-5f66-4dbb-b14e-99d846e8e98b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:30.920696 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb453fb3-5f66-4dbb-b14e-99d846e8e98b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:30.925621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329d188-05fa-40aa-8a26-e93f9781bc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:30.926408 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329d188-05fa-40aa-8a26-e93f9781bc32 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:30.926665 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329d188-05fa-40aa-8a26-e93f9781bc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:30.926967 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329d188-05fa-40aa-8a26-e93f9781bc32 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:30.927662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329d188-05fa-40aa-8a26-e93f9781bc32 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:30.929267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329d188-05fa-40aa-8a26-e93f9781bc32 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:30.940110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-f329d188-05fa-40aa-8a26-e93f9781bc32 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 08 10:49:30.941462 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 458/904] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Nov 8 10:49:30 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:30.948147 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1977b9-7d1a-45ba-84fb-8242b4fab3b1 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:30.957409 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1977b9-7d1a-45ba-84fb-8242b4fab3b1 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:30.962453 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90166f-3e56-4ad7-9e90-f1012afc48cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:30.963115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90166f-3e56-4ad7-9e90-f1012afc48cd admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:30.963444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90166f-3e56-4ad7-9e90-f1012afc48cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:30.963724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90166f-3e56-4ad7-9e90-f1012afc48cd admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:30.964442 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90166f-3e56-4ad7-9e90-f1012afc48cd admin admin] RBAC: Adding query filter params (name=image) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:30.964740 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90166f-3e56-4ad7-9e90-f1012afc48cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:30.966342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90166f-3e56-4ad7-9e90-f1012afc48cd admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:30.976524 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 447/905] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:30 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:30.977769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329d188-05fa-40aa-8a26-e93f9781bc32 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:30.987787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329d188-05fa-40aa-8a26-e93f9781bc32 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:30.994052 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e50746-cd98-4683-b6f2-7123ddfa28f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:30.994917 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e50746-cd98-4683-b6f2-7123ddfa28f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:30.995325 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e50746-cd98-4683-b6f2-7123ddfa28f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:30.995612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e50746-cd98-4683-b6f2-7123ddfa28f3 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:30.996336 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e50746-cd98-4683-b6f2-7123ddfa28f3 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:30.996645 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e50746-cd98-4683-b6f2-7123ddfa28f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:30.998249 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e50746-cd98-4683-b6f2-7123ddfa28f3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:31.003531 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 459/906] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:30 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:31.009753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90166f-3e56-4ad7-9e90-f1012afc48cd admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:31.022232 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90166f-3e56-4ad7-9e90-f1012afc48cd admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:31.026919 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631259c-ba24-426d-aca6-9f4adf1ead76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:31.027596 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631259c-ba24-426d-aca6-9f4adf1ead76 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:31.027878 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631259c-ba24-426d-aca6-9f4adf1ead76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:31.028150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631259c-ba24-426d-aca6-9f4adf1ead76 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:31.028948 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631259c-ba24-426d-aca6-9f4adf1ead76 admin admin] RBAC: Adding query filter params (interface=public, service_id=af196f3d71ed4575a7d42e504c498708, region_id=RegionOne) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:31.029270 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631259c-ba24-426d-aca6-9f4adf1ead76 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:31.030852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631259c-ba24-426d-aca6-9f4adf1ead76 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:31.036101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 448/907] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Nov 8 10:49:31 2021] GET /identity/v3/endpoints?service_id=af196f3d71ed4575a7d42e504c498708&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:31.042142 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e50746-cd98-4683-b6f2-7123ddfa28f3 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:31.052083 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e50746-cd98-4683-b6f2-7123ddfa28f3 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:31.056807 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce58460-c688-431e-b320-2f6ae11e8221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:31.057454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce58460-c688-431e-b320-2f6ae11e8221 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:31.057739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce58460-c688-431e-b320-2f6ae11e8221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:31.058018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce58460-c688-431e-b320-2f6ae11e8221 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:31.058702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce58460-c688-431e-b320-2f6ae11e8221 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:31.060481 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce58460-c688-431e-b320-2f6ae11e8221 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:31.071347 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 460/908] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Nov 8 10:49:31 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 10:49:31.808698 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4bed-dc80-4685-91f8-d7ec262812d7 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:31.809212 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4bed-dc80-4685-91f8-d7ec262812d7 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:31.809212 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4bed-dc80-4685-91f8-d7ec262812d7 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:31.811101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 449/909] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:31.817190 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ac474-3414-4686-a4d6-8712c489baa2 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:31.817646 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ac474-3414-4686-a4d6-8712c489baa2 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:31.817722 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ac474-3414-4686-a4d6-8712c489baa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:31.836056 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-eb9ac474-3414-4686-a4d6-8712c489baa2 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:31.837241 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-eb9ac474-3414-4686-a4d6-8712c489baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:31.845738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 461/910] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:31 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:31.869187 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b4bed-dc80-4685-91f8-d7ec262812d7 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:31.882332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b4bed-dc80-4685-91f8-d7ec262812d7 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:31.887110 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dcbc9-4996-47cc-9524-64520e172c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:31.887937 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dcbc9-4996-47cc-9524-64520e172c70 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:31.888190 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dcbc9-4996-47cc-9524-64520e172c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:31.888478 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dcbc9-4996-47cc-9524-64520e172c70 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:31.889125 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dcbc9-4996-47cc-9524-64520e172c70 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:31.890708 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dcbc9-4996-47cc-9524-64520e172c70 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:31.902374 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-1a1dcbc9-4996-47cc-9524-64520e172c70 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 08 10:49:31.903789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 450/911] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Nov 8 10:49:31 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:31.910335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ac474-3414-4686-a4d6-8712c489baa2 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:31.919684 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ac474-3414-4686-a4d6-8712c489baa2 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:31.924726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686c12f-8bae-44be-a3cb-bf69c27a62e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:31.925394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686c12f-8bae-44be-a3cb-bf69c27a62e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:31.925630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686c12f-8bae-44be-a3cb-bf69c27a62e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:31.925927 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686c12f-8bae-44be-a3cb-bf69c27a62e3 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:31.926644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686c12f-8bae-44be-a3cb-bf69c27a62e3 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:31.927003 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686c12f-8bae-44be-a3cb-bf69c27a62e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:31.928631 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686c12f-8bae-44be-a3cb-bf69c27a62e3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:31.934429 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 462/912] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Nov 8 10:49:31 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:31.940861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dcbc9-4996-47cc-9524-64520e172c70 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:31.950713 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dcbc9-4996-47cc-9524-64520e172c70 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:31.955810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae209c-3407-4b6d-b535-a3b97cf8c5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:31.956470 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae209c-3407-4b6d-b535-a3b97cf8c5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:31.956782 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae209c-3407-4b6d-b535-a3b97cf8c5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:31.957109 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae209c-3407-4b6d-b535-a3b97cf8c5a1 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:31.957875 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae209c-3407-4b6d-b535-a3b97cf8c5a1 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:31.958397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae209c-3407-4b6d-b535-a3b97cf8c5a1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:31.960530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae209c-3407-4b6d-b535-a3b97cf8c5a1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:31.966436 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 451/913] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Nov 8 10:49:31 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:31.972959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686c12f-8bae-44be-a3cb-bf69c27a62e3 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:31.982944 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686c12f-8bae-44be-a3cb-bf69c27a62e3 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:31.987602 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90571d9-3014-44a0-835f-9fe36ec77f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:31.988334 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90571d9-3014-44a0-835f-9fe36ec77f91 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:31.988683 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90571d9-3014-44a0-835f-9fe36ec77f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:31.989025 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90571d9-3014-44a0-835f-9fe36ec77f91 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:31.989872 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90571d9-3014-44a0-835f-9fe36ec77f91 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:31.990871 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-e90571d9-3014-44a0-835f-9fe36ec77f91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:49:31.990871 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:49:31.990871 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:49:31.991791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90571d9-3014-44a0-835f-9fe36ec77f91 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:32.010838 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 463/914] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Nov 8 10:49:31 2021] POST /identity/v3/endpoints => generated 325 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:49:32.843487 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d400a-e68c-4c4e-a88e-3e8bcb8bbaed None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:32.843997 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d400a-e68c-4c4e-a88e-3e8bcb8bbaed None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:32.843997 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d400a-e68c-4c4e-a88e-3e8bcb8bbaed None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:32.845983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 452/915] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:32.852177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c410189-d430-4346-aa2e-e77ffe898ed9 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:32.852614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c410189-d430-4346-aa2e-e77ffe898ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:32.852686 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c410189-d430-4346-aa2e-e77ffe898ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:32.870969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-3c410189-d430-4346-aa2e-e77ffe898ed9 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:32.872213 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-3c410189-d430-4346-aa2e-e77ffe898ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:32.890514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 464/916] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:32 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:32.915306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d400a-e68c-4c4e-a88e-3e8bcb8bbaed None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:32.928384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d400a-e68c-4c4e-a88e-3e8bcb8bbaed None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:32.932880 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b17d7-1040-4c13-b442-86cb349d6d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:32.933683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b17d7-1040-4c13-b442-86cb349d6d8b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:32.933963 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b17d7-1040-4c13-b442-86cb349d6d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:32.934242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b17d7-1040-4c13-b442-86cb349d6d8b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:32.934908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b17d7-1040-4c13-b442-86cb349d6d8b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:32.936565 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b17d7-1040-4c13-b442-86cb349d6d8b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:32.947933 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-b50b17d7-1040-4c13-b442-86cb349d6d8b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 08 10:49:32.949285 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 453/917] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:32 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:32.956124 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c410189-d430-4346-aa2e-e77ffe898ed9 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:32.965556 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c410189-d430-4346-aa2e-e77ffe898ed9 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:32.970734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d7dc7-1dd2-4e1e-8bbd-5854ba06cdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:32.971420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d7dc7-1dd2-4e1e-8bbd-5854ba06cdfa admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:32.971706 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d7dc7-1dd2-4e1e-8bbd-5854ba06cdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:32.971948 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d7dc7-1dd2-4e1e-8bbd-5854ba06cdfa admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:32.972700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d7dc7-1dd2-4e1e-8bbd-5854ba06cdfa admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:32.973003 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d7dc7-1dd2-4e1e-8bbd-5854ba06cdfa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:32.974598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d7dc7-1dd2-4e1e-8bbd-5854ba06cdfa admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:32.979929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 465/918] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Nov 8 10:49:32 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:32.986516 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b17d7-1040-4c13-b442-86cb349d6d8b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:32.997307 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b17d7-1040-4c13-b442-86cb349d6d8b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:33.002651 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201e7f6-fb28-48d8-ad7a-39a2c8407f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:33.003348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201e7f6-fb28-48d8-ad7a-39a2c8407f1c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:33.003643 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201e7f6-fb28-48d8-ad7a-39a2c8407f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:33.003913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201e7f6-fb28-48d8-ad7a-39a2c8407f1c admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:33.004638 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201e7f6-fb28-48d8-ad7a-39a2c8407f1c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:33.004945 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201e7f6-fb28-48d8-ad7a-39a2c8407f1c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:33.006537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201e7f6-fb28-48d8-ad7a-39a2c8407f1c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:33.011988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 454/919] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Nov 8 10:49:32 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:33.018604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d7dc7-1dd2-4e1e-8bbd-5854ba06cdfa admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:33.028146 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d7dc7-1dd2-4e1e-8bbd-5854ba06cdfa admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:33.032739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb1db1-8e0b-4fbe-8a94-534137576bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:33.033387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb1db1-8e0b-4fbe-8a94-534137576bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:33.033671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb1db1-8e0b-4fbe-8a94-534137576bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:33.033947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb1db1-8e0b-4fbe-8a94-534137576bd0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:33.034726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb1db1-8e0b-4fbe-8a94-534137576bd0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:33.036353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb1db1-8e0b-4fbe-8a94-534137576bd0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:33.063188 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 466/920] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Nov 8 10:49:33 2021] POST /identity/v3/endpoints => generated 334 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:49:33.320709 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8aa27-c8ea-49df-8593-f58c34720194 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:33.321049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8aa27-c8ea-49df-8593-f58c34720194 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:33.321265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8aa27-c8ea-49df-8593-f58c34720194 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:33.323192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 455/921] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:33.329959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9338e83-2aa9-4676-ab36-0144098b1cf0 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:33.330500 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9338e83-2aa9-4676-ab36-0144098b1cf0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:33.330874 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9338e83-2aa9-4676-ab36-0144098b1cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:33.349885 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-e9338e83-2aa9-4676-ab36-0144098b1cf0 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:33.351082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e9338e83-2aa9-4676-ab36-0144098b1cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:33.368796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 467/922] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:33 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:33.393863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8aa27-c8ea-49df-8593-f58c34720194 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:33.406160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8aa27-c8ea-49df-8593-f58c34720194 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:33.410603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74862a-64ee-4183-8190-7e429399c637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:33.411445 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74862a-64ee-4183-8190-7e429399c637 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:33.411716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74862a-64ee-4183-8190-7e429399c637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:33.411984 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74862a-64ee-4183-8190-7e429399c637 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:33.412648 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74862a-64ee-4183-8190-7e429399c637 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:33.414244 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74862a-64ee-4183-8190-7e429399c637 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:33.425307 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-ba74862a-64ee-4183-8190-7e429399c637 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 08 10:49:33.427525 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 456/923] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Nov 8 10:49:33 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:33.433382 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9338e83-2aa9-4676-ab36-0144098b1cf0 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:33.442422 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9338e83-2aa9-4676-ab36-0144098b1cf0 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:33.446787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970c487-bf28-44a7-9c78-7ca472707cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:33.447472 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970c487-bf28-44a7-9c78-7ca472707cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:33.447749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970c487-bf28-44a7-9c78-7ca472707cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:33.448014 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970c487-bf28-44a7-9c78-7ca472707cc4 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:33.448725 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970c487-bf28-44a7-9c78-7ca472707cc4 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:33.449023 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970c487-bf28-44a7-9c78-7ca472707cc4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:33.450602 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970c487-bf28-44a7-9c78-7ca472707cc4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:33.455783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 468/924] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:33 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:33.464426 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74862a-64ee-4183-8190-7e429399c637 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:33.476328 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74862a-64ee-4183-8190-7e429399c637 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:33.480905 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f557542-6b60-43f9-a9cd-2cb6149c825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:33.481562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f557542-6b60-43f9-a9cd-2cb6149c825f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:33.481841 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f557542-6b60-43f9-a9cd-2cb6149c825f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:33.482111 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f557542-6b60-43f9-a9cd-2cb6149c825f admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:33.482837 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f557542-6b60-43f9-a9cd-2cb6149c825f admin admin] RBAC: Adding query filter params (type=image) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:33.483165 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f557542-6b60-43f9-a9cd-2cb6149c825f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:33.484866 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f557542-6b60-43f9-a9cd-2cb6149c825f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:33.495169 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 457/925] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:33 2021] GET /identity/v3/services?type=image => generated 350 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:33.496507 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970c487-bf28-44a7-9c78-7ca472707cc4 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:33.506506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970c487-bf28-44a7-9c78-7ca472707cc4 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:33.511316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd4182-20a3-4f1f-a8fb-7d844a8215bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:33.511954 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd4182-20a3-4f1f-a8fb-7d844a8215bc admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:33.512239 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd4182-20a3-4f1f-a8fb-7d844a8215bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:33.512508 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd4182-20a3-4f1f-a8fb-7d844a8215bc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:33.513260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd4182-20a3-4f1f-a8fb-7d844a8215bc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:33.514843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd4182-20a3-4f1f-a8fb-7d844a8215bc admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:33.534460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 469/926] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Nov 8 10:49:33 2021] POST /identity/v3/endpoints => generated 327 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 10:49:34.359836 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d24d8-0e0c-4510-a30d-eb0b69bc0944 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:34.360392 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d24d8-0e0c-4510-a30d-eb0b69bc0944 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:34.360392 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d24d8-0e0c-4510-a30d-eb0b69bc0944 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:34.362643 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 458/927] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:34.369109 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c749c9e-95f7-417e-9f78-15145d0ebf58 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:34.369610 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c749c9e-95f7-417e-9f78-15145d0ebf58 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:34.369610 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c749c9e-95f7-417e-9f78-15145d0ebf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:34.388050 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-6c749c9e-95f7-417e-9f78-15145d0ebf58 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:34.389244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6c749c9e-95f7-417e-9f78-15145d0ebf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:34.408256 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 470/928] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:34 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:34.432727 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d24d8-0e0c-4510-a30d-eb0b69bc0944 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:34.446043 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d24d8-0e0c-4510-a30d-eb0b69bc0944 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:34.450572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88650ae8-c05d-4d72-bc98-5d536143c3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:34.451397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88650ae8-c05d-4d72-bc98-5d536143c3ba admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:34.451683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88650ae8-c05d-4d72-bc98-5d536143c3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:34.451959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88650ae8-c05d-4d72-bc98-5d536143c3ba admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:34.453236 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88650ae8-c05d-4d72-bc98-5d536143c3ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:34.455395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88650ae8-c05d-4d72-bc98-5d536143c3ba admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:34.457197 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 459/929] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:34.464400 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c749c9e-95f7-417e-9f78-15145d0ebf58 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:34.476671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c749c9e-95f7-417e-9f78-15145d0ebf58 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:34.481617 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c082e1e-dbb9-4631-be12-74a17c7db4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:34.482286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082e1e-dbb9-4631-be12-74a17c7db4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:34.482570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082e1e-dbb9-4631-be12-74a17c7db4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:34.482843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082e1e-dbb9-4631-be12-74a17c7db4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:34.483611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c082e1e-dbb9-4631-be12-74a17c7db4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:34.485693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c082e1e-dbb9-4631-be12-74a17c7db4e2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:34.514479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 471/930] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Nov 8 10:49:34 2021] POST /identity/v3/projects => generated 311 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:49:35.416692 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51069308-0ff4-42d8-9ddc-a50e4f334278 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.417207 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51069308-0ff4-42d8-9ddc-a50e4f334278 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.417310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51069308-0ff4-42d8-9ddc-a50e4f334278 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.419215 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 460/931] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:35.425574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3d9a-34b5-48b1-9945-14a623a499b7 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.426055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3d9a-34b5-48b1-9945-14a623a499b7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.426133 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3d9a-34b5-48b1-9945-14a623a499b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.443847 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-176f3d9a-34b5-48b1-9945-14a623a499b7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:35.445024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-176f3d9a-34b5-48b1-9945-14a623a499b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:35.504598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 472/932] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:35.529302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51069308-0ff4-42d8-9ddc-a50e4f334278 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:35.542186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51069308-0ff4-42d8-9ddc-a50e4f334278 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:35.546893 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701760b-e213-4f0b-8b90-3a619a2da4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:35.547720 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701760b-e213-4f0b-8b90-3a619a2da4fa admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.548135 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701760b-e213-4f0b-8b90-3a619a2da4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.548444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701760b-e213-4f0b-8b90-3a619a2da4fa admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.558970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701760b-e213-4f0b-8b90-3a619a2da4fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:35.566075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-e701760b-e213-4f0b-8b90-3a619a2da4fa admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 08 10:49:35.567418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 461/933] 10.222.0.20 () {56 vars in 1141 bytes} [Mon Nov 8 10:49:35 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:35.574099 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f3d9a-34b5-48b1-9945-14a623a499b7 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:35.583638 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f3d9a-34b5-48b1-9945-14a623a499b7 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:35.588295 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb0901-2e1a-4aea-9188-83c823bad570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:35.589032 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb0901-2e1a-4aea-9188-83c823bad570 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.589399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb0901-2e1a-4aea-9188-83c823bad570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.589737 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb0901-2e1a-4aea-9188-83c823bad570 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.590595 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb0901-2e1a-4aea-9188-83c823bad570 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:35.590985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb0901-2e1a-4aea-9188-83c823bad570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:35.592682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb0901-2e1a-4aea-9188-83c823bad570 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:35.602034 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 473/934] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Nov 8 10:49:35 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:35.608800 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701760b-e213-4f0b-8b90-3a619a2da4fa admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:35.619662 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701760b-e213-4f0b-8b90-3a619a2da4fa admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:35.624595 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff450756-7279-4da4-be5f-c93231f29544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:35.625719 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450756-7279-4da4-be5f-c93231f29544 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.626030 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450756-7279-4da4-be5f-c93231f29544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.626297 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450756-7279-4da4-be5f-c93231f29544 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.637537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff450756-7279-4da4-be5f-c93231f29544 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:35.639514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff450756-7279-4da4-be5f-c93231f29544 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:35.657577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-ff450756-7279-4da4-be5f-c93231f29544 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:35.659403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 462/935] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:35.666124 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb0901-2e1a-4aea-9188-83c823bad570 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:35.677377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb0901-2e1a-4aea-9188-83c823bad570 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:35.682983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff78c5-680b-47d7-96fe-600918a05234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:35.683742 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff78c5-680b-47d7-96fe-600918a05234 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.684080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff78c5-680b-47d7-96fe-600918a05234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.684316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff78c5-680b-47d7-96fe-600918a05234 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.685106 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff78c5-680b-47d7-96fe-600918a05234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:35.685467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff78c5-680b-47d7-96fe-600918a05234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:35.687175 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff78c5-680b-47d7-96fe-600918a05234 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:35.701197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 474/936] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:35.707588 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff450756-7279-4da4-be5f-c93231f29544 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:35.717799 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff450756-7279-4da4-be5f-c93231f29544 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:35.723080 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ddb60-93da-45af-9d0e-728468d72b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:35.723989 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ddb60-93da-45af-9d0e-728468d72b4c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.724271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ddb60-93da-45af-9d0e-728468d72b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.724549 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ddb60-93da-45af-9d0e-728468d72b4c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.732631 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ddb60-93da-45af-9d0e-728468d72b4c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:35.734734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ddb60-93da-45af-9d0e-728468d72b4c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:35.749294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-733ddb60-93da-45af-9d0e-728468d72b4c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 08 10:49:35.750903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 463/937] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Nov 8 10:49:35 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:35.757996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff78c5-680b-47d7-96fe-600918a05234 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:35.769436 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff78c5-680b-47d7-96fe-600918a05234 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:35.774361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1fce4-5238-4484-80c4-987e8e77822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:35.775046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1fce4-5238-4484-80c4-987e8e77822f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.775388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1fce4-5238-4484-80c4-987e8e77822f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.775664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1fce4-5238-4484-80c4-987e8e77822f admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.776523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1fce4-5238-4484-80c4-987e8e77822f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:35.776820 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1fce4-5238-4484-80c4-987e8e77822f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:35.778687 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1fce4-5238-4484-80c4-987e8e77822f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:35.796558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 475/938] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Nov 8 10:49:35 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:35.803069 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ddb60-93da-45af-9d0e-728468d72b4c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:35.812810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607bba6-3eed-45d1-b94a-7a9f455cd133 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.813092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607bba6-3eed-45d1-b94a-7a9f455cd133 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.813298 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ddb60-93da-45af-9d0e-728468d72b4c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:35.813403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607bba6-3eed-45d1-b94a-7a9f455cd133 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.815487 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 476/939] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:35.818514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06b972-4646-47ae-8a98-c67baac77fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:35.819157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06b972-4646-47ae-8a98-c67baac77fff admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.819447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06b972-4646-47ae-8a98-c67baac77fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.819735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06b972-4646-47ae-8a98-c67baac77fff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.821762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b8bb8-f48c-4e15-9b25-c0b84a110b1e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.822039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b8bb8-f48c-4e15-9b25-c0b84a110b1e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.822316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b8bb8-f48c-4e15-9b25-c0b84a110b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.828390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06b972-4646-47ae-8a98-c67baac77fff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:35.830432 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06b972-4646-47ae-8a98-c67baac77fff admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:35.839432 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 464/940] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:35 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:49:35.840622 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-9c6b8bb8-f48c-4e15-9b25-c0b84a110b1e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:35.842089 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9c6b8bb8-f48c-4e15-9b25-c0b84a110b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:35.846271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06b972-4646-47ae-8a98-c67baac77fff admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:35.850483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 477/941] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:35.855819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06b972-4646-47ae-8a98-c67baac77fff admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:35.860963 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3f7de-204a-4ad9-9f35-2f1b8c439503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:35.861952 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3f7de-204a-4ad9-9f35-2f1b8c439503 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.862437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3f7de-204a-4ad9-9f35-2f1b8c439503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.862901 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3f7de-204a-4ad9-9f35-2f1b8c439503 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.873696 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b8bb8-f48c-4e15-9b25-c0b84a110b1e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:35.873972 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3f7de-204a-4ad9-9f35-2f1b8c439503 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:35.876087 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3f7de-204a-4ad9-9f35-2f1b8c439503 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:35.882991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b8bb8-f48c-4e15-9b25-c0b84a110b1e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:35.888192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38916523-30d0-473d-be22-b50dd3cf06a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:35.888838 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916523-30d0-473d-be22-b50dd3cf06a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.889118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916523-30d0-473d-be22-b50dd3cf06a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.889389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916523-30d0-473d-be22-b50dd3cf06a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.893719 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-48c3f7de-204a-4ad9-9f35-2f1b8c439503 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:35.895071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 465/942] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:35.898144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38916523-30d0-473d-be22-b50dd3cf06a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:35.900263 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38916523-30d0-473d-be22-b50dd3cf06a1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:35.901102 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3f7de-204a-4ad9-9f35-2f1b8c439503 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:35.909359 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 478/943] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:35 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 10:49:35.912464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3f7de-204a-4ad9-9f35-2f1b8c439503 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:35.915708 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38916523-30d0-473d-be22-b50dd3cf06a1 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:35.917357 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bc928-d188-4845-ae13-c4dacb466a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:35.918022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bc928-d188-4845-ae13-c4dacb466a4c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.918294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bc928-d188-4845-ae13-c4dacb466a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.918657 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bc928-d188-4845-ae13-c4dacb466a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.919437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bc928-d188-4845-ae13-c4dacb466a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:35.919739 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bc928-d188-4845-ae13-c4dacb466a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:35.921335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bc928-d188-4845-ae13-c4dacb466a4c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:35.924903 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38916523-30d0-473d-be22-b50dd3cf06a1 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:35.929698 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c7255-ba03-472b-b110-9698fbf12422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:35.930436 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c7255-ba03-472b-b110-9698fbf12422 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.930717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c7255-ba03-472b-b110-9698fbf12422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.930994 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c7255-ba03-472b-b110-9698fbf12422 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.932203 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c7255-ba03-472b-b110-9698fbf12422 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:35.933635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 466/944] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:35.933886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c7255-ba03-472b-b110-9698fbf12422 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:35.935620 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 479/945] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:35.941592 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bc928-d188-4845-ae13-c4dacb466a4c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:35.951701 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bc928-d188-4845-ae13-c4dacb466a4c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:35.956587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a580208-1800-4b21-8556-52e7c6ac671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:35.957414 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a580208-1800-4b21-8556-52e7c6ac671c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:35.957696 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a580208-1800-4b21-8556-52e7c6ac671c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:35.957967 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a580208-1800-4b21-8556-52e7c6ac671c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:35.965660 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a580208-1800-4b21-8556-52e7c6ac671c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:35.967762 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a580208-1800-4b21-8556-52e7c6ac671c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:35.982605 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-4a580208-1800-4b21-8556-52e7c6ac671c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:35.984084 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 467/946] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:35.990865 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c7255-ba03-472b-b110-9698fbf12422 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:36.002245 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c7255-ba03-472b-b110-9698fbf12422 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:36.009261 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52db353-1472-4b35-acfd-ffd793c2f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:36.010409 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52db353-1472-4b35-acfd-ffd793c2f8af admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:36.011005 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52db353-1472-4b35-acfd-ffd793c2f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:36.011413 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52db353-1472-4b35-acfd-ffd793c2f8af admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:36.012310 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52db353-1472-4b35-acfd-ffd793c2f8af admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:36.012702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52db353-1472-4b35-acfd-ffd793c2f8af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:36.014668 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52db353-1472-4b35-acfd-ffd793c2f8af admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:36.035161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 480/947] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:36.037392 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a580208-1800-4b21-8556-52e7c6ac671c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:36.047499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a580208-1800-4b21-8556-52e7c6ac671c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:36.052112 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658b23a-3299-4377-a728-9fa77bfa2569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:36.052778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658b23a-3299-4377-a728-9fa77bfa2569 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:36.053061 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658b23a-3299-4377-a728-9fa77bfa2569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:36.053333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658b23a-3299-4377-a728-9fa77bfa2569 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:36.054186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658b23a-3299-4377-a728-9fa77bfa2569 admin admin] RBAC: Adding query filter params (role.id=84142a61c6044699aebb0fc5df7f6922, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=d3421cf1bbb24423a2f24c4667adfdda) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:36.054493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658b23a-3299-4377-a728-9fa77bfa2569 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:36.056399 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658b23a-3299-4377-a728-9fa77bfa2569 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:36.062868 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 468/948] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:36 2021] GET /identity/v3/role_assignments?user.id=d3421cf1bbb24423a2f24c4667adfdda&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=84142a61c6044699aebb0fc5df7f6922 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:36.826727 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440d2e-ebbf-48d2-bb7b-51e36fbfca4d None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:36.827321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440d2e-ebbf-48d2-bb7b-51e36fbfca4d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:36.827321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440d2e-ebbf-48d2-bb7b-51e36fbfca4d None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:36.829205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 481/949] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:36.835203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7088ce7-064b-4f65-af1a-fc554e64b753 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:36.835645 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7088ce7-064b-4f65-af1a-fc554e64b753 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:36.835791 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7088ce7-064b-4f65-af1a-fc554e64b753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:36.853917 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-f7088ce7-064b-4f65-af1a-fc554e64b753 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:36.855104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f7088ce7-064b-4f65-af1a-fc554e64b753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:36.864006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 469/950] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:36.889905 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96440d2e-ebbf-48d2-bb7b-51e36fbfca4d None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:36.903266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96440d2e-ebbf-48d2-bb7b-51e36fbfca4d None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:36.908149 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb235da-6236-4614-bb6e-756b798e32fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:36.908945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb235da-6236-4614-bb6e-756b798e32fe admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:36.909228 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb235da-6236-4614-bb6e-756b798e32fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:36.909503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb235da-6236-4614-bb6e-756b798e32fe admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:36.910712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb235da-6236-4614-bb6e-756b798e32fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:36.912440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb235da-6236-4614-bb6e-756b798e32fe admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:36.914041 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 482/951] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:36 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:36.920664 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7088ce7-064b-4f65-af1a-fc554e64b753 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:36.930120 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7088ce7-064b-4f65-af1a-fc554e64b753 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:36.934720 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25b8f7-6887-4682-9caf-3424b5237bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:36.935440 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25b8f7-6887-4682-9caf-3424b5237bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:36.935723 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25b8f7-6887-4682-9caf-3424b5237bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:36.935996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25b8f7-6887-4682-9caf-3424b5237bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:36.936716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25b8f7-6887-4682-9caf-3424b5237bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:36.938705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25b8f7-6887-4682-9caf-3424b5237bc5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:36.962524 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 470/952] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Nov 8 10:49:36 2021] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:49:38.285496 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a42c4-a490-4a7b-8a59-6fa421622462 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:38.286033 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a42c4-a490-4a7b-8a59-6fa421622462 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:38.286205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a42c4-a490-4a7b-8a59-6fa421622462 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:38.288026 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 483/953] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:38.294226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c62c2-4434-4f6f-970d-35673ba8dce5 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:38.294600 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c62c2-4434-4f6f-970d-35673ba8dce5 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:38.294772 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c62c2-4434-4f6f-970d-35673ba8dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:38.314142 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-eb0c62c2-4434-4f6f-970d-35673ba8dce5 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:38.315353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-eb0c62c2-4434-4f6f-970d-35673ba8dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:38.325451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 471/954] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:38.349646 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a42c4-a490-4a7b-8a59-6fa421622462 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:38.363985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a42c4-a490-4a7b-8a59-6fa421622462 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:38.369342 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac3eb0-3bbf-40f7-b16f-39d0b54fc410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:38.370142 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac3eb0-3bbf-40f7-b16f-39d0b54fc410 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:38.370421 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac3eb0-3bbf-40f7-b16f-39d0b54fc410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:38.370700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac3eb0-3bbf-40f7-b16f-39d0b54fc410 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:38.381231 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac3eb0-3bbf-40f7-b16f-39d0b54fc410 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:38.388420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-98ac3eb0-3bbf-40f7-b16f-39d0b54fc410 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 08 10:49:38.389719 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 484/955] 10.222.0.20 () {56 vars in 1141 bytes} [Mon Nov 8 10:49:38 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:38.396677 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c62c2-4434-4f6f-970d-35673ba8dce5 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:38.405644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c62c2-4434-4f6f-970d-35673ba8dce5 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:38.410656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db36522-956d-45f7-9361-aee024bba1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:38.411335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db36522-956d-45f7-9361-aee024bba1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:38.411613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db36522-956d-45f7-9361-aee024bba1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:38.411880 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db36522-956d-45f7-9361-aee024bba1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:38.412629 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db36522-956d-45f7-9361-aee024bba1f6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:38.412920 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db36522-956d-45f7-9361-aee024bba1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:38.414511 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db36522-956d-45f7-9361-aee024bba1f6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:38.422938 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 472/956] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Nov 8 10:49:38 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:38.428915 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac3eb0-3bbf-40f7-b16f-39d0b54fc410 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:38.438946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac3eb0-3bbf-40f7-b16f-39d0b54fc410 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:38.443859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f4e86-3f92-4a9d-b854-94b86bcbd513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:38.444612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4e86-3f92-4a9d-b854-94b86bcbd513 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:38.444891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4e86-3f92-4a9d-b854-94b86bcbd513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:38.445161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4e86-3f92-4a9d-b854-94b86bcbd513 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:38.455449 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f4e86-3f92-4a9d-b854-94b86bcbd513 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:38.457274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f4e86-3f92-4a9d-b854-94b86bcbd513 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:38.473980 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-0f3f4e86-3f92-4a9d-b854-94b86bcbd513 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:38.475155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 485/957] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:38.481649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db36522-956d-45f7-9361-aee024bba1f6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:38.491869 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db36522-956d-45f7-9361-aee024bba1f6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:38.497534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67102530-a2fd-4c62-99df-2ffca41cfb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:38.498182 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102530-a2fd-4c62-99df-2ffca41cfb1e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:38.498465 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102530-a2fd-4c62-99df-2ffca41cfb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:38.498742 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102530-a2fd-4c62-99df-2ffca41cfb1e admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:38.499506 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67102530-a2fd-4c62-99df-2ffca41cfb1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:38.499809 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67102530-a2fd-4c62-99df-2ffca41cfb1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:38.501484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67102530-a2fd-4c62-99df-2ffca41cfb1e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:38.513347 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 473/958] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:38.520126 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f4e86-3f92-4a9d-b854-94b86bcbd513 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:38.530527 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f4e86-3f92-4a9d-b854-94b86bcbd513 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:38.535981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f7462-395b-4365-89b6-42bc5cbfbd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:38.536702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f7462-395b-4365-89b6-42bc5cbfbd2c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:38.536981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f7462-395b-4365-89b6-42bc5cbfbd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:38.537248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f7462-395b-4365-89b6-42bc5cbfbd2c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:38.544658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f7462-395b-4365-89b6-42bc5cbfbd2c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:38.546678 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f7462-395b-4365-89b6-42bc5cbfbd2c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:38.560119 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-e45f7462-395b-4365-89b6-42bc5cbfbd2c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 08 10:49:38.561286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 486/959] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Nov 8 10:49:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:38.567734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67102530-a2fd-4c62-99df-2ffca41cfb1e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:38.577543 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67102530-a2fd-4c62-99df-2ffca41cfb1e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:38.582749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd3715-87eb-4fbc-9a1f-4ef8ca535967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:38.583530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd3715-87eb-4fbc-9a1f-4ef8ca535967 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:38.583882 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd3715-87eb-4fbc-9a1f-4ef8ca535967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:38.584219 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd3715-87eb-4fbc-9a1f-4ef8ca535967 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:38.585125 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd3715-87eb-4fbc-9a1f-4ef8ca535967 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:38.585513 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd3715-87eb-4fbc-9a1f-4ef8ca535967 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:38.587466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd3715-87eb-4fbc-9a1f-4ef8ca535967 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:38.604147 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 474/960] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Nov 8 10:49:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:38.610490 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f7462-395b-4365-89b6-42bc5cbfbd2c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:38.621305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f7462-395b-4365-89b6-42bc5cbfbd2c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:38.626663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b885f7-3438-46c3-9f58-093b4ece5df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:38.627484 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b885f7-3438-46c3-9f58-093b4ece5df6 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:38.627764 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b885f7-3438-46c3-9f58-093b4ece5df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:38.628034 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b885f7-3438-46c3-9f58-093b4ece5df6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:38.638381 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b885f7-3438-46c3-9f58-093b4ece5df6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:38.640264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b885f7-3438-46c3-9f58-093b4ece5df6 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:38.657405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-27b885f7-3438-46c3-9f58-093b4ece5df6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:38.658619 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 487/961] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:38.665158 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd3715-87eb-4fbc-9a1f-4ef8ca535967 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:38.675233 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd3715-87eb-4fbc-9a1f-4ef8ca535967 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:38.680029 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1c7df-65e6-4cb8-9276-afffb9b53628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:38.680679 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1c7df-65e6-4cb8-9276-afffb9b53628 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:38.680959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1c7df-65e6-4cb8-9276-afffb9b53628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:38.681232 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1c7df-65e6-4cb8-9276-afffb9b53628 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:38.681976 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1c7df-65e6-4cb8-9276-afffb9b53628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:38.682273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1c7df-65e6-4cb8-9276-afffb9b53628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:38.683902 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1c7df-65e6-4cb8-9276-afffb9b53628 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:38.695703 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 475/962] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:38.702382 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b885f7-3438-46c3-9f58-093b4ece5df6 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:38.712983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b885f7-3438-46c3-9f58-093b4ece5df6 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:38.718674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b42819-05bf-4988-8565-8f26b793fcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:38.719495 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b42819-05bf-4988-8565-8f26b793fcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:38.719806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b42819-05bf-4988-8565-8f26b793fcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:38.720082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b42819-05bf-4988-8565-8f26b793fcf9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:38.727367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b42819-05bf-4988-8565-8f26b793fcf9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:38.729365 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b42819-05bf-4988-8565-8f26b793fcf9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:38.742562 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-80b42819-05bf-4988-8565-8f26b793fcf9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:38.743841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 488/963] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:38.750304 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1c7df-65e6-4cb8-9276-afffb9b53628 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:38.760765 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1c7df-65e6-4cb8-9276-afffb9b53628 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:38.767151 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2145e-db29-4417-9acb-4d3dbde6dc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:38.767817 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2145e-db29-4417-9acb-4d3dbde6dc69 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:38.768095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2145e-db29-4417-9acb-4d3dbde6dc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:38.768368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2145e-db29-4417-9acb-4d3dbde6dc69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:38.769183 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2145e-db29-4417-9acb-4d3dbde6dc69 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:38.769488 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2145e-db29-4417-9acb-4d3dbde6dc69 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:38.771376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2145e-db29-4417-9acb-4d3dbde6dc69 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:38.784099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 476/964] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:38.790939 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b42819-05bf-4988-8565-8f26b793fcf9 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:38.802067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b42819-05bf-4988-8565-8f26b793fcf9 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:38.807005 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae5a5c-c1c5-4bcb-a6a9-495c19157212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:38.807909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5a5c-c1c5-4bcb-a6a9-495c19157212 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:38.808191 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5a5c-c1c5-4bcb-a6a9-495c19157212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:38.808463 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5a5c-c1c5-4bcb-a6a9-495c19157212 admin admin] PATH_INFO: `/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/d3421cf1bbb24423a2f24c4667adfdda/roles/84142a61c6044699aebb0fc5df7f6922` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:38.810784 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae5a5c-c1c5-4bcb-a6a9-495c19157212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ae5e80b1f745dfaedd81a2c0ded718, user_id=d3421cf1bbb24423a2f24c4667adfdda, role_id=84142a61c6044699aebb0fc5df7f6922)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:38.813482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae5a5c-c1c5-4bcb-a6a9-495c19157212 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:38.828609 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 489/965] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:49:38 2021] PUT /identity/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/d3421cf1bbb24423a2f24c4667adfdda/roles/84142a61c6044699aebb0fc5df7f6922 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:49:39.249704 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141f007-e9fe-4e7b-a8b6-d6ec615f47e0 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:39.249958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141f007-e9fe-4e7b-a8b6-d6ec615f47e0 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:39.250264 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141f007-e9fe-4e7b-a8b6-d6ec615f47e0 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:39.252344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 477/966] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:39.258575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0da71-c7bf-463c-b439-030abc829279 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:39.258973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0da71-c7bf-463c-b439-030abc829279 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:39.259296 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0da71-c7bf-463c-b439-030abc829279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:39.278727 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-f6a0da71-c7bf-463c-b439-030abc829279 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:39.279967 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f6a0da71-c7bf-463c-b439-030abc829279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:39.338168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 490/967] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:39.363107 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141f007-e9fe-4e7b-a8b6-d6ec615f47e0 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:39.376799 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141f007-e9fe-4e7b-a8b6-d6ec615f47e0 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:39.381509 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d0169-e432-4e65-b5df-24e8d8e7a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:39.382298 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d0169-e432-4e65-b5df-24e8d8e7a632 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:39.382577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d0169-e432-4e65-b5df-24e8d8e7a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:39.382844 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d0169-e432-4e65-b5df-24e8d8e7a632 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:39.394457 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d0169-e432-4e65-b5df-24e8d8e7a632 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:39.401317 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-721d0169-e432-4e65-b5df-24e8d8e7a632 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:49:39.402478 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 478/968] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:49:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:39.409527 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0da71-c7bf-463c-b439-030abc829279 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:39.418881 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0da71-c7bf-463c-b439-030abc829279 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:39.424724 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f3c0b-0923-4e54-bc74-b5995d1bc61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:39.425387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f3c0b-0923-4e54-bc74-b5995d1bc61c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:39.425653 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f3c0b-0923-4e54-bc74-b5995d1bc61c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:39.425919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f3c0b-0923-4e54-bc74-b5995d1bc61c admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:39.426686 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f3c0b-0923-4e54-bc74-b5995d1bc61c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:39.426991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f3c0b-0923-4e54-bc74-b5995d1bc61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:39.428643 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f3c0b-0923-4e54-bc74-b5995d1bc61c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:39.437195 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 491/969] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:49:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:39.443686 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d0169-e432-4e65-b5df-24e8d8e7a632 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:39.455064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d0169-e432-4e65-b5df-24e8d8e7a632 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:39.460579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8486f0-ba99-4cfc-b454-4d908f8d8b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:39.461426 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8486f0-ba99-4cfc-b454-4d908f8d8b1a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:39.461676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8486f0-ba99-4cfc-b454-4d908f8d8b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:39.461975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8486f0-ba99-4cfc-b454-4d908f8d8b1a admin admin] PATH_INFO: `/v3/users/711ceb7878d34a498dd53277b0260373` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:39.476274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8486f0-ba99-4cfc-b454-4d908f8d8b1a admin admin] RBAC: Authorizing `identity:get_user(user_id=711ceb7878d34a498dd53277b0260373)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:39.478426 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8486f0-ba99-4cfc-b454-4d908f8d8b1a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:39.480283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 479/970] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:49:39 2021] GET /identity/v3/users/711ceb7878d34a498dd53277b0260373 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:39.486772 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f3c0b-0923-4e54-bc74-b5995d1bc61c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:39.496367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f3c0b-0923-4e54-bc74-b5995d1bc61c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:39.501013 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69c71f-2291-40e8-a4b8-a190e89e3f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:39.501588 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69c71f-2291-40e8-a4b8-a190e89e3f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:39.501868 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69c71f-2291-40e8-a4b8-a190e89e3f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:39.502143 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69c71f-2291-40e8-a4b8-a190e89e3f98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:39.509677 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69c71f-2291-40e8-a4b8-a190e89e3f98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:39.511464 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69c71f-2291-40e8-a4b8-a190e89e3f98 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:39.520423 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 492/971] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:39 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:49:39.526754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8486f0-ba99-4cfc-b454-4d908f8d8b1a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:39.536504 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8486f0-ba99-4cfc-b454-4d908f8d8b1a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:39.541052 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f794180-9b58-4fe7-9ce4-a9253869814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:39.541899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f794180-9b58-4fe7-9ce4-a9253869814f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:39.542180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f794180-9b58-4fe7-9ce4-a9253869814f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:39.542455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f794180-9b58-4fe7-9ce4-a9253869814f admin admin] PATH_INFO: `/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:39.543660 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f794180-9b58-4fe7-9ce4-a9253869814f admin admin] RBAC: Authorizing `identity:get_project(project_id=0ee8f38f26434b01aac0d2c0ca2ce960)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:39.545690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f794180-9b58-4fe7-9ce4-a9253869814f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:39.547398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 480/972] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:49:39 2021] GET /identity/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:39.554076 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69c71f-2291-40e8-a4b8-a190e89e3f98 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:39.562917 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69c71f-2291-40e8-a4b8-a190e89e3f98 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:39.567624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d898c5f-aaa3-458b-a412-1126fce810b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:39.568265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d898c5f-aaa3-458b-a412-1126fce810b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:39.568534 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d898c5f-aaa3-458b-a412-1126fce810b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:39.568802 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d898c5f-aaa3-458b-a412-1126fce810b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:39.569647 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d898c5f-aaa3-458b-a412-1126fce810b0 admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=0ee8f38f26434b01aac0d2c0ca2ce960, user.id=711ceb7878d34a498dd53277b0260373) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:39.569952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d898c5f-aaa3-458b-a412-1126fce810b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:39.571839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d898c5f-aaa3-458b-a412-1126fce810b0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:39.577291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 493/973] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:39 2021] GET /identity/v3/role_assignments?user.id=711ceb7878d34a498dd53277b0260373&scope.project.id=0ee8f38f26434b01aac0d2c0ca2ce960&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:41.091375 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972e3fd-e8b0-450d-bff3-065c6b961560 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.091933 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972e3fd-e8b0-450d-bff3-065c6b961560 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.091933 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972e3fd-e8b0-450d-bff3-065c6b961560 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.093704 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 481/974] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:41.099883 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75500ef2-a808-4684-96cc-fd18e414bc1b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.100304 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75500ef2-a808-4684-96cc-fd18e414bc1b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.100567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75500ef2-a808-4684-96cc-fd18e414bc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.119824 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-75500ef2-a808-4684-96cc-fd18e414bc1b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:41.121018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-75500ef2-a808-4684-96cc-fd18e414bc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:41.129748 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 494/975] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:41.154624 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972e3fd-e8b0-450d-bff3-065c6b961560 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:41.167694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972e3fd-e8b0-450d-bff3-065c6b961560 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:41.172518 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae8a92-1c81-4603-90ce-d08ac0b7341d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:41.173400 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae8a92-1c81-4603-90ce-d08ac0b7341d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.173735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae8a92-1c81-4603-90ce-d08ac0b7341d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.173955 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae8a92-1c81-4603-90ce-d08ac0b7341d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.184205 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae8a92-1c81-4603-90ce-d08ac0b7341d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:41.191477 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-1fae8a92-1c81-4603-90ce-d08ac0b7341d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 08 10:49:41.192628 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 482/976] 10.222.0.20 () {56 vars in 1141 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:41.199253 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75500ef2-a808-4684-96cc-fd18e414bc1b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:41.208648 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75500ef2-a808-4684-96cc-fd18e414bc1b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:41.213632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54fff7-b6d6-47ad-9621-031e2822bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:41.214377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54fff7-b6d6-47ad-9621-031e2822bbad admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.214725 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54fff7-b6d6-47ad-9621-031e2822bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.215065 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54fff7-b6d6-47ad-9621-031e2822bbad admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.215938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54fff7-b6d6-47ad-9621-031e2822bbad admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:41.216249 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54fff7-b6d6-47ad-9621-031e2822bbad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:41.217870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54fff7-b6d6-47ad-9621-031e2822bbad admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:41.226595 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 495/977] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:41.233243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae8a92-1c81-4603-90ce-d08ac0b7341d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:41.243545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae8a92-1c81-4603-90ce-d08ac0b7341d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:41.248237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818a106-b23a-4e2d-9103-1fdba1b5ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:41.249014 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818a106-b23a-4e2d-9103-1fdba1b5ed55 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.249298 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818a106-b23a-4e2d-9103-1fdba1b5ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.249575 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818a106-b23a-4e2d-9103-1fdba1b5ed55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.260046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818a106-b23a-4e2d-9103-1fdba1b5ed55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:41.261890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818a106-b23a-4e2d-9103-1fdba1b5ed55 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:41.279152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-e818a106-b23a-4e2d-9103-1fdba1b5ed55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:41.283347 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 483/978] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:41.286815 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54fff7-b6d6-47ad-9621-031e2822bbad admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:41.296799 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54fff7-b6d6-47ad-9621-031e2822bbad admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:41.302185 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c20b33-5b78-4c3b-b1df-eea9bef63561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:41.302839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20b33-5b78-4c3b-b1df-eea9bef63561 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.303153 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20b33-5b78-4c3b-b1df-eea9bef63561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.303423 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20b33-5b78-4c3b-b1df-eea9bef63561 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.304163 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c20b33-5b78-4c3b-b1df-eea9bef63561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:41.304468 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c20b33-5b78-4c3b-b1df-eea9bef63561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:41.306056 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c20b33-5b78-4c3b-b1df-eea9bef63561 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:41.318045 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 496/979] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:41.324464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818a106-b23a-4e2d-9103-1fdba1b5ed55 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:41.334530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818a106-b23a-4e2d-9103-1fdba1b5ed55 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:41.339482 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec704aed-e2a6-4997-b527-3a0c2cc4b249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:41.340268 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec704aed-e2a6-4997-b527-3a0c2cc4b249 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.340558 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec704aed-e2a6-4997-b527-3a0c2cc4b249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.340819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec704aed-e2a6-4997-b527-3a0c2cc4b249 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.348591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec704aed-e2a6-4997-b527-3a0c2cc4b249 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:41.350569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec704aed-e2a6-4997-b527-3a0c2cc4b249 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:41.364880 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-ec704aed-e2a6-4997-b527-3a0c2cc4b249 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 08 10:49:41.366041 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 484/980] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:41.372615 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c20b33-5b78-4c3b-b1df-eea9bef63561 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:41.383108 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c20b33-5b78-4c3b-b1df-eea9bef63561 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:41.388993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aa2b9-82cf-4296-a20d-7be0d2740d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:41.389658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa2b9-82cf-4296-a20d-7be0d2740d36 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.389940 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa2b9-82cf-4296-a20d-7be0d2740d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.390217 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aa2b9-82cf-4296-a20d-7be0d2740d36 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.391074 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aa2b9-82cf-4296-a20d-7be0d2740d36 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:41.391814 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aa2b9-82cf-4296-a20d-7be0d2740d36 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:41.393803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aa2b9-82cf-4296-a20d-7be0d2740d36 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:41.412127 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 497/981] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:41.418810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec704aed-e2a6-4997-b527-3a0c2cc4b249 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:41.429468 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec704aed-e2a6-4997-b527-3a0c2cc4b249 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:41.434494 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72390936-55cb-4940-acce-071f9043c795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:41.435171 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72390936-55cb-4940-acce-071f9043c795 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.435461 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72390936-55cb-4940-acce-071f9043c795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.435738 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72390936-55cb-4940-acce-071f9043c795 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.444072 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72390936-55cb-4940-acce-071f9043c795 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:41.445831 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72390936-55cb-4940-acce-071f9043c795 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:41.454986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 485/982] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:49:41.461449 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aa2b9-82cf-4296-a20d-7be0d2740d36 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:41.472004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aa2b9-82cf-4296-a20d-7be0d2740d36 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:41.477880 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d23e45-b462-4a0c-84b6-59ac5232430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:41.478687 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d23e45-b462-4a0c-84b6-59ac5232430e admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.478976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d23e45-b462-4a0c-84b6-59ac5232430e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.479365 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d23e45-b462-4a0c-84b6-59ac5232430e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.490543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d23e45-b462-4a0c-84b6-59ac5232430e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:41.492425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d23e45-b462-4a0c-84b6-59ac5232430e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:41.509870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-f5d23e45-b462-4a0c-84b6-59ac5232430e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:49:41.511056 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 498/983] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:41.517910 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72390936-55cb-4940-acce-071f9043c795 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:41.527145 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72390936-55cb-4940-acce-071f9043c795 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:41.532049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef55cf3-8854-40e2-9372-4d94adfc1a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:41.532825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef55cf3-8854-40e2-9372-4d94adfc1a4f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.533170 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef55cf3-8854-40e2-9372-4d94adfc1a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.533501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef55cf3-8854-40e2-9372-4d94adfc1a4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.534306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef55cf3-8854-40e2-9372-4d94adfc1a4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:41.534614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef55cf3-8854-40e2-9372-4d94adfc1a4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:41.536299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef55cf3-8854-40e2-9372-4d94adfc1a4f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:41.547790 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 486/984] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:41.554055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d23e45-b462-4a0c-84b6-59ac5232430e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:41.564260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d23e45-b462-4a0c-84b6-59ac5232430e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:41.569974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e3538-dba8-4661-ac3e-a394a89b56b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:41.570753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e3538-dba8-4661-ac3e-a394a89b56b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.571028 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e3538-dba8-4661-ac3e-a394a89b56b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.571345 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e3538-dba8-4661-ac3e-a394a89b56b4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.578843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e3538-dba8-4661-ac3e-a394a89b56b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:41.580981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e3538-dba8-4661-ac3e-a394a89b56b4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:41.594118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-633e3538-dba8-4661-ac3e-a394a89b56b4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:49:41.595350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 499/985] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:41.601865 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef55cf3-8854-40e2-9372-4d94adfc1a4f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:41.612213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef55cf3-8854-40e2-9372-4d94adfc1a4f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:41.617117 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e352e03-d228-463d-ba1e-ebe52e49c621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:41.617764 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e352e03-d228-463d-ba1e-ebe52e49c621 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.618040 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e352e03-d228-463d-ba1e-ebe52e49c621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.618310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e352e03-d228-463d-ba1e-ebe52e49c621 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.619086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e352e03-d228-463d-ba1e-ebe52e49c621 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:41.619422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e352e03-d228-463d-ba1e-ebe52e49c621 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:41.621259 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e352e03-d228-463d-ba1e-ebe52e49c621 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:41.633555 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 487/986] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:41.640242 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e3538-dba8-4661-ac3e-a394a89b56b4 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:41.651633 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e3538-dba8-4661-ac3e-a394a89b56b4 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:41.657309 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2d6b4-ce25-41d4-b108-872f8e9598c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:41.658074 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2d6b4-ce25-41d4-b108-872f8e9598c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.658354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2d6b4-ce25-41d4-b108-872f8e9598c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.658625 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2d6b4-ce25-41d4-b108-872f8e9598c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.659507 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2d6b4-ce25-41d4-b108-872f8e9598c8 admin admin] RBAC: Adding query filter params (role.id=84142a61c6044699aebb0fc5df7f6922, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=d3421cf1bbb24423a2f24c4667adfdda) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:41.659812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2d6b4-ce25-41d4-b108-872f8e9598c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:41.661664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2d6b4-ce25-41d4-b108-872f8e9598c8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:41.667841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 500/987] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/role_assignments?user.id=d3421cf1bbb24423a2f24c4667adfdda&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=84142a61c6044699aebb0fc5df7f6922 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:41.839971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6aa40d-645e-4a66-aad0-d6958e6cbed2 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.840235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6aa40d-645e-4a66-aad0-d6958e6cbed2 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.840543 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6aa40d-645e-4a66-aad0-d6958e6cbed2 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.842358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 488/988] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:41.849822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d49386-d1b5-4b13-9d27-86a668da056f None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.850117 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d49386-d1b5-4b13-9d27-86a668da056f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.850379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d49386-d1b5-4b13-9d27-86a668da056f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.870263 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-c0d49386-d1b5-4b13-9d27-86a668da056f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:41.871422 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c0d49386-d1b5-4b13-9d27-86a668da056f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:41.881866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 501/989] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:41.909734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6aa40d-645e-4a66-aad0-d6958e6cbed2 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:41.922890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6aa40d-645e-4a66-aad0-d6958e6cbed2 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:41.928057 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ca117-8b70-44a0-9f22-63822fefa910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:41.928844 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ca117-8b70-44a0-9f22-63822fefa910 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.929125 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ca117-8b70-44a0-9f22-63822fefa910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.929395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ca117-8b70-44a0-9f22-63822fefa910 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.940103 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ca117-8b70-44a0-9f22-63822fefa910 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:41.946790 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-502ca117-8b70-44a0-9f22-63822fefa910 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:49:41.948042 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 489/990] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:41.955340 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d49386-d1b5-4b13-9d27-86a668da056f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:41.964650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d49386-d1b5-4b13-9d27-86a668da056f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:41.970414 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045089e-7ca3-48bd-af05-0a012eea4b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:41.971080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045089e-7ca3-48bd-af05-0a012eea4b13 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:41.971594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045089e-7ca3-48bd-af05-0a012eea4b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:41.971857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045089e-7ca3-48bd-af05-0a012eea4b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:41.972387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045089e-7ca3-48bd-af05-0a012eea4b13 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:41.972689 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045089e-7ca3-48bd-af05-0a012eea4b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:41.974295 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045089e-7ca3-48bd-af05-0a012eea4b13 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:41.983328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 502/991] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:49:41.990526 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ca117-8b70-44a0-9f22-63822fefa910 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:42.001128 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ca117-8b70-44a0-9f22-63822fefa910 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:42.006153 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286f505-70f7-4ae3-ba01-99ca9979a3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:42.006996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286f505-70f7-4ae3-ba01-99ca9979a3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:42.007309 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286f505-70f7-4ae3-ba01-99ca9979a3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:42.007544 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286f505-70f7-4ae3-ba01-99ca9979a3c0 admin admin] PATH_INFO: `/v3/users/711ceb7878d34a498dd53277b0260373` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:42.008807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286f505-70f7-4ae3-ba01-99ca9979a3c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=711ceb7878d34a498dd53277b0260373)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:42.010930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286f505-70f7-4ae3-ba01-99ca9979a3c0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:42.012542 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 490/992] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:49:41 2021] GET /identity/v3/users/711ceb7878d34a498dd53277b0260373 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:42.019512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045089e-7ca3-48bd-af05-0a012eea4b13 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:42.029753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045089e-7ca3-48bd-af05-0a012eea4b13 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:42.034693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff27328-2705-4af8-9eee-8f7ea4e0c42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:42.035604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff27328-2705-4af8-9eee-8f7ea4e0c42f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:42.035924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff27328-2705-4af8-9eee-8f7ea4e0c42f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:42.036238 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff27328-2705-4af8-9eee-8f7ea4e0c42f admin admin] PATH_INFO: `/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:42.037465 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff27328-2705-4af8-9eee-8f7ea4e0c42f admin admin] RBAC: Authorizing `identity:get_project(project_id=0ee8f38f26434b01aac0d2c0ca2ce960)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:42.039568 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff27328-2705-4af8-9eee-8f7ea4e0c42f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:42.041276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 503/993] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:49:42 2021] GET /identity/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:42.048177 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286f505-70f7-4ae3-ba01-99ca9979a3c0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:42.061421 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286f505-70f7-4ae3-ba01-99ca9979a3c0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:42.067967 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062cce0-96c2-4458-833b-e410d98a1a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:42.068842 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062cce0-96c2-4458-833b-e410d98a1a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:42.069115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062cce0-96c2-4458-833b-e410d98a1a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:42.069384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062cce0-96c2-4458-833b-e410d98a1a18 admin admin] PATH_INFO: `/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960/users/711ceb7878d34a498dd53277b0260373/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:42.071599 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062cce0-96c2-4458-833b-e410d98a1a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee8f38f26434b01aac0d2c0ca2ce960, user_id=711ceb7878d34a498dd53277b0260373, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:42.074346 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062cce0-96c2-4458-833b-e410d98a1a18 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:42.094120 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 491/994] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:49:42 2021] PUT /identity/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960/users/711ceb7878d34a498dd53277b0260373/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:49:44.301174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6fa96-4147-44b4-a683-e51181414770 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:44.302029 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6fa96-4147-44b4-a683-e51181414770 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:44.302029 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6fa96-4147-44b4-a683-e51181414770 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:44.304926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 504/995] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:44 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:44.312105 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fd0c3-8228-40f7-983d-011ba6c1b8c7 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:44.312532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fd0c3-8228-40f7-983d-011ba6c1b8c7 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:44.312705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fd0c3-8228-40f7-983d-011ba6c1b8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:44.332138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-429fd0c3-8228-40f7-983d-011ba6c1b8c7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:44.333341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-429fd0c3-8228-40f7-983d-011ba6c1b8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:44.393729 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 492/996] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:44.430020 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6fa96-4147-44b4-a683-e51181414770 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:44.445161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6fa96-4147-44b4-a683-e51181414770 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:44.450130 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e06127-d55a-4c26-9670-bd571fb92f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:44.450928 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e06127-d55a-4c26-9670-bd571fb92f2b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:44.451239 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e06127-d55a-4c26-9670-bd571fb92f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:44.451515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e06127-d55a-4c26-9670-bd571fb92f2b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:44.462913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e06127-d55a-4c26-9670-bd571fb92f2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:49:44.469891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-a9e06127-d55a-4c26-9670-bd571fb92f2b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:49:44.471350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 505/997] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:49:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:49:44.478340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fd0c3-8228-40f7-983d-011ba6c1b8c7 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:44.487922 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fd0c3-8228-40f7-983d-011ba6c1b8c7 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:44.493582 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abfc72-1421-47bc-a92f-1d5abc9ff1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:44.494251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abfc72-1421-47bc-a92f-1d5abc9ff1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:44.494530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abfc72-1421-47bc-a92f-1d5abc9ff1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:44.494803 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abfc72-1421-47bc-a92f-1d5abc9ff1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:44.495616 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abfc72-1421-47bc-a92f-1d5abc9ff1c2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:44.495925 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abfc72-1421-47bc-a92f-1d5abc9ff1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:44.497532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abfc72-1421-47bc-a92f-1d5abc9ff1c2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:44.506947 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 493/998] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:49:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:44.513476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e06127-d55a-4c26-9670-bd571fb92f2b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:44.524508 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e06127-d55a-4c26-9670-bd571fb92f2b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:44.529444 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a57951-2ef2-4348-84ca-f849e0bf3f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:44.530289 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a57951-2ef2-4348-84ca-f849e0bf3f83 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:44.530575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a57951-2ef2-4348-84ca-f849e0bf3f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:44.530843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a57951-2ef2-4348-84ca-f849e0bf3f83 admin admin] PATH_INFO: `/v3/users/711ceb7878d34a498dd53277b0260373` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:44.532140 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a57951-2ef2-4348-84ca-f849e0bf3f83 admin admin] RBAC: Authorizing `identity:get_user(user_id=711ceb7878d34a498dd53277b0260373)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:44.534568 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a57951-2ef2-4348-84ca-f849e0bf3f83 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:44.536177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 506/999] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:49:44 2021] GET /identity/v3/users/711ceb7878d34a498dd53277b0260373 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:44.542860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abfc72-1421-47bc-a92f-1d5abc9ff1c2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:44.555109 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abfc72-1421-47bc-a92f-1d5abc9ff1c2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:44.560327 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf149d5b-73b3-4cf9-a767-5bf457d30c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:44.560949 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149d5b-73b3-4cf9-a767-5bf457d30c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:44.561228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149d5b-73b3-4cf9-a767-5bf457d30c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:44.561499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149d5b-73b3-4cf9-a767-5bf457d30c13 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:44.569193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf149d5b-73b3-4cf9-a767-5bf457d30c13 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:44.570938 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf149d5b-73b3-4cf9-a767-5bf457d30c13 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:44.579514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 494/1000] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:44 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:49:44.589861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a57951-2ef2-4348-84ca-f849e0bf3f83 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:44.605697 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a57951-2ef2-4348-84ca-f849e0bf3f83 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:44.613483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c9af3-73eb-45b8-8b16-0130569f8f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:44.614330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c9af3-73eb-45b8-8b16-0130569f8f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:44.614584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c9af3-73eb-45b8-8b16-0130569f8f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:44.614889 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c9af3-73eb-45b8-8b16-0130569f8f44 admin admin] PATH_INFO: `/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:44.616327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c9af3-73eb-45b8-8b16-0130569f8f44 admin admin] RBAC: Authorizing `identity:get_project(project_id=0ee8f38f26434b01aac0d2c0ca2ce960)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:44.618374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c9af3-73eb-45b8-8b16-0130569f8f44 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:44.620053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 507/1001] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:49:44 2021] GET /identity/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960 => generated 311 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:44.626771 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf149d5b-73b3-4cf9-a767-5bf457d30c13 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:44.641679 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf149d5b-73b3-4cf9-a767-5bf457d30c13 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:44.647251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3db2eb-616c-4a05-a33c-a305963a3552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:44.647870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db2eb-616c-4a05-a33c-a305963a3552 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:44.648151 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db2eb-616c-4a05-a33c-a305963a3552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:44.648425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db2eb-616c-4a05-a33c-a305963a3552 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:44.649263 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3db2eb-616c-4a05-a33c-a305963a3552 admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=0ee8f38f26434b01aac0d2c0ca2ce960, user.id=711ceb7878d34a498dd53277b0260373) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:44.649571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3db2eb-616c-4a05-a33c-a305963a3552 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:44.651399 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3db2eb-616c-4a05-a33c-a305963a3552 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:44.657538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 495/1002] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:44 2021] GET /identity/v3/role_assignments?user.id=711ceb7878d34a498dd53277b0260373&scope.project.id=0ee8f38f26434b01aac0d2c0ca2ce960&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:46.914422 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc480439-7726-4956-9ebc-5d977a451df2 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:46.914955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc480439-7726-4956-9ebc-5d977a451df2 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:46.914955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc480439-7726-4956-9ebc-5d977a451df2 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:46.916715 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 508/1003] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:46.924464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cf332-6cae-43c8-8fcc-c2dffefc41b6 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:46.925217 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cf332-6cae-43c8-8fcc-c2dffefc41b6 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:46.925390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cf332-6cae-43c8-8fcc-c2dffefc41b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:46.954184 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-384cf332-6cae-43c8-8fcc-c2dffefc41b6 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:46.955720 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-384cf332-6cae-43c8-8fcc-c2dffefc41b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:46.964435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 496/1004] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:46 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:46.990233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc480439-7726-4956-9ebc-5d977a451df2 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:47.003018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc480439-7726-4956-9ebc-5d977a451df2 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:47.007939 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22808e05-a926-4320-a46e-643610f729e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:47.008711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22808e05-a926-4320-a46e-643610f729e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:47.008990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22808e05-a926-4320-a46e-643610f729e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:47.009265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22808e05-a926-4320-a46e-643610f729e9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:47.010438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22808e05-a926-4320-a46e-643610f729e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:47.012155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22808e05-a926-4320-a46e-643610f729e9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:47.013703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 509/1005] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:47.021938 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cf332-6cae-43c8-8fcc-c2dffefc41b6 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:47.036419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cf332-6cae-43c8-8fcc-c2dffefc41b6 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:47.045472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7460f-b81c-4796-ac49-61d4baccf316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:47.046405 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7460f-b81c-4796-ac49-61d4baccf316 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:47.046761 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7460f-b81c-4796-ac49-61d4baccf316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:47.047094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7460f-b81c-4796-ac49-61d4baccf316 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:47.048672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7460f-b81c-4796-ac49-61d4baccf316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:47.050592 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7460f-b81c-4796-ac49-61d4baccf316 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:47.071630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 497/1006] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Nov 8 10:49:47 2021] POST /identity/v3/users => generated 286 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:49:49.402120 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eead80-f95a-4fc4-bc19-8d6bc4c39770 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:49.402976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eead80-f95a-4fc4-bc19-8d6bc4c39770 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:49.402976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eead80-f95a-4fc4-bc19-8d6bc4c39770 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:49.405855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 510/1007] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:49.413194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565211a-2cb2-41f3-8aed-a862f0ca4b5c None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:49.413927 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565211a-2cb2-41f3-8aed-a862f0ca4b5c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:49.414077 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565211a-2cb2-41f3-8aed-a862f0ca4b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:49.442555 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-b565211a-2cb2-41f3-8aed-a862f0ca4b5c None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:49.443785 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b565211a-2cb2-41f3-8aed-a862f0ca4b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:49.453611 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 498/1008] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:49 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:49.484363 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eead80-f95a-4fc4-bc19-8d6bc4c39770 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:49.498246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eead80-f95a-4fc4-bc19-8d6bc4c39770 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:49.503366 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b8c35-49cc-46f0-8084-415467fab4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:49.504287 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b8c35-49cc-46f0-8084-415467fab4cb admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:49.504563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b8c35-49cc-46f0-8084-415467fab4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:49.504843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b8c35-49cc-46f0-8084-415467fab4cb admin admin] PATH_INFO: `/v3/roles/a4a3a42f23b2463ebc5e198fe56ac656` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:49.506440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b8c35-49cc-46f0-8084-415467fab4cb admin admin] RBAC: Authorizing `identity:get_role(role_id=a4a3a42f23b2463ebc5e198fe56ac656)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:49.507924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-d02b8c35-49cc-46f0-8084-415467fab4cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:49:49.507924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:49:49.507924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:49:49.509565 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b8c35-49cc-46f0-8084-415467fab4cb admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:49.510994 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 511/1009] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:49:49 2021] GET /identity/v3/roles/a4a3a42f23b2463ebc5e198fe56ac656 => generated 223 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:49.523954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565211a-2cb2-41f3-8aed-a862f0ca4b5c None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:49.539522 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565211a-2cb2-41f3-8aed-a862f0ca4b5c None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:49.548640 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401de3e6-c8a4-43b0-ab71-c51410636b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:49.550114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401de3e6-c8a4-43b0-ab71-c51410636b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:49.550548 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401de3e6-c8a4-43b0-ab71-c51410636b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:49.550984 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401de3e6-c8a4-43b0-ab71-c51410636b23 admin admin] PATH_INFO: `/v3/users/12fb780c522340ff8063cd3aef396c7d` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:49.571379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401de3e6-c8a4-43b0-ab71-c51410636b23 admin admin] RBAC: Authorizing `identity:get_user(user_id=12fb780c522340ff8063cd3aef396c7d)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:49.573527 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401de3e6-c8a4-43b0-ab71-c51410636b23 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:49.575146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 499/1010] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:49:49 2021] GET /identity/v3/users/12fb780c522340ff8063cd3aef396c7d => generated 286 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:49.581813 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b8c35-49cc-46f0-8084-415467fab4cb admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:49.591766 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b8c35-49cc-46f0-8084-415467fab4cb admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:49.597711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a9751-09fb-492d-b3a2-e0b8926d647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:49.598352 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a9751-09fb-492d-b3a2-e0b8926d647e admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:49.598630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a9751-09fb-492d-b3a2-e0b8926d647e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:49.598898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a9751-09fb-492d-b3a2-e0b8926d647e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:49.606956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a9751-09fb-492d-b3a2-e0b8926d647e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:49.608760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a9751-09fb-492d-b3a2-e0b8926d647e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:49.618403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 512/1011] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:49 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:49:49.628323 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401de3e6-c8a4-43b0-ab71-c51410636b23 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:49.639081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401de3e6-c8a4-43b0-ab71-c51410636b23 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:49.645455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa8668-78a2-4d40-a1a0-005c533c06e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:49.646290 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa8668-78a2-4d40-a1a0-005c533c06e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:49.646580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa8668-78a2-4d40-a1a0-005c533c06e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:49.646855 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa8668-78a2-4d40-a1a0-005c533c06e7 admin admin] PATH_INFO: `/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:49.648142 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa8668-78a2-4d40-a1a0-005c533c06e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=0ee8f38f26434b01aac0d2c0ca2ce960)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:49.650183 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa8668-78a2-4d40-a1a0-005c533c06e7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:49.651848 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 500/1012] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:49:49 2021] GET /identity/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:49.658667 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a9751-09fb-492d-b3a2-e0b8926d647e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:49.667617 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a9751-09fb-492d-b3a2-e0b8926d647e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:49.673363 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b1b67-6b50-4ab2-8571-36fb4a62493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:49.674018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b1b67-6b50-4ab2-8571-36fb4a62493c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:49.674384 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b1b67-6b50-4ab2-8571-36fb4a62493c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:49.674654 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b1b67-6b50-4ab2-8571-36fb4a62493c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:49.675521 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b1b67-6b50-4ab2-8571-36fb4a62493c admin admin] RBAC: Adding query filter params (role.id=a4a3a42f23b2463ebc5e198fe56ac656, scope.project.id=0ee8f38f26434b01aac0d2c0ca2ce960, user.id=12fb780c522340ff8063cd3aef396c7d) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:49.675828 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b1b67-6b50-4ab2-8571-36fb4a62493c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:49.677617 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b1b67-6b50-4ab2-8571-36fb4a62493c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:49.683236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 513/1013] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:49 2021] GET /identity/v3/role_assignments?user.id=12fb780c522340ff8063cd3aef396c7d&scope.project.id=0ee8f38f26434b01aac0d2c0ca2ce960&role.id=a4a3a42f23b2463ebc5e198fe56ac656 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:51.898651 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc721ac-3fc6-4bb8-a76c-f421169168a5 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:51.899520 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc721ac-3fc6-4bb8-a76c-f421169168a5 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:51.899520 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc721ac-3fc6-4bb8-a76c-f421169168a5 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:51.902372 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 501/1014] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:51 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:51.908615 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f12f1-1647-4aca-9f60-7ba9b11e4a38 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:51.909060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f12f1-1647-4aca-9f60-7ba9b11e4a38 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:51.909172 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f12f1-1647-4aca-9f60-7ba9b11e4a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:51.927483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-bc2f12f1-1647-4aca-9f60-7ba9b11e4a38 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:51.928654 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-bc2f12f1-1647-4aca-9f60-7ba9b11e4a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:51.937528 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 514/1015] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:51 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:51.961825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc721ac-3fc6-4bb8-a76c-f421169168a5 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:51.979893 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc721ac-3fc6-4bb8-a76c-f421169168a5 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:51.986051 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bc672-0871-489e-9492-787067599527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:51.986912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bc672-0871-489e-9492-787067599527 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:51.987225 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bc672-0871-489e-9492-787067599527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:51.987507 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bc672-0871-489e-9492-787067599527 admin admin] PATH_INFO: `/v3/roles/a4a3a42f23b2463ebc5e198fe56ac656` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:51.989073 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bc672-0871-489e-9492-787067599527 admin admin] RBAC: Authorizing `identity:get_role(role_id=a4a3a42f23b2463ebc5e198fe56ac656)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:51.990099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-179bc672-0871-489e-9492-787067599527 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:49:51.990099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:49:51.990099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:49:51.990971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bc672-0871-489e-9492-787067599527 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:51.992314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 502/1016] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:49:51 2021] GET /identity/v3/roles/a4a3a42f23b2463ebc5e198fe56ac656 => generated 223 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:52.001700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f12f1-1647-4aca-9f60-7ba9b11e4a38 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:52.016624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f12f1-1647-4aca-9f60-7ba9b11e4a38 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:52.022759 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b42fe-7557-4f3a-9c21-484eb49e9f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:52.023645 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b42fe-7557-4f3a-9c21-484eb49e9f42 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:52.023922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b42fe-7557-4f3a-9c21-484eb49e9f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:52.024185 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b42fe-7557-4f3a-9c21-484eb49e9f42 admin admin] PATH_INFO: `/v3/users/12fb780c522340ff8063cd3aef396c7d` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:52.025523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b42fe-7557-4f3a-9c21-484eb49e9f42 admin admin] RBAC: Authorizing `identity:get_user(user_id=12fb780c522340ff8063cd3aef396c7d)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:52.027682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b42fe-7557-4f3a-9c21-484eb49e9f42 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:52.029246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 515/1017] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:49:52 2021] GET /identity/v3/users/12fb780c522340ff8063cd3aef396c7d => generated 286 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:52.035661 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bc672-0871-489e-9492-787067599527 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:52.046269 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bc672-0871-489e-9492-787067599527 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:52.052400 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47ff4a-8016-4bff-8bac-b7e22af1d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:52.053209 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47ff4a-8016-4bff-8bac-b7e22af1d1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:52.053493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47ff4a-8016-4bff-8bac-b7e22af1d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:52.053770 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47ff4a-8016-4bff-8bac-b7e22af1d1d8 admin admin] PATH_INFO: `/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:52.055058 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47ff4a-8016-4bff-8bac-b7e22af1d1d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=0ee8f38f26434b01aac0d2c0ca2ce960)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:52.057119 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47ff4a-8016-4bff-8bac-b7e22af1d1d8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:52.058722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 503/1018] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:49:52 2021] GET /identity/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:52.065000 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b42fe-7557-4f3a-9c21-484eb49e9f42 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:52.074894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b42fe-7557-4f3a-9c21-484eb49e9f42 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:52.080775 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69433c97-2d3d-4280-af64-5947c763639e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:52.081735 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69433c97-2d3d-4280-af64-5947c763639e admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:52.081971 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69433c97-2d3d-4280-af64-5947c763639e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:52.082266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69433c97-2d3d-4280-af64-5947c763639e admin admin] PATH_INFO: `/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960/users/12fb780c522340ff8063cd3aef396c7d/roles/a4a3a42f23b2463ebc5e198fe56ac656` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:52.084804 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69433c97-2d3d-4280-af64-5947c763639e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee8f38f26434b01aac0d2c0ca2ce960, user_id=12fb780c522340ff8063cd3aef396c7d, role_id=a4a3a42f23b2463ebc5e198fe56ac656)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:52.087412 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69433c97-2d3d-4280-af64-5947c763639e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:52.106364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 516/1019] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:49:52 2021] PUT /identity/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960/users/12fb780c522340ff8063cd3aef396c7d/roles/a4a3a42f23b2463ebc5e198fe56ac656 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:49:54.330193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bceab-a877-4497-9145-31813bbd43f7 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:54.331227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bceab-a877-4497-9145-31813bbd43f7 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:54.331227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bceab-a877-4497-9145-31813bbd43f7 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:54.333992 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 504/1020] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:54 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:54.343923 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517f093-59c9-4b41-a838-3331cebf712d None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:54.344357 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517f093-59c9-4b41-a838-3331cebf712d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:54.344495 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517f093-59c9-4b41-a838-3331cebf712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:54.369569 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-2517f093-59c9-4b41-a838-3331cebf712d None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:54.370772 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-2517f093-59c9-4b41-a838-3331cebf712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:54.429940 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 517/1021] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:54 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:54.464651 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bceab-a877-4497-9145-31813bbd43f7 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:54.483238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bceab-a877-4497-9145-31813bbd43f7 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:54.489437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9cc5-84ca-4cf8-b2d6-5a6fd8d2e9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:54.490286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9cc5-84ca-4cf8-b2d6-5a6fd8d2e9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:54.490571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9cc5-84ca-4cf8-b2d6-5a6fd8d2e9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:54.490845 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9cc5-84ca-4cf8-b2d6-5a6fd8d2e9d3 admin admin] PATH_INFO: `/v3/roles/a4a3a42f23b2463ebc5e198fe56ac656` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:54.492376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f9cc5-84ca-4cf8-b2d6-5a6fd8d2e9d3 admin admin] RBAC: Authorizing `identity:get_role(role_id=a4a3a42f23b2463ebc5e198fe56ac656)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:54.493975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f9cc5-84ca-4cf8-b2d6-5a6fd8d2e9d3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:54.495334 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 505/1022] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:49:54 2021] GET /identity/v3/roles/a4a3a42f23b2463ebc5e198fe56ac656 => generated 223 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:54.502045 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517f093-59c9-4b41-a838-3331cebf712d None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:54.511304 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517f093-59c9-4b41-a838-3331cebf712d None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:54.516255 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d9356-0e53-445a-8bbf-3857234ff329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:54.517542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d9356-0e53-445a-8bbf-3857234ff329 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:54.517810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d9356-0e53-445a-8bbf-3857234ff329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:54.518078 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d9356-0e53-445a-8bbf-3857234ff329 admin admin] PATH_INFO: `/v3/users/12fb780c522340ff8063cd3aef396c7d` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:54.519400 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d9356-0e53-445a-8bbf-3857234ff329 admin admin] RBAC: Authorizing `identity:get_user(user_id=12fb780c522340ff8063cd3aef396c7d)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:54.521740 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d9356-0e53-445a-8bbf-3857234ff329 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:54.523413 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 518/1023] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:49:54 2021] GET /identity/v3/users/12fb780c522340ff8063cd3aef396c7d => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:54.533989 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9cc5-84ca-4cf8-b2d6-5a6fd8d2e9d3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:54.544553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9cc5-84ca-4cf8-b2d6-5a6fd8d2e9d3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:54.549958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da2d1a-a345-43b3-b6ca-72ce3441a24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:54.550563 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da2d1a-a345-43b3-b6ca-72ce3441a24a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:54.550844 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da2d1a-a345-43b3-b6ca-72ce3441a24a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:54.551109 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da2d1a-a345-43b3-b6ca-72ce3441a24a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:54.559350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da2d1a-a345-43b3-b6ca-72ce3441a24a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:54.561094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da2d1a-a345-43b3-b6ca-72ce3441a24a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:54.571069 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 506/1024] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:49:54 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:49:54.577378 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d9356-0e53-445a-8bbf-3857234ff329 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:54.587661 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d9356-0e53-445a-8bbf-3857234ff329 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:54.592845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f388ae-81c9-46cd-a3b4-0d052a990f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:54.593653 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f388ae-81c9-46cd-a3b4-0d052a990f8e admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:54.593927 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f388ae-81c9-46cd-a3b4-0d052a990f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:54.594205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f388ae-81c9-46cd-a3b4-0d052a990f8e admin admin] PATH_INFO: `/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:54.595658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f388ae-81c9-46cd-a3b4-0d052a990f8e admin admin] RBAC: Authorizing `identity:get_project(project_id=0ee8f38f26434b01aac0d2c0ca2ce960)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:54.598547 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f388ae-81c9-46cd-a3b4-0d052a990f8e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:54.601190 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 519/1025] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:49:54 2021] GET /identity/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:54.609374 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da2d1a-a345-43b3-b6ca-72ce3441a24a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:54.623097 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da2d1a-a345-43b3-b6ca-72ce3441a24a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:54.628793 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0d288-368a-4d11-8b9e-c5c80b0f7ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:54.629433 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0d288-368a-4d11-8b9e-c5c80b0f7ace admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:54.629718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0d288-368a-4d11-8b9e-c5c80b0f7ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:54.629984 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0d288-368a-4d11-8b9e-c5c80b0f7ace admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:54.630856 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0d288-368a-4d11-8b9e-c5c80b0f7ace admin admin] RBAC: Adding query filter params (role.id=a4a3a42f23b2463ebc5e198fe56ac656, scope.project.id=0ee8f38f26434b01aac0d2c0ca2ce960, user.id=12fb780c522340ff8063cd3aef396c7d) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:49:54.631157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0d288-368a-4d11-8b9e-c5c80b0f7ace admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:54.633045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0d288-368a-4d11-8b9e-c5c80b0f7ace admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:54.639470 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 507/1026] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:49:54 2021] GET /identity/v3/role_assignments?user.id=12fb780c522340ff8063cd3aef396c7d&scope.project.id=0ee8f38f26434b01aac0d2c0ca2ce960&role.id=a4a3a42f23b2463ebc5e198fe56ac656 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:56.870253 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be503a-f523-4ed8-a884-cffe29d2086a None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:56.871091 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be503a-f523-4ed8-a884-cffe29d2086a None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:56.871091 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be503a-f523-4ed8-a884-cffe29d2086a None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:56.873866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 520/1027] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:56 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:56.881103 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc1c4d-3622-4402-a9e3-39eb714c6048 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:56.881511 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc1c4d-3622-4402-a9e3-39eb714c6048 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:56.881651 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc1c4d-3622-4402-a9e3-39eb714c6048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:56.900803 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-bacc1c4d-3622-4402-a9e3-39eb714c6048 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:56.902017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-bacc1c4d-3622-4402-a9e3-39eb714c6048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:56.911530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 508/1028] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:49:56.936144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be503a-f523-4ed8-a884-cffe29d2086a None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:56.952503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be503a-f523-4ed8-a884-cffe29d2086a None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:56.958588 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d8ac1-5511-4476-9d7d-583b9c9091af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:56.959414 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d8ac1-5511-4476-9d7d-583b9c9091af admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:56.959695 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d8ac1-5511-4476-9d7d-583b9c9091af admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:56.959973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d8ac1-5511-4476-9d7d-583b9c9091af admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:56.961285 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d8ac1-5511-4476-9d7d-583b9c9091af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:56.962983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d8ac1-5511-4476-9d7d-583b9c9091af admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:56.964590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 521/1029] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:56.972850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc1c4d-3622-4402-a9e3-39eb714c6048 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:56.986765 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc1c4d-3622-4402-a9e3-39eb714c6048 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:56.994568 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51723738-f676-41f6-8f53-eebe31ab1a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:56.995646 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51723738-f676-41f6-8f53-eebe31ab1a54 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:56.996054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51723738-f676-41f6-8f53-eebe31ab1a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:56.996450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51723738-f676-41f6-8f53-eebe31ab1a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:56.997631 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51723738-f676-41f6-8f53-eebe31ab1a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:57.000707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51723738-f676-41f6-8f53-eebe31ab1a54 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:57.028388 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 509/1030] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Nov 8 10:49:56 2021] POST /identity/v3/projects => generated 311 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 10:49:59.304862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52779693-fefd-43d5-870e-b5cff4188438 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:59.305754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52779693-fefd-43d5-870e-b5cff4188438 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:59.305754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52779693-fefd-43d5-870e-b5cff4188438 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:59.308624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 522/1031] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:49:59 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:49:59.315316 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be6ed-0f33-46ca-9aa9-af9cf7f4c8e5 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:59.315757 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be6ed-0f33-46ca-9aa9-af9cf7f4c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:59.315854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be6ed-0f33-46ca-9aa9-af9cf7f4c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:59.334739 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-ab8be6ed-0f33-46ca-9aa9-af9cf7f4c8e5 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:49:59.336037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-ab8be6ed-0f33-46ca-9aa9-af9cf7f4c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:49:59.393609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 510/1032] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:49:59 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:49:59.420896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52779693-fefd-43d5-870e-b5cff4188438 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:59.441246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52779693-fefd-43d5-870e-b5cff4188438 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:59.446897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7750a-214d-42af-8799-7e2c6fa67e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:59.447708 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7750a-214d-42af-8799-7e2c6fa67e0b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:59.447993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7750a-214d-42af-8799-7e2c6fa67e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:59.448263 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7750a-214d-42af-8799-7e2c6fa67e0b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:59.449523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7750a-214d-42af-8799-7e2c6fa67e0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:59.451236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7750a-214d-42af-8799-7e2c6fa67e0b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:59.452808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 523/1033] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:49:59 2021] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:49:59.459698 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8be6ed-0f33-46ca-9aa9-af9cf7f4c8e5 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:49:59.470626 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8be6ed-0f33-46ca-9aa9-af9cf7f4c8e5 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:49:59.475632 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ef7d9-b487-412c-b103-45492fef9ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:49:59.476308 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ef7d9-b487-412c-b103-45492fef9ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:49:59.476587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ef7d9-b487-412c-b103-45492fef9ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:49:59.476857 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ef7d9-b487-412c-b103-45492fef9ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:49:59.477609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ef7d9-b487-412c-b103-45492fef9ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:49:59.479623 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ef7d9-b487-412c-b103-45492fef9ff5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:49:59.502465 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 511/1034] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Nov 8 10:49:59 2021] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:50:01.773795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5b312-0258-4108-9c12-cc7230925b0c None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:01.774335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5b312-0258-4108-9c12-cc7230925b0c None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:01.774335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5b312-0258-4108-9c12-cc7230925b0c None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:01.776098 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 524/1035] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:50:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:50:01.783283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fc1fb-ceec-42d4-88a7-daea19d88c50 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:01.783980 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fc1fb-ceec-42d4-88a7-daea19d88c50 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:01.784146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fc1fb-ceec-42d4-88a7-daea19d88c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:01.807079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-675fc1fb-ceec-42d4-88a7-daea19d88c50 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:50:01.808305 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-675fc1fb-ceec-42d4-88a7-daea19d88c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:50:01.816936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 512/1036] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:50:01 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:50:01.841875 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5b312-0258-4108-9c12-cc7230925b0c None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:01.863158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5b312-0258-4108-9c12-cc7230925b0c None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:01.869653 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4efe0-90b3-43f0-987f-1ea54572ff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:01.870426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4efe0-90b3-43f0-987f-1ea54572ff07 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:01.870704 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4efe0-90b3-43f0-987f-1ea54572ff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:01.871002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4efe0-90b3-43f0-987f-1ea54572ff07 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:01.881866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4efe0-90b3-43f0-987f-1ea54572ff07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:50:01.888570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-1fe4efe0-90b3-43f0-987f-1ea54572ff07 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:50:01.889729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 525/1037] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:50:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:50:01.896782 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fc1fb-ceec-42d4-88a7-daea19d88c50 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:01.905718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fc1fb-ceec-42d4-88a7-daea19d88c50 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:01.911603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f028bb-6111-4cbe-8ffd-7ebcd2f02a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:01.912252 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f028bb-6111-4cbe-8ffd-7ebcd2f02a10 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:01.912528 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f028bb-6111-4cbe-8ffd-7ebcd2f02a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:01.912806 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f028bb-6111-4cbe-8ffd-7ebcd2f02a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:01.913564 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f028bb-6111-4cbe-8ffd-7ebcd2f02a10 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:50:01.913872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f028bb-6111-4cbe-8ffd-7ebcd2f02a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:01.915599 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f028bb-6111-4cbe-8ffd-7ebcd2f02a10 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:01.924383 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 513/1038] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:50:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:01.931548 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4efe0-90b3-43f0-987f-1ea54572ff07 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:01.948781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4efe0-90b3-43f0-987f-1ea54572ff07 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:01.957019 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b473e7c-f407-4d32-9ab3-245469ef2643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:01.957859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473e7c-f407-4d32-9ab3-245469ef2643 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:01.958137 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473e7c-f407-4d32-9ab3-245469ef2643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:01.958370 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473e7c-f407-4d32-9ab3-245469ef2643 admin admin] PATH_INFO: `/v3/users/8b8731bc9d504a409370371bfc53324c` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:01.974493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b473e7c-f407-4d32-9ab3-245469ef2643 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b8731bc9d504a409370371bfc53324c)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:01.976663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b473e7c-f407-4d32-9ab3-245469ef2643 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:01.978266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 526/1039] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:50:01 2021] GET /identity/v3/users/8b8731bc9d504a409370371bfc53324c => generated 286 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:01.987693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f028bb-6111-4cbe-8ffd-7ebcd2f02a10 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:01.997950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f028bb-6111-4cbe-8ffd-7ebcd2f02a10 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:02.004438 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006d91-8131-4665-80c3-3239c11ada30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:02.005072 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006d91-8131-4665-80c3-3239c11ada30 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:02.005355 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006d91-8131-4665-80c3-3239c11ada30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:02.005630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006d91-8131-4665-80c3-3239c11ada30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:02.013973 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed006d91-8131-4665-80c3-3239c11ada30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:02.015817 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed006d91-8131-4665-80c3-3239c11ada30 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:02.025305 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 514/1040] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:50:01 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:50:02.032170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b473e7c-f407-4d32-9ab3-245469ef2643 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:02.048855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b473e7c-f407-4d32-9ab3-245469ef2643 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:02.054701 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21615d0-4d92-4da9-9db0-1caab023008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:02.055587 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21615d0-4d92-4da9-9db0-1caab023008d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:02.055867 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21615d0-4d92-4da9-9db0-1caab023008d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:02.056141 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21615d0-4d92-4da9-9db0-1caab023008d admin admin] PATH_INFO: `/v3/projects/b234799dbdd24ab6a455ff56e4aa2a72` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:02.057630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21615d0-4d92-4da9-9db0-1caab023008d admin admin] RBAC: Authorizing `identity:get_project(project_id=b234799dbdd24ab6a455ff56e4aa2a72)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:02.059699 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21615d0-4d92-4da9-9db0-1caab023008d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:02.061362 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 527/1041] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:50:02 2021] GET /identity/v3/projects/b234799dbdd24ab6a455ff56e4aa2a72 => generated 311 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:02.070098 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006d91-8131-4665-80c3-3239c11ada30 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:02.081481 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006d91-8131-4665-80c3-3239c11ada30 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:02.088171 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb9cdd-1f8f-463a-b97b-991a8ba7e862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:02.088808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb9cdd-1f8f-463a-b97b-991a8ba7e862 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:02.089087 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb9cdd-1f8f-463a-b97b-991a8ba7e862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:02.089359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb9cdd-1f8f-463a-b97b-991a8ba7e862 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:02.090199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb9cdd-1f8f-463a-b97b-991a8ba7e862 admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=b234799dbdd24ab6a455ff56e4aa2a72, user.id=8b8731bc9d504a409370371bfc53324c) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:50:02.090518 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb9cdd-1f8f-463a-b97b-991a8ba7e862 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:02.092390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb9cdd-1f8f-463a-b97b-991a8ba7e862 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:02.098182 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 515/1042] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:50:02 2021] GET /identity/v3/role_assignments?user.id=8b8731bc9d504a409370371bfc53324c&scope.project.id=b234799dbdd24ab6a455ff56e4aa2a72&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:04.294352 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd13af-00ea-46dc-a58f-0af004819988 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:04.295274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd13af-00ea-46dc-a58f-0af004819988 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:04.295274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd13af-00ea-46dc-a58f-0af004819988 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:04.298555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 528/1043] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:50:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:50:04.305752 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f382a-a93f-46ff-b2a6-1fb1fc927ba6 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:04.306163 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f382a-a93f-46ff-b2a6-1fb1fc927ba6 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:04.306362 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f382a-a93f-46ff-b2a6-1fb1fc927ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:04.333869 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-4e2f382a-a93f-46ff-b2a6-1fb1fc927ba6 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:50:04.335060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-4e2f382a-a93f-46ff-b2a6-1fb1fc927ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:50:04.347727 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 516/1044] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:50:04 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:50:04.372882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd13af-00ea-46dc-a58f-0af004819988 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:04.388698 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd13af-00ea-46dc-a58f-0af004819988 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:04.395266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f8987-db59-4327-9255-a77ecaef9440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:04.396060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f8987-db59-4327-9255-a77ecaef9440 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:04.396342 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f8987-db59-4327-9255-a77ecaef9440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:04.396584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f8987-db59-4327-9255-a77ecaef9440 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:04.407080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f8987-db59-4327-9255-a77ecaef9440 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:50:04.414082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-1c8f8987-db59-4327-9255-a77ecaef9440 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:50:04.415251 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 529/1045] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:50:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:50:04.422265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f382a-a93f-46ff-b2a6-1fb1fc927ba6 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:04.431767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f382a-a93f-46ff-b2a6-1fb1fc927ba6 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:04.437477 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36596a-89d8-488f-b406-e72442c0dc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:04.438133 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36596a-89d8-488f-b406-e72442c0dc5a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:04.438421 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36596a-89d8-488f-b406-e72442c0dc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:04.438770 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36596a-89d8-488f-b406-e72442c0dc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:04.439924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36596a-89d8-488f-b406-e72442c0dc5a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:50:04.440237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36596a-89d8-488f-b406-e72442c0dc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:04.441849 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36596a-89d8-488f-b406-e72442c0dc5a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:04.450181 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 517/1046] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:50:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:50:04.460260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f8987-db59-4327-9255-a77ecaef9440 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:04.474354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f8987-db59-4327-9255-a77ecaef9440 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:04.480252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083275a7-8922-4b0a-b0ed-821528bf3674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:04.481121 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083275a7-8922-4b0a-b0ed-821528bf3674 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:04.481406 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083275a7-8922-4b0a-b0ed-821528bf3674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:04.481677 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083275a7-8922-4b0a-b0ed-821528bf3674 admin admin] PATH_INFO: `/v3/users/8b8731bc9d504a409370371bfc53324c` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:04.483036 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083275a7-8922-4b0a-b0ed-821528bf3674 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b8731bc9d504a409370371bfc53324c)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:04.485233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083275a7-8922-4b0a-b0ed-821528bf3674 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:04.486849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 530/1047] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:50:04 2021] GET /identity/v3/users/8b8731bc9d504a409370371bfc53324c => generated 286 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:04.493452 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36596a-89d8-488f-b406-e72442c0dc5a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:04.503917 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36596a-89d8-488f-b406-e72442c0dc5a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:04.509643 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a326fe-7495-4f3a-818b-cd80d61287f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:04.510491 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a326fe-7495-4f3a-818b-cd80d61287f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:04.510771 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a326fe-7495-4f3a-818b-cd80d61287f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:04.511040 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a326fe-7495-4f3a-818b-cd80d61287f5 admin admin] PATH_INFO: `/v3/projects/b234799dbdd24ab6a455ff56e4aa2a72` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:04.512408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a326fe-7495-4f3a-818b-cd80d61287f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=b234799dbdd24ab6a455ff56e4aa2a72)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:04.514470 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a326fe-7495-4f3a-818b-cd80d61287f5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:04.516130 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 518/1048] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:50:04 2021] GET /identity/v3/projects/b234799dbdd24ab6a455ff56e4aa2a72 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:04.522717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083275a7-8922-4b0a-b0ed-821528bf3674 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:04.532931 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083275a7-8922-4b0a-b0ed-821528bf3674 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:04.539038 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615acbaa-086a-43d5-be0b-ee3993ba452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:04.539932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615acbaa-086a-43d5-be0b-ee3993ba452c admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:04.540215 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615acbaa-086a-43d5-be0b-ee3993ba452c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:04.540487 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615acbaa-086a-43d5-be0b-ee3993ba452c admin admin] PATH_INFO: `/v3/projects/b234799dbdd24ab6a455ff56e4aa2a72/users/8b8731bc9d504a409370371bfc53324c/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:04.542907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615acbaa-086a-43d5-be0b-ee3993ba452c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b234799dbdd24ab6a455ff56e4aa2a72, user_id=8b8731bc9d504a409370371bfc53324c, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:04.545612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615acbaa-086a-43d5-be0b-ee3993ba452c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:04.564913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 531/1049] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:50:04 2021] PUT /identity/v3/projects/b234799dbdd24ab6a455ff56e4aa2a72/users/8b8731bc9d504a409370371bfc53324c/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:50:06.783188 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5740b4f-9743-4ece-862a-d26a9c795357 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:06.783734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5740b4f-9743-4ece-862a-d26a9c795357 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:06.783734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5740b4f-9743-4ece-862a-d26a9c795357 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:06.785475 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 519/1050] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:50:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:50:06.792653 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649b6e6-a100-48b3-bb88-63c80e94c068 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:06.793086 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649b6e6-a100-48b3-bb88-63c80e94c068 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:06.793175 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649b6e6-a100-48b3-bb88-63c80e94c068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:06.819377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-d649b6e6-a100-48b3-bb88-63c80e94c068 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:50:06.820589 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d649b6e6-a100-48b3-bb88-63c80e94c068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:50:06.880291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 532/1051] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:50:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:50:06.916589 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5740b4f-9743-4ece-862a-d26a9c795357 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:06.938504 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5740b4f-9743-4ece-862a-d26a9c795357 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:06.944641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030f217-5eea-4e2f-8e93-e6446ce7207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:06.945419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030f217-5eea-4e2f-8e93-e6446ce7207c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:06.945695 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030f217-5eea-4e2f-8e93-e6446ce7207c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:06.945962 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030f217-5eea-4e2f-8e93-e6446ce7207c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:06.957412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030f217-5eea-4e2f-8e93-e6446ce7207c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:50:06.964165 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-b030f217-5eea-4e2f-8e93-e6446ce7207c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:50:06.965302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 520/1052] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:50:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:50:06.973811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649b6e6-a100-48b3-bb88-63c80e94c068 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:06.983530 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649b6e6-a100-48b3-bb88-63c80e94c068 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:06.990183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2cd9f-b3f0-4c3f-a0e9-c35d1dd0ac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:06.990837 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2cd9f-b3f0-4c3f-a0e9-c35d1dd0ac14 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:06.991147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2cd9f-b3f0-4c3f-a0e9-c35d1dd0ac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:06.991420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2cd9f-b3f0-4c3f-a0e9-c35d1dd0ac14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:06.992184 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2cd9f-b3f0-4c3f-a0e9-c35d1dd0ac14 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:50:06.992487 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2cd9f-b3f0-4c3f-a0e9-c35d1dd0ac14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:06.994092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2cd9f-b3f0-4c3f-a0e9-c35d1dd0ac14 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:07.002364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 533/1053] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:50:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:07.009534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030f217-5eea-4e2f-8e93-e6446ce7207c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:07.024013 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030f217-5eea-4e2f-8e93-e6446ce7207c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:07.029946 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e3b82-2656-4697-aab1-233da65c81b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:07.030783 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e3b82-2656-4697-aab1-233da65c81b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:07.031068 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e3b82-2656-4697-aab1-233da65c81b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:07.031375 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e3b82-2656-4697-aab1-233da65c81b8 admin admin] PATH_INFO: `/v3/users/8b8731bc9d504a409370371bfc53324c` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:07.032601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e3b82-2656-4697-aab1-233da65c81b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b8731bc9d504a409370371bfc53324c)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:07.034872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e3b82-2656-4697-aab1-233da65c81b8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:07.036415 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 521/1054] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:50:07 2021] GET /identity/v3/users/8b8731bc9d504a409370371bfc53324c => generated 286 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:07.042626 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2cd9f-b3f0-4c3f-a0e9-c35d1dd0ac14 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:07.052330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2cd9f-b3f0-4c3f-a0e9-c35d1dd0ac14 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:07.058098 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979a883-7650-4af3-95ff-2f87d5440851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:07.058712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a883-7650-4af3-95ff-2f87d5440851 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:07.059076 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a883-7650-4af3-95ff-2f87d5440851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:07.059381 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a883-7650-4af3-95ff-2f87d5440851 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:07.067136 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979a883-7650-4af3-95ff-2f87d5440851 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:07.068863 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979a883-7650-4af3-95ff-2f87d5440851 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:07.077488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 534/1055] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:50:07 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:50:07.084395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e3b82-2656-4697-aab1-233da65c81b8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:07.100585 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e3b82-2656-4697-aab1-233da65c81b8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:07.109500 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de0f8a-b1e1-4307-9e89-ef5153fac446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:07.110728 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de0f8a-b1e1-4307-9e89-ef5153fac446 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:07.111318 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de0f8a-b1e1-4307-9e89-ef5153fac446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:07.111657 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de0f8a-b1e1-4307-9e89-ef5153fac446 admin admin] PATH_INFO: `/v3/projects/b234799dbdd24ab6a455ff56e4aa2a72` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:07.113038 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de0f8a-b1e1-4307-9e89-ef5153fac446 admin admin] RBAC: Authorizing `identity:get_project(project_id=b234799dbdd24ab6a455ff56e4aa2a72)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:07.115102 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de0f8a-b1e1-4307-9e89-ef5153fac446 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:07.116801 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 522/1056] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:50:07 2021] GET /identity/v3/projects/b234799dbdd24ab6a455ff56e4aa2a72 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:07.124405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979a883-7650-4af3-95ff-2f87d5440851 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:07.138839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979a883-7650-4af3-95ff-2f87d5440851 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:07.145528 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b702e2-f04c-4a55-8251-13062512b6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:07.146196 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b702e2-f04c-4a55-8251-13062512b6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:07.146482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b702e2-f04c-4a55-8251-13062512b6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:07.146753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b702e2-f04c-4a55-8251-13062512b6a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:07.147637 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b702e2-f04c-4a55-8251-13062512b6a5 admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=b234799dbdd24ab6a455ff56e4aa2a72, user.id=8b8731bc9d504a409370371bfc53324c) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:50:07.147942 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b702e2-f04c-4a55-8251-13062512b6a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:07.149784 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b702e2-f04c-4a55-8251-13062512b6a5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:07.156444 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 535/1057] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:50:07 2021] GET /identity/v3/role_assignments?user.id=8b8731bc9d504a409370371bfc53324c&scope.project.id=b234799dbdd24ab6a455ff56e4aa2a72&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:09.377603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc704e-3478-426e-83d7-0c0b7fea78d1 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:09.378538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc704e-3478-426e-83d7-0c0b7fea78d1 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:09.378538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc704e-3478-426e-83d7-0c0b7fea78d1 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:09.381303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 523/1058] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:50:09 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:50:09.391797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62324c8b-ba7e-4c39-9f06-dce09a2e8b69 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:09.392269 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62324c8b-ba7e-4c39-9f06-dce09a2e8b69 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:09.392660 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62324c8b-ba7e-4c39-9f06-dce09a2e8b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:09.410733 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-62324c8b-ba7e-4c39-9f06-dce09a2e8b69 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:50:09.411977 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-62324c8b-ba7e-4c39-9f06-dce09a2e8b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:50:09.421136 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 536/1059] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:50:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:50:09.458215 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc704e-3478-426e-83d7-0c0b7fea78d1 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:09.473936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc704e-3478-426e-83d7-0c0b7fea78d1 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:09.480133 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba369bce-9d9f-4a27-8932-f9bef88dc0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:09.480783 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba369bce-9d9f-4a27-8932-f9bef88dc0ad admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:09.481066 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba369bce-9d9f-4a27-8932-f9bef88dc0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:09.481325 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba369bce-9d9f-4a27-8932-f9bef88dc0ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:09.490268 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba369bce-9d9f-4a27-8932-f9bef88dc0ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:09.492086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba369bce-9d9f-4a27-8932-f9bef88dc0ad admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:09.501308 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 524/1060] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:50:09 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:50:09.508392 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62324c8b-ba7e-4c39-9f06-dce09a2e8b69 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:09.518240 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62324c8b-ba7e-4c39-9f06-dce09a2e8b69 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:09.524680 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae8c35-3af2-461f-9d6a-c0bc622fc8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:09.525474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae8c35-3af2-461f-9d6a-c0bc622fc8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:09.525753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae8c35-3af2-461f-9d6a-c0bc622fc8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:09.526021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae8c35-3af2-461f-9d6a-c0bc622fc8d9 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:09.534464 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae8c35-3af2-461f-9d6a-c0bc622fc8d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:09.538027 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae8c35-3af2-461f-9d6a-c0bc622fc8d9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:09.552552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-15ae8c35-3af2-461f-9d6a-c0bc622fc8d9 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 08 10:50:09.553675 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 537/1061] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Nov 8 10:50:09 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:50:09.564570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba369bce-9d9f-4a27-8932-f9bef88dc0ad admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:09.578781 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba369bce-9d9f-4a27-8932-f9bef88dc0ad admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:09.585599 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c723bd5-b31c-41db-a1f1-13155334fc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:09.586252 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c723bd5-b31c-41db-a1f1-13155334fc32 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:09.586530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c723bd5-b31c-41db-a1f1-13155334fc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:09.586796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c723bd5-b31c-41db-a1f1-13155334fc32 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:09.587561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c723bd5-b31c-41db-a1f1-13155334fc32 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:50:09.587864 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c723bd5-b31c-41db-a1f1-13155334fc32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:09.589441 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c723bd5-b31c-41db-a1f1-13155334fc32 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:09.596896 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 525/1062] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Nov 8 10:50:09 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:11.826651 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b905-03c3-40bd-80e4-98f1059235ee None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:11.827511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b905-03c3-40bd-80e4-98f1059235ee None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:11.827511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b905-03c3-40bd-80e4-98f1059235ee None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:11.830882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 538/1063] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:50:11 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:50:11.840837 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda749e-a07d-482b-b33f-09e11f9aad6b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:11.841273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda749e-a07d-482b-b33f-09e11f9aad6b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:11.841406 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda749e-a07d-482b-b33f-09e11f9aad6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:11.861529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-3cda749e-a07d-482b-b33f-09e11f9aad6b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:50:11.862714 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3cda749e-a07d-482b-b33f-09e11f9aad6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:50:11.871705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 526/1064] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:50:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:50:11.897369 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5b905-03c3-40bd-80e4-98f1059235ee None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:11.913290 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5b905-03c3-40bd-80e4-98f1059235ee None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:11.919240 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac53079-6bcc-4c7f-8f2f-7a42245ad7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:11.919884 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac53079-6bcc-4c7f-8f2f-7a42245ad7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:11.920169 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac53079-6bcc-4c7f-8f2f-7a42245ad7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:11.920442 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac53079-6bcc-4c7f-8f2f-7a42245ad7b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:11.921208 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac53079-6bcc-4c7f-8f2f-7a42245ad7b7 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:11.922222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-5ac53079-6bcc-4c7f-8f2f-7a42245ad7b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:50:11.922222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:50:11.922222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:50:11.923205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac53079-6bcc-4c7f-8f2f-7a42245ad7b7 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:11.942156 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 539/1065] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Nov 8 10:50:11 2021] POST /identity/v3/domains => generated 267 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:50:14.196980 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e41c4a-bcdb-431f-94f0-294d5266fc4d None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:14.197834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e41c4a-bcdb-431f-94f0-294d5266fc4d None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:14.197834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e41c4a-bcdb-431f-94f0-294d5266fc4d None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:14.200751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 527/1066] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:50:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:50:14.209426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180ef82-0984-422b-b606-543e680907ea None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:14.210080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180ef82-0984-422b-b606-543e680907ea None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:14.210265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180ef82-0984-422b-b606-543e680907ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:14.238820 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-4180ef82-0984-422b-b606-543e680907ea None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:50:14.240059 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4180ef82-0984-422b-b606-543e680907ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:50:14.298777 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 540/1067] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:50:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:50:14.338364 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e41c4a-bcdb-431f-94f0-294d5266fc4d None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:14.354592 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e41c4a-bcdb-431f-94f0-294d5266fc4d None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:14.360891 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76e2be-5a30-4f09-b6d1-106f83240a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:14.361751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76e2be-5a30-4f09-b6d1-106f83240a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:14.362035 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76e2be-5a30-4f09-b6d1-106f83240a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:14.362304 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76e2be-5a30-4f09-b6d1-106f83240a0b admin admin] PATH_INFO: `/v3/domains/019f21374c1640cdbb15cfc8595bb917` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:14.373579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76e2be-5a30-4f09-b6d1-106f83240a0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=019f21374c1640cdbb15cfc8595bb917)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:14.375664 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76e2be-5a30-4f09-b6d1-106f83240a0b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:14.377282 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 528/1068] 10.222.0.20 () {56 vars in 1204 bytes} [Mon Nov 8 10:50:14 2021] GET /identity/v3/domains/019f21374c1640cdbb15cfc8595bb917 => generated 267 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:14.384594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180ef82-0984-422b-b606-543e680907ea None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:14.396745 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180ef82-0984-422b-b606-543e680907ea None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:14.403185 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc212027-062a-4621-b365-408b8f52059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:14.403835 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc212027-062a-4621-b365-408b8f52059b admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:14.404114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc212027-062a-4621-b365-408b8f52059b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:14.404382 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc212027-062a-4621-b365-408b8f52059b admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:14.405104 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc212027-062a-4621-b365-408b8f52059b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:14.406991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc212027-062a-4621-b365-408b8f52059b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:14.438495 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 541/1069] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Nov 8 10:50:14 2021] POST /identity/v3/projects => generated 361 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:50:16.716151 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a41574-a9f9-4f55-b1f2-52f4dc8f6e87 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:16.717064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a41574-a9f9-4f55-b1f2-52f4dc8f6e87 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:16.717064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a41574-a9f9-4f55-b1f2-52f4dc8f6e87 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:16.719901 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 529/1070] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:50:16 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:50:16.726954 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb923faa-eccc-4961-a0b5-90c0872722a4 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:16.727745 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb923faa-eccc-4961-a0b5-90c0872722a4 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:16.727901 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb923faa-eccc-4961-a0b5-90c0872722a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:16.751286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-bb923faa-eccc-4961-a0b5-90c0872722a4 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:50:16.752474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-bb923faa-eccc-4961-a0b5-90c0872722a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:50:16.818016 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 542/1071] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:50:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:50:16.845018 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a41574-a9f9-4f55-b1f2-52f4dc8f6e87 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:16.859287 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a41574-a9f9-4f55-b1f2-52f4dc8f6e87 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:16.864829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f13542-f958-4fb3-af42-458b8589e0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:16.865673 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f13542-f958-4fb3-af42-458b8589e0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:16.865954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f13542-f958-4fb3-af42-458b8589e0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:16.866225 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f13542-f958-4fb3-af42-458b8589e0a0 admin admin] PATH_INFO: `/v3/domains/019f21374c1640cdbb15cfc8595bb917` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:16.867557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f13542-f958-4fb3-af42-458b8589e0a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=019f21374c1640cdbb15cfc8595bb917)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:16.869498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f13542-f958-4fb3-af42-458b8589e0a0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:16.871058 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 530/1072] 10.222.0.20 () {56 vars in 1204 bytes} [Mon Nov 8 10:50:16 2021] GET /identity/v3/domains/019f21374c1640cdbb15cfc8595bb917 => generated 267 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:16.877575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb923faa-eccc-4961-a0b5-90c0872722a4 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:16.886859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb923faa-eccc-4961-a0b5-90c0872722a4 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:16.893254 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b575cc-443e-4c25-ac21-e35d4b090ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:16.893913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b575cc-443e-4c25-ac21-e35d4b090ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:16.894192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b575cc-443e-4c25-ac21-e35d4b090ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:16.894463 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b575cc-443e-4c25-ac21-e35d4b090ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:16.895224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b575cc-443e-4c25-ac21-e35d4b090ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:16.897143 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b575cc-443e-4c25-ac21-e35d4b090ec3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:16.923962 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 543/1073] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Nov 8 10:50:16 2021] POST /identity/v3/users => generated 311 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:50:19.233330 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2b8a-8216-4438-b71a-69fa95f2133b None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:19.234267 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2b8a-8216-4438-b71a-69fa95f2133b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:19.234267 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2b8a-8216-4438-b71a-69fa95f2133b None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:19.237549 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 531/1074] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:50:19 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:50:19.244695 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64c267-792d-427d-8e1c-76b71d56adbd None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:19.245147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64c267-792d-427d-8e1c-76b71d56adbd None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:19.245269 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64c267-792d-427d-8e1c-76b71d56adbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:19.267645 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-8f64c267-792d-427d-8e1c-76b71d56adbd None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:50:19.268852 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8f64c267-792d-427d-8e1c-76b71d56adbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:50:19.277155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 544/1075] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:50:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:50:19.302458 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b2b8a-8216-4438-b71a-69fa95f2133b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:19.321110 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b2b8a-8216-4438-b71a-69fa95f2133b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:19.327150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff28e9-82b4-49e2-8e0e-0a51726c26b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:19.327944 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff28e9-82b4-49e2-8e0e-0a51726c26b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:19.328226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff28e9-82b4-49e2-8e0e-0a51726c26b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:19.328502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff28e9-82b4-49e2-8e0e-0a51726c26b8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:19.342983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff28e9-82b4-49e2-8e0e-0a51726c26b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:50:19.355352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-52ff28e9-82b4-49e2-8e0e-0a51726c26b8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:50:19.356566 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 532/1076] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:50:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:50:19.365341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64c267-792d-427d-8e1c-76b71d56adbd None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:19.375508 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64c267-792d-427d-8e1c-76b71d56adbd None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:19.381995 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28720ff4-af4b-4bed-a10d-cf0a1c29f4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:19.382681 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28720ff4-af4b-4bed-a10d-cf0a1c29f4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:19.382958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28720ff4-af4b-4bed-a10d-cf0a1c29f4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:19.383301 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28720ff4-af4b-4bed-a10d-cf0a1c29f4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:19.384090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28720ff4-af4b-4bed-a10d-cf0a1c29f4a6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:50:19.384395 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28720ff4-af4b-4bed-a10d-cf0a1c29f4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:19.386015 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28720ff4-af4b-4bed-a10d-cf0a1c29f4a6 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:19.395678 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 545/1077] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:50:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:19.402859 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff28e9-82b4-49e2-8e0e-0a51726c26b8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:19.418547 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff28e9-82b4-49e2-8e0e-0a51726c26b8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:19.426758 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a30d2f-7473-4a27-b65f-09b962a21394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:19.428130 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a30d2f-7473-4a27-b65f-09b962a21394 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:19.428563 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a30d2f-7473-4a27-b65f-09b962a21394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:19.428966 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a30d2f-7473-4a27-b65f-09b962a21394 admin admin] PATH_INFO: `/v3/users/a6c1033cd71e4f8599dbbb4f8d18da9b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:19.450962 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a30d2f-7473-4a27-b65f-09b962a21394 admin admin] RBAC: Authorizing `identity:get_user(user_id=a6c1033cd71e4f8599dbbb4f8d18da9b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:19.454441 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a30d2f-7473-4a27-b65f-09b962a21394 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:19.456553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 533/1078] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:50:19 2021] GET /identity/v3/users/a6c1033cd71e4f8599dbbb4f8d18da9b => generated 311 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:19.462998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28720ff4-af4b-4bed-a10d-cf0a1c29f4a6 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:19.473474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28720ff4-af4b-4bed-a10d-cf0a1c29f4a6 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:19.478933 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aaee9-197f-4f88-9ea2-28bd100161a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:19.479606 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aaee9-197f-4f88-9ea2-28bd100161a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:19.479889 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aaee9-197f-4f88-9ea2-28bd100161a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:19.480158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aaee9-197f-4f88-9ea2-28bd100161a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:19.489178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5aaee9-197f-4f88-9ea2-28bd100161a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:19.490845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5aaee9-197f-4f88-9ea2-28bd100161a7 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:19.500241 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 546/1079] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:50:19 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:50:19.507676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a30d2f-7473-4a27-b65f-09b962a21394 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:19.521332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a30d2f-7473-4a27-b65f-09b962a21394 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:19.527710 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676be2e-2bdc-4430-9c20-fa69959cdacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:19.528554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676be2e-2bdc-4430-9c20-fa69959cdacf admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:19.528832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676be2e-2bdc-4430-9c20-fa69959cdacf admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:19.529104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676be2e-2bdc-4430-9c20-fa69959cdacf admin admin] PATH_INFO: `/v3/projects/5012a4bb6e5144dc85c9c00926a88eba` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:19.530491 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676be2e-2bdc-4430-9c20-fa69959cdacf admin admin] RBAC: Authorizing `identity:get_project(project_id=5012a4bb6e5144dc85c9c00926a88eba)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:19.532716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676be2e-2bdc-4430-9c20-fa69959cdacf admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:19.534324 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 534/1080] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:50:19 2021] GET /identity/v3/projects/5012a4bb6e5144dc85c9c00926a88eba => generated 361 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:19.540692 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aaee9-197f-4f88-9ea2-28bd100161a7 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:19.549480 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aaee9-197f-4f88-9ea2-28bd100161a7 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:19.555090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d311d6e-8abc-4c73-93c1-687bd0ca7938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:19.555727 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d311d6e-8abc-4c73-93c1-687bd0ca7938 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:19.556006 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d311d6e-8abc-4c73-93c1-687bd0ca7938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:19.556277 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d311d6e-8abc-4c73-93c1-687bd0ca7938 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:19.557103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d311d6e-8abc-4c73-93c1-687bd0ca7938 admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=5012a4bb6e5144dc85c9c00926a88eba, user.id=a6c1033cd71e4f8599dbbb4f8d18da9b) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:50:19.557403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d311d6e-8abc-4c73-93c1-687bd0ca7938 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:19.559246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d311d6e-8abc-4c73-93c1-687bd0ca7938 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:19.564693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 547/1081] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:50:19 2021] GET /identity/v3/role_assignments?user.id=a6c1033cd71e4f8599dbbb4f8d18da9b&scope.project.id=5012a4bb6e5144dc85c9c00926a88eba&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:21.748643 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469bacb-8cbb-4cb1-bf7e-2521a277d532 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:21.749451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469bacb-8cbb-4cb1-bf7e-2521a277d532 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:21.749451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469bacb-8cbb-4cb1-bf7e-2521a277d532 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:21.752315 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 535/1082] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:50:21 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:50:21.759546 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027619-7371-4f02-9a2f-10ca8af3f67a None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:21.760323 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027619-7371-4f02-9a2f-10ca8af3f67a None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:21.760484 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027619-7371-4f02-9a2f-10ca8af3f67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:21.782141 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-ab027619-7371-4f02-9a2f-10ca8af3f67a None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:50:21.783509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ab027619-7371-4f02-9a2f-10ca8af3f67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:50:21.793568 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 548/1083] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:50:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:50:21.817477 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469bacb-8cbb-4cb1-bf7e-2521a277d532 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:21.836104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469bacb-8cbb-4cb1-bf7e-2521a277d532 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:21.842344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb3bf3-0ac9-4719-a411-9e9be2a4bdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:21.843137 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb3bf3-0ac9-4719-a411-9e9be2a4bdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:21.843440 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb3bf3-0ac9-4719-a411-9e9be2a4bdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:21.843717 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb3bf3-0ac9-4719-a411-9e9be2a4bdb2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:21.854921 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb3bf3-0ac9-4719-a411-9e9be2a4bdb2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:50:21.861715 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-98cb3bf3-0ac9-4719-a411-9e9be2a4bdb2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:50:21.862846 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 536/1084] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:50:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:50:21.869733 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab027619-7371-4f02-9a2f-10ca8af3f67a None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:21.879039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab027619-7371-4f02-9a2f-10ca8af3f67a None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:21.885677 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44367a6-b416-4f8b-a245-d5669008455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:21.886327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44367a6-b416-4f8b-a245-d5669008455b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:21.886605 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44367a6-b416-4f8b-a245-d5669008455b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:21.886872 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44367a6-b416-4f8b-a245-d5669008455b admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:21.887676 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44367a6-b416-4f8b-a245-d5669008455b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:50:21.887984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44367a6-b416-4f8b-a245-d5669008455b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:21.889567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44367a6-b416-4f8b-a245-d5669008455b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:21.898941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 549/1085] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:50:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:21.905433 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb3bf3-0ac9-4719-a411-9e9be2a4bdb2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:21.922875 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb3bf3-0ac9-4719-a411-9e9be2a4bdb2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:21.929380 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b16693-0d55-402c-8837-f4a3fe703a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:21.930215 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b16693-0d55-402c-8837-f4a3fe703a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:21.930492 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b16693-0d55-402c-8837-f4a3fe703a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:21.930775 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b16693-0d55-402c-8837-f4a3fe703a20 admin admin] PATH_INFO: `/v3/users/a6c1033cd71e4f8599dbbb4f8d18da9b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:21.932239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b16693-0d55-402c-8837-f4a3fe703a20 admin admin] RBAC: Authorizing `identity:get_user(user_id=a6c1033cd71e4f8599dbbb4f8d18da9b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:21.934379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b16693-0d55-402c-8837-f4a3fe703a20 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:21.935970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 537/1086] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:50:21 2021] GET /identity/v3/users/a6c1033cd71e4f8599dbbb4f8d18da9b => generated 311 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:21.942390 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44367a6-b416-4f8b-a245-d5669008455b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:21.952504 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44367a6-b416-4f8b-a245-d5669008455b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:21.958859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b749d8-e6d7-4707-a3f6-52e57a734271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:21.959760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b749d8-e6d7-4707-a3f6-52e57a734271 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:21.960039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b749d8-e6d7-4707-a3f6-52e57a734271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:21.960307 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b749d8-e6d7-4707-a3f6-52e57a734271 admin admin] PATH_INFO: `/v3/projects/5012a4bb6e5144dc85c9c00926a88eba` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:21.961616 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b749d8-e6d7-4707-a3f6-52e57a734271 admin admin] RBAC: Authorizing `identity:get_project(project_id=5012a4bb6e5144dc85c9c00926a88eba)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:21.963670 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b749d8-e6d7-4707-a3f6-52e57a734271 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:21.965283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 550/1087] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:50:21 2021] GET /identity/v3/projects/5012a4bb6e5144dc85c9c00926a88eba => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:21.971760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b16693-0d55-402c-8837-f4a3fe703a20 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:21.982428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b16693-0d55-402c-8837-f4a3fe703a20 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:21.988858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26f624-8393-4198-9bff-833b7ef68dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:21.989702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26f624-8393-4198-9bff-833b7ef68dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:21.989986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26f624-8393-4198-9bff-833b7ef68dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:21.990258 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26f624-8393-4198-9bff-833b7ef68dd2 admin admin] PATH_INFO: `/v3/projects/5012a4bb6e5144dc85c9c00926a88eba/users/a6c1033cd71e4f8599dbbb4f8d18da9b/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:21.992645 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26f624-8393-4198-9bff-833b7ef68dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5012a4bb6e5144dc85c9c00926a88eba, user_id=a6c1033cd71e4f8599dbbb4f8d18da9b, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:21.995295 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26f624-8393-4198-9bff-833b7ef68dd2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:22.012367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 538/1088] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:50:21 2021] PUT /identity/v3/projects/5012a4bb6e5144dc85c9c00926a88eba/users/a6c1033cd71e4f8599dbbb4f8d18da9b/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:50:24.228408 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc849133-0aad-4b5b-aecb-2e23771d7083 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:24.229321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc849133-0aad-4b5b-aecb-2e23771d7083 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:24.229321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc849133-0aad-4b5b-aecb-2e23771d7083 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:24.232261 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 551/1089] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:50:24 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:50:24.238503 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6be957-e716-4e4e-a756-d7b368e58b1f None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:24.238935 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6be957-e716-4e4e-a756-d7b368e58b1f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:24.239031 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6be957-e716-4e4e-a756-d7b368e58b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:24.257908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-7e6be957-e716-4e4e-a756-d7b368e58b1f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:50:24.259090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-7e6be957-e716-4e4e-a756-d7b368e58b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:50:24.315723 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 539/1090] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:50:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:50:24.340680 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc849133-0aad-4b5b-aecb-2e23771d7083 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:24.357547 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc849133-0aad-4b5b-aecb-2e23771d7083 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:24.363991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdf4b7-ae96-4f96-8e59-01be044bf15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:24.364772 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdf4b7-ae96-4f96-8e59-01be044bf15d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:24.365058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdf4b7-ae96-4f96-8e59-01be044bf15d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:24.365331 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdf4b7-ae96-4f96-8e59-01be044bf15d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:24.377364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdf4b7-ae96-4f96-8e59-01be044bf15d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:50:24.384169 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-7fcdf4b7-ae96-4f96-8e59-01be044bf15d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:50:24.385335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 552/1091] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:50:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:50:24.395973 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6be957-e716-4e4e-a756-d7b368e58b1f None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:24.409156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6be957-e716-4e4e-a756-d7b368e58b1f None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:24.415341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60a5d5-580a-4ce8-9bc4-a8d2612f9699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:24.415998 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60a5d5-580a-4ce8-9bc4-a8d2612f9699 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:24.416274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60a5d5-580a-4ce8-9bc4-a8d2612f9699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:24.416543 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60a5d5-580a-4ce8-9bc4-a8d2612f9699 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:24.417302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60a5d5-580a-4ce8-9bc4-a8d2612f9699 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:50:24.417606 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60a5d5-580a-4ce8-9bc4-a8d2612f9699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:24.419217 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60a5d5-580a-4ce8-9bc4-a8d2612f9699 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:24.428105 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 540/1092] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:50:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:24.435458 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdf4b7-ae96-4f96-8e59-01be044bf15d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:24.451747 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdf4b7-ae96-4f96-8e59-01be044bf15d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:24.459478 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863076f-1374-4087-8bd5-8bea9d2f1e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:24.460714 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863076f-1374-4087-8bd5-8bea9d2f1e78 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:24.461019 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863076f-1374-4087-8bd5-8bea9d2f1e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:24.461306 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863076f-1374-4087-8bd5-8bea9d2f1e78 admin admin] PATH_INFO: `/v3/users/a6c1033cd71e4f8599dbbb4f8d18da9b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:24.462512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863076f-1374-4087-8bd5-8bea9d2f1e78 admin admin] RBAC: Authorizing `identity:get_user(user_id=a6c1033cd71e4f8599dbbb4f8d18da9b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:24.464657 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863076f-1374-4087-8bd5-8bea9d2f1e78 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:24.466252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 553/1093] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:50:24 2021] GET /identity/v3/users/a6c1033cd71e4f8599dbbb4f8d18da9b => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:24.474186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60a5d5-580a-4ce8-9bc4-a8d2612f9699 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:24.484416 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60a5d5-580a-4ce8-9bc4-a8d2612f9699 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:24.489705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e45b46-d87c-49e9-8967-988b48ee038c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:24.490351 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e45b46-d87c-49e9-8967-988b48ee038c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:24.490632 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e45b46-d87c-49e9-8967-988b48ee038c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:24.490906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e45b46-d87c-49e9-8967-988b48ee038c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:24.499326 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e45b46-d87c-49e9-8967-988b48ee038c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:24.501171 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e45b46-d87c-49e9-8967-988b48ee038c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:24.510662 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 541/1094] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:50:24 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:50:24.517812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863076f-1374-4087-8bd5-8bea9d2f1e78 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:24.528732 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863076f-1374-4087-8bd5-8bea9d2f1e78 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:24.535092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bc696-d883-41ab-af19-90bcdec068a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:24.535969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bc696-d883-41ab-af19-90bcdec068a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:24.536246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bc696-d883-41ab-af19-90bcdec068a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:24.536514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bc696-d883-41ab-af19-90bcdec068a0 admin admin] PATH_INFO: `/v3/projects/5012a4bb6e5144dc85c9c00926a88eba` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:24.537846 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bc696-d883-41ab-af19-90bcdec068a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=5012a4bb6e5144dc85c9c00926a88eba)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:24.539938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bc696-d883-41ab-af19-90bcdec068a0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:24.541577 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 554/1095] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:50:24 2021] GET /identity/v3/projects/5012a4bb6e5144dc85c9c00926a88eba => generated 361 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:50:24.547988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e45b46-d87c-49e9-8967-988b48ee038c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:50:24.556697 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e45b46-d87c-49e9-8967-988b48ee038c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:50:24.561659 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4df27-8ade-4628-96cd-577ac52eae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:50:24.562271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4df27-8ade-4628-96cd-577ac52eae40 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:50:24.562547 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4df27-8ade-4628-96cd-577ac52eae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:50:24.562815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4df27-8ade-4628-96cd-577ac52eae40 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:50:24.563874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4df27-8ade-4628-96cd-577ac52eae40 admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=5012a4bb6e5144dc85c9c00926a88eba, user.id=a6c1033cd71e4f8599dbbb4f8d18da9b) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:50:24.564239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4df27-8ade-4628-96cd-577ac52eae40 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:50:24.566002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4df27-8ade-4628-96cd-577ac52eae40 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:50:24.571820 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 542/1096] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:50:24 2021] GET /identity/v3/role_assignments?user.id=a6c1033cd71e4f8599dbbb4f8d18da9b&scope.project.id=5012a4bb6e5144dc85c9c00926a88eba&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:20.378712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0435146-581c-4392-a230-8abc4ef2f087 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:20.378712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0435146-581c-4392-a230-8abc4ef2f087 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:20.378712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0435146-581c-4392-a230-8abc4ef2f087 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:20.379785 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 555/1097] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:51:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:51:20.386776 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021947fa-448e-4b3e-ad18-9c6cc2ce19a7 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:20.387341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021947fa-448e-4b3e-ad18-9c6cc2ce19a7 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:20.387444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021947fa-448e-4b3e-ad18-9c6cc2ce19a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:20.413781 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-021947fa-448e-4b3e-ad18-9c6cc2ce19a7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:51:20.415115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-021947fa-448e-4b3e-ad18-9c6cc2ce19a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:51:20.424262 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 543/1098] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:51:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:51:20.453731 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0435146-581c-4392-a230-8abc4ef2f087 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:20.471438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0435146-581c-4392-a230-8abc4ef2f087 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:20.479899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d8981-358c-4d71-a3e9-0ca1e1392d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:20.480735 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d8981-358c-4d71-a3e9-0ca1e1392d87 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:20.481019 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d8981-358c-4d71-a3e9-0ca1e1392d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:20.481303 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d8981-358c-4d71-a3e9-0ca1e1392d87 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:20.500476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d8981-358c-4d71-a3e9-0ca1e1392d87 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:20.502687 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d8981-358c-4d71-a3e9-0ca1e1392d87 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:20.522747 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-361d8981-358c-4d71-a3e9-0ca1e1392d87 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:51:20.524396 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 556/1099] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:20.531459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021947fa-448e-4b3e-ad18-9c6cc2ce19a7 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:20.541999 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021947fa-448e-4b3e-ad18-9c6cc2ce19a7 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:20.547624 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0053195-fad1-455e-a3b2-3682d01e6741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:20.548774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0053195-fad1-455e-a3b2-3682d01e6741 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:20.549359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0053195-fad1-455e-a3b2-3682d01e6741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:20.549820 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0053195-fad1-455e-a3b2-3682d01e6741 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:20.551271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0053195-fad1-455e-a3b2-3682d01e6741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:20.551588 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0053195-fad1-455e-a3b2-3682d01e6741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:20.553428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0053195-fad1-455e-a3b2-3682d01e6741 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:20.572647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 544/1100] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:51:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:20.574156 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d8981-358c-4d71-a3e9-0ca1e1392d87 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:20.585020 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d8981-358c-4d71-a3e9-0ca1e1392d87 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:20.589992 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d360a-8c78-4cbf-939e-037e74e07163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:20.590744 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d360a-8c78-4cbf-939e-037e74e07163 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:20.591031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d360a-8c78-4cbf-939e-037e74e07163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:20.591366 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d360a-8c78-4cbf-939e-037e74e07163 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:20.592168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d360a-8c78-4cbf-939e-037e74e07163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:20.594169 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d360a-8c78-4cbf-939e-037e74e07163 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:20.627723 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 557/1101] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Nov 8 10:51:20 2021] POST /identity/v3/users => generated 251 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 10:51:23.008364 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a605b-cf74-40f4-9ade-f95bafbe4a2f None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:23.008364 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a605b-cf74-40f4-9ade-f95bafbe4a2f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:23.009020 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a605b-cf74-40f4-9ade-f95bafbe4a2f None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:23.010776 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 545/1102] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:51:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:51:23.021260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06161835-a38c-4f7d-be5b-3d8199ffcb77 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:23.021808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06161835-a38c-4f7d-be5b-3d8199ffcb77 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:23.021944 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06161835-a38c-4f7d-be5b-3d8199ffcb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:23.047003 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-06161835-a38c-4f7d-be5b-3d8199ffcb77 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:51:23.048298 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-06161835-a38c-4f7d-be5b-3d8199ffcb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:51:23.057841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 558/1103] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:51:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:51:23.085897 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a605b-cf74-40f4-9ade-f95bafbe4a2f None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:23.100471 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a605b-cf74-40f4-9ade-f95bafbe4a2f None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:23.106466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fa64b-9978-4f0c-abb4-46d4cffb62a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:23.107366 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fa64b-9978-4f0c-abb4-46d4cffb62a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:23.107652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fa64b-9978-4f0c-abb4-46d4cffb62a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:23.108010 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fa64b-9978-4f0c-abb4-46d4cffb62a9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:23.123303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fa64b-9978-4f0c-abb4-46d4cffb62a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:51:23.131600 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-de0fa64b-9978-4f0c-abb4-46d4cffb62a9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:51:23.132985 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 546/1104] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:51:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:23.141280 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06161835-a38c-4f7d-be5b-3d8199ffcb77 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:23.154404 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06161835-a38c-4f7d-be5b-3d8199ffcb77 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:23.160674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248c133-6d94-446d-b6eb-e73ca1483bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:23.161581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248c133-6d94-446d-b6eb-e73ca1483bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:23.161978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248c133-6d94-446d-b6eb-e73ca1483bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:23.162253 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248c133-6d94-446d-b6eb-e73ca1483bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:23.163311 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248c133-6d94-446d-b6eb-e73ca1483bc4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:23.163694 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248c133-6d94-446d-b6eb-e73ca1483bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:23.165506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248c133-6d94-446d-b6eb-e73ca1483bc4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:23.175678 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 559/1105] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:51:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:23.183023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fa64b-9978-4f0c-abb4-46d4cffb62a9 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:23.196352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fa64b-9978-4f0c-abb4-46d4cffb62a9 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:23.201373 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee7a04-5566-4573-86ee-768a845b5981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:23.202175 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee7a04-5566-4573-86ee-768a845b5981 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:23.202456 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee7a04-5566-4573-86ee-768a845b5981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:23.202729 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee7a04-5566-4573-86ee-768a845b5981 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:23.213501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee7a04-5566-4573-86ee-768a845b5981 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:23.215394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee7a04-5566-4573-86ee-768a845b5981 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:23.232520 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-43ee7a04-5566-4573-86ee-768a845b5981 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:51:23.233890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 547/1106] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:23.240711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248c133-6d94-446d-b6eb-e73ca1483bc4 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:23.250741 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248c133-6d94-446d-b6eb-e73ca1483bc4 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:23.256590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf0784-a997-47d5-a976-4098b4687aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:23.257245 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf0784-a997-47d5-a976-4098b4687aeb admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:23.257534 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf0784-a997-47d5-a976-4098b4687aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:23.257796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf0784-a997-47d5-a976-4098b4687aeb admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:23.258566 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf0784-a997-47d5-a976-4098b4687aeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:23.258830 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf0784-a997-47d5-a976-4098b4687aeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:23.260509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf0784-a997-47d5-a976-4098b4687aeb admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:23.273934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 560/1107] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:51:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:23.280094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee7a04-5566-4573-86ee-768a845b5981 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:23.290618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee7a04-5566-4573-86ee-768a845b5981 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:23.295615 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddfda8-799a-472b-a29b-ebfd0a3a526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:23.296413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddfda8-799a-472b-a29b-ebfd0a3a526b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:23.296690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddfda8-799a-472b-a29b-ebfd0a3a526b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:23.296960 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddfda8-799a-472b-a29b-ebfd0a3a526b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:23.305326 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddfda8-799a-472b-a29b-ebfd0a3a526b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:23.307450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddfda8-799a-472b-a29b-ebfd0a3a526b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:23.322042 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-36ddfda8-799a-472b-a29b-ebfd0a3a526b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 08 10:51:23.323431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 548/1108] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:23 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:23.331396 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf0784-a997-47d5-a976-4098b4687aeb admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:23.341762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf0784-a997-47d5-a976-4098b4687aeb admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:23.347891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd1b4f-0bca-4930-bce9-e0bd386ff408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:23.348640 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd1b4f-0bca-4930-bce9-e0bd386ff408 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:23.349035 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd1b4f-0bca-4930-bce9-e0bd386ff408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:23.349360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd1b4f-0bca-4930-bce9-e0bd386ff408 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:23.350246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd1b4f-0bca-4930-bce9-e0bd386ff408 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:23.350566 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd1b4f-0bca-4930-bce9-e0bd386ff408 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:23.352478 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd1b4f-0bca-4930-bce9-e0bd386ff408 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:23.375165 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 561/1109] 10.222.0.20 () {56 vars in 1164 bytes} [Mon Nov 8 10:51:23 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:23.377655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddfda8-799a-472b-a29b-ebfd0a3a526b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:23.389859 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddfda8-799a-472b-a29b-ebfd0a3a526b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:23.395682 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712510a-d21e-4580-87e5-34daa1ab5721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:23.396371 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712510a-d21e-4580-87e5-34daa1ab5721 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:23.396664 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712510a-d21e-4580-87e5-34daa1ab5721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:23.396886 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712510a-d21e-4580-87e5-34daa1ab5721 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:23.405541 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712510a-d21e-4580-87e5-34daa1ab5721 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:23.407390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712510a-d21e-4580-87e5-34daa1ab5721 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:23.416874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 549/1110] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:51:23 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 10:51:23.423947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd1b4f-0bca-4930-bce9-e0bd386ff408 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:23.433879 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd1b4f-0bca-4930-bce9-e0bd386ff408 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:23.438470 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bfd25-b8e1-4ee2-b7b6-f1d191f62466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:23.439368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bfd25-b8e1-4ee2-b7b6-f1d191f62466 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:23.439659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bfd25-b8e1-4ee2-b7b6-f1d191f62466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:23.439919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bfd25-b8e1-4ee2-b7b6-f1d191f62466 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:23.452341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bfd25-b8e1-4ee2-b7b6-f1d191f62466 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:23.454181 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bfd25-b8e1-4ee2-b7b6-f1d191f62466 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:23.472553 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-884bfd25-b8e1-4ee2-b7b6-f1d191f62466 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:51:23.475280 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 562/1111] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:23.479478 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712510a-d21e-4580-87e5-34daa1ab5721 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:23.489044 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712510a-d21e-4580-87e5-34daa1ab5721 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:23.494788 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3c6ab-1c2c-488c-aab0-effa916204a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:23.495434 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3c6ab-1c2c-488c-aab0-effa916204a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:23.498672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3c6ab-1c2c-488c-aab0-effa916204a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:23.498672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3c6ab-1c2c-488c-aab0-effa916204a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:23.498672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3c6ab-1c2c-488c-aab0-effa916204a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:23.498672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3c6ab-1c2c-488c-aab0-effa916204a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:23.498672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3c6ab-1c2c-488c-aab0-effa916204a7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:23.510774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 550/1112] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:51:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:23.520225 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bfd25-b8e1-4ee2-b7b6-f1d191f62466 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:23.530217 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bfd25-b8e1-4ee2-b7b6-f1d191f62466 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:23.535227 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd2355-e8e4-454a-9c11-65d713035877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:23.536018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd2355-e8e4-454a-9c11-65d713035877 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:23.537357 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd2355-e8e4-454a-9c11-65d713035877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:23.537357 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd2355-e8e4-454a-9c11-65d713035877 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:23.543606 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd2355-e8e4-454a-9c11-65d713035877 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:23.547610 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd2355-e8e4-454a-9c11-65d713035877 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:23.560518 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-c9cd2355-e8e4-454a-9c11-65d713035877 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:51:23.561706 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 563/1113] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:51:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:51:23.568368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3c6ab-1c2c-488c-aab0-effa916204a7 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:23.578663 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3c6ab-1c2c-488c-aab0-effa916204a7 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:23.584145 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b89c8-ab7e-4f09-8faa-190b3e3340cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:23.584813 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b89c8-ab7e-4f09-8faa-190b3e3340cb admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:23.585096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b89c8-ab7e-4f09-8faa-190b3e3340cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:23.585370 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b89c8-ab7e-4f09-8faa-190b3e3340cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:23.586174 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b89c8-ab7e-4f09-8faa-190b3e3340cb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:23.586483 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b89c8-ab7e-4f09-8faa-190b3e3340cb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:23.588377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b89c8-ab7e-4f09-8faa-190b3e3340cb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:23.601410 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 551/1114] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:51:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:23.608506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd2355-e8e4-454a-9c11-65d713035877 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:23.619619 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd2355-e8e4-454a-9c11-65d713035877 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:23.624745 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688966a-1f20-4443-b313-e4e4d23fe1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:23.625506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688966a-1f20-4443-b313-e4e4d23fe1ef admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:23.625886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688966a-1f20-4443-b313-e4e4d23fe1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:23.626253 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688966a-1f20-4443-b313-e4e4d23fe1ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:23.627652 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688966a-1f20-4443-b313-e4e4d23fe1ef admin admin] RBAC: Adding query filter params (role.id=2ba23f9ef2de43a6bf86f97ccf919c68, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=642c2b97ece34d69bacd821b108bd210) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:23.628063 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688966a-1f20-4443-b313-e4e4d23fe1ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:23.630010 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688966a-1f20-4443-b313-e4e4d23fe1ef admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:23.636734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 564/1115] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:51:23 2021] GET /identity/v3/role_assignments?user.id=642c2b97ece34d69bacd821b108bd210&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=2ba23f9ef2de43a6bf86f97ccf919c68 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:51:25.993213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ead157-905c-40b7-968f-9d51fdb8f7cc None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:25.993795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ead157-905c-40b7-968f-9d51fdb8f7cc None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:25.993795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ead157-905c-40b7-968f-9d51fdb8f7cc None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:25.995827 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 552/1116] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:51:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:51:26.002393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9663e-24ed-4831-bf4f-c644389539e8 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:26.002862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9663e-24ed-4831-bf4f-c644389539e8 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:26.002951 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9663e-24ed-4831-bf4f-c644389539e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:26.023601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-88b9663e-24ed-4831-bf4f-c644389539e8 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:51:26.024902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-88b9663e-24ed-4831-bf4f-c644389539e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:51:26.034586 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 565/1117] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:51:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:51:26.058788 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ead157-905c-40b7-968f-9d51fdb8f7cc None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:26.072114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ead157-905c-40b7-968f-9d51fdb8f7cc None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:26.076521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebe8c6-76ef-431a-ba80-4789c385155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:26.077347 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe8c6-76ef-431a-ba80-4789c385155c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:26.077634 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe8c6-76ef-431a-ba80-4789c385155c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:26.077893 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe8c6-76ef-431a-ba80-4789c385155c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:26.090489 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebe8c6-76ef-431a-ba80-4789c385155c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:51:26.097772 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-2eebe8c6-76ef-431a-ba80-4789c385155c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:51:26.099320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 553/1118] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:51:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:26.110218 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9663e-24ed-4831-bf4f-c644389539e8 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:26.116243 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9663e-24ed-4831-bf4f-c644389539e8 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:26.123230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956f639-36fa-4b70-aadf-1e7e2f4bb254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:26.124467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f639-36fa-4b70-aadf-1e7e2f4bb254 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:26.124898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f639-36fa-4b70-aadf-1e7e2f4bb254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:26.125238 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f639-36fa-4b70-aadf-1e7e2f4bb254 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:26.126177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956f639-36fa-4b70-aadf-1e7e2f4bb254 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:26.126680 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956f639-36fa-4b70-aadf-1e7e2f4bb254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:26.128935 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956f639-36fa-4b70-aadf-1e7e2f4bb254 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:26.145831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 566/1119] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:51:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:26.147497 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebe8c6-76ef-431a-ba80-4789c385155c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:26.160877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebe8c6-76ef-431a-ba80-4789c385155c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:26.166841 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9e2a5-8d1e-4ace-b00e-35e36e8cb1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:26.167955 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9e2a5-8d1e-4ace-b00e-35e36e8cb1af admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:26.168218 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9e2a5-8d1e-4ace-b00e-35e36e8cb1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:26.168524 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9e2a5-8d1e-4ace-b00e-35e36e8cb1af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:26.181334 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9e2a5-8d1e-4ace-b00e-35e36e8cb1af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:26.183372 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9e2a5-8d1e-4ace-b00e-35e36e8cb1af admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:26.201576 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-94e9e2a5-8d1e-4ace-b00e-35e36e8cb1af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:51:26.202981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 554/1120] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:51:26.210064 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956f639-36fa-4b70-aadf-1e7e2f4bb254 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:26.221704 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956f639-36fa-4b70-aadf-1e7e2f4bb254 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:26.226867 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f57b02-3598-4afe-a111-ba837f95d2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:26.227621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57b02-3598-4afe-a111-ba837f95d2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:26.227894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57b02-3598-4afe-a111-ba837f95d2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:26.228167 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57b02-3598-4afe-a111-ba837f95d2d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:26.228975 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f57b02-3598-4afe-a111-ba837f95d2d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:26.229347 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f57b02-3598-4afe-a111-ba837f95d2d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:26.231151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f57b02-3598-4afe-a111-ba837f95d2d4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:26.244994 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 567/1121] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:51:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:26.251451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9e2a5-8d1e-4ace-b00e-35e36e8cb1af admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:26.262203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9e2a5-8d1e-4ace-b00e-35e36e8cb1af admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:26.268096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c741b-eae8-48d2-b88c-74a23222b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:26.269227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c741b-eae8-48d2-b88c-74a23222b14f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:26.269482 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c741b-eae8-48d2-b88c-74a23222b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:26.269875 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c741b-eae8-48d2-b88c-74a23222b14f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:26.279046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c741b-eae8-48d2-b88c-74a23222b14f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:26.281280 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c741b-eae8-48d2-b88c-74a23222b14f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:26.296724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-c76c741b-eae8-48d2-b88c-74a23222b14f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 08 10:51:26.303716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 555/1122] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:26 2021] GET /identity/v3/users/placement => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:51:26.305001 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f57b02-3598-4afe-a111-ba837f95d2d4 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:26.315811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f57b02-3598-4afe-a111-ba837f95d2d4 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:26.320808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d9bba-1ac1-458b-a6c9-2b2dfbc434b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:26.321571 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d9bba-1ac1-458b-a6c9-2b2dfbc434b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:26.322009 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d9bba-1ac1-458b-a6c9-2b2dfbc434b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:26.322327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d9bba-1ac1-458b-a6c9-2b2dfbc434b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:26.323329 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d9bba-1ac1-458b-a6c9-2b2dfbc434b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:26.323706 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d9bba-1ac1-458b-a6c9-2b2dfbc434b5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:26.325776 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d9bba-1ac1-458b-a6c9-2b2dfbc434b5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:26.344623 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 568/1123] 10.222.0.20 () {56 vars in 1164 bytes} [Mon Nov 8 10:51:26 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:26.351487 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c741b-eae8-48d2-b88c-74a23222b14f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:26.362106 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c741b-eae8-48d2-b88c-74a23222b14f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:26.367082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae14f4-17e9-4c04-b2c5-67be034bcbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:26.368036 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae14f4-17e9-4c04-b2c5-67be034bcbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:26.368531 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae14f4-17e9-4c04-b2c5-67be034bcbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:26.368841 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae14f4-17e9-4c04-b2c5-67be034bcbe1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:26.379908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae14f4-17e9-4c04-b2c5-67be034bcbe1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:26.381759 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae14f4-17e9-4c04-b2c5-67be034bcbe1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:26.400201 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-48ae14f4-17e9-4c04-b2c5-67be034bcbe1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:51:26.401435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 556/1124] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:26.408142 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d9bba-1ac1-458b-a6c9-2b2dfbc434b5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:26.418538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d9bba-1ac1-458b-a6c9-2b2dfbc434b5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:26.423509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd4850-5d8d-4023-a394-e7c6c5b21a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:26.424398 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd4850-5d8d-4023-a394-e7c6c5b21a08 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:26.424810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd4850-5d8d-4023-a394-e7c6c5b21a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:26.425163 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd4850-5d8d-4023-a394-e7c6c5b21a08 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:26.426180 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd4850-5d8d-4023-a394-e7c6c5b21a08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:26.426613 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd4850-5d8d-4023-a394-e7c6c5b21a08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:26.428252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd4850-5d8d-4023-a394-e7c6c5b21a08 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:26.442483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 569/1125] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:51:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:51:26.448876 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae14f4-17e9-4c04-b2c5-67be034bcbe1 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:26.458983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae14f4-17e9-4c04-b2c5-67be034bcbe1 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:26.472998 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890dce0-166e-46e0-9d5c-5355262df981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:26.474092 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890dce0-166e-46e0-9d5c-5355262df981 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:26.474519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890dce0-166e-46e0-9d5c-5355262df981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:26.474988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890dce0-166e-46e0-9d5c-5355262df981 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:26.482757 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890dce0-166e-46e0-9d5c-5355262df981 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:26.485430 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890dce0-166e-46e0-9d5c-5355262df981 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:26.500502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-9890dce0-166e-46e0-9d5c-5355262df981 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:51:26.507220 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 557/1126] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:51:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:26.508423 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd4850-5d8d-4023-a394-e7c6c5b21a08 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:26.519622 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd4850-5d8d-4023-a394-e7c6c5b21a08 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:26.524630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabf9f0-9536-4178-a4ed-2fdbc8c96ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:26.525599 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf9f0-9536-4178-a4ed-2fdbc8c96ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:26.525989 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf9f0-9536-4178-a4ed-2fdbc8c96ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:26.526482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf9f0-9536-4178-a4ed-2fdbc8c96ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:26.527635 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabf9f0-9536-4178-a4ed-2fdbc8c96ab7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:26.528088 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabf9f0-9536-4178-a4ed-2fdbc8c96ab7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:26.530573 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabf9f0-9536-4178-a4ed-2fdbc8c96ab7 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:26.553206 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 570/1127] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:51:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:26.554787 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890dce0-166e-46e0-9d5c-5355262df981 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:26.568435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890dce0-166e-46e0-9d5c-5355262df981 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:26.574088 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb2a2e-d095-4128-b015-75d5fa6ca847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:26.575367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb2a2e-d095-4128-b015-75d5fa6ca847 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:26.575770 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb2a2e-d095-4128-b015-75d5fa6ca847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:26.576179 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb2a2e-d095-4128-b015-75d5fa6ca847 admin admin] PATH_INFO: `/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/642c2b97ece34d69bacd821b108bd210/roles/2ba23f9ef2de43a6bf86f97ccf919c68` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:26.596195 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb2a2e-d095-4128-b015-75d5fa6ca847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ae5e80b1f745dfaedd81a2c0ded718, user_id=642c2b97ece34d69bacd821b108bd210, role_id=2ba23f9ef2de43a6bf86f97ccf919c68)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:26.599032 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb2a2e-d095-4128-b015-75d5fa6ca847 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:26.617782 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 558/1128] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:51:26 2021] PUT /identity/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/642c2b97ece34d69bacd821b108bd210/roles/2ba23f9ef2de43a6bf86f97ccf919c68 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:51:28.907573 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dfa0c-1cb4-4818-bf1a-1136008a8589 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:28.908114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dfa0c-1cb4-4818-bf1a-1136008a8589 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:28.908114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dfa0c-1cb4-4818-bf1a-1136008a8589 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:28.909796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 571/1129] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:51:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:51:28.918360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3b519-2c9e-4b00-a23e-d69a981c2e90 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:28.918360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3b519-2c9e-4b00-a23e-d69a981c2e90 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:28.918360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3b519-2c9e-4b00-a23e-d69a981c2e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:28.937342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-18c3b519-2c9e-4b00-a23e-d69a981c2e90 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:51:28.938614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-18c3b519-2c9e-4b00-a23e-d69a981c2e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:51:28.999845 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 559/1130] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:51:28 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:51:29.025458 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dfa0c-1cb4-4818-bf1a-1136008a8589 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:29.038276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dfa0c-1cb4-4818-bf1a-1136008a8589 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:29.043230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033b724-e601-46e9-97b4-b665427c1132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:29.044058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033b724-e601-46e9-97b4-b665427c1132 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:29.044329 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033b724-e601-46e9-97b4-b665427c1132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:29.044594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033b724-e601-46e9-97b4-b665427c1132 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:29.055477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033b724-e601-46e9-97b4-b665427c1132 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:51:29.062305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-1033b724-e601-46e9-97b4-b665427c1132 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 08 10:51:29.063529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 572/1131] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Nov 8 10:51:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:51:29.070498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3b519-2c9e-4b00-a23e-d69a981c2e90 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:29.081039 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3b519-2c9e-4b00-a23e-d69a981c2e90 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:29.088156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4dfe-181a-4857-a38e-45a5ee156897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:29.089004 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4dfe-181a-4857-a38e-45a5ee156897 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:29.089469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4dfe-181a-4857-a38e-45a5ee156897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:29.089752 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4dfe-181a-4857-a38e-45a5ee156897 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:29.090607 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa4dfe-181a-4857-a38e-45a5ee156897 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:29.090912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa4dfe-181a-4857-a38e-45a5ee156897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:29.092697 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa4dfe-181a-4857-a38e-45a5ee156897 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:29.102446 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 560/1132] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Nov 8 10:51:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:29.109344 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033b724-e601-46e9-97b4-b665427c1132 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:29.120173 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033b724-e601-46e9-97b4-b665427c1132 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:29.125854 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386b852-87ac-4a54-9d28-d1a25ce8cc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:29.126789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386b852-87ac-4a54-9d28-d1a25ce8cc36 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:29.127170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386b852-87ac-4a54-9d28-d1a25ce8cc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:29.127680 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386b852-87ac-4a54-9d28-d1a25ce8cc36 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:29.140085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386b852-87ac-4a54-9d28-d1a25ce8cc36 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:29.142960 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386b852-87ac-4a54-9d28-d1a25ce8cc36 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:29.164335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-9386b852-87ac-4a54-9d28-d1a25ce8cc36 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:51:29.165934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 573/1133] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:29.175804 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4dfe-181a-4857-a38e-45a5ee156897 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:29.186110 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4dfe-181a-4857-a38e-45a5ee156897 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:29.191238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecabeb-203c-4e9f-b2f5-17fddfa28a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:29.191959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecabeb-203c-4e9f-b2f5-17fddfa28a51 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:29.192235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecabeb-203c-4e9f-b2f5-17fddfa28a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:29.192486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecabeb-203c-4e9f-b2f5-17fddfa28a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:29.193225 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eecabeb-203c-4e9f-b2f5-17fddfa28a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:29.193527 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eecabeb-203c-4e9f-b2f5-17fddfa28a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:29.195248 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eecabeb-203c-4e9f-b2f5-17fddfa28a51 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:29.208127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 561/1134] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:51:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:29.215827 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386b852-87ac-4a54-9d28-d1a25ce8cc36 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:29.228141 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386b852-87ac-4a54-9d28-d1a25ce8cc36 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:29.233728 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112a94b-2663-4bb9-ada4-4fab20fb4a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:29.234639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112a94b-2663-4bb9-ada4-4fab20fb4a91 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:29.234939 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112a94b-2663-4bb9-ada4-4fab20fb4a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:29.235319 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112a94b-2663-4bb9-ada4-4fab20fb4a91 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:29.243331 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112a94b-2663-4bb9-ada4-4fab20fb4a91 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:29.245368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112a94b-2663-4bb9-ada4-4fab20fb4a91 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:29.259387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-f112a94b-2663-4bb9-ada4-4fab20fb4a91 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 08 10:51:29.260604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 574/1135] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:29 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:29.268058 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecabeb-203c-4e9f-b2f5-17fddfa28a51 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:29.278565 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecabeb-203c-4e9f-b2f5-17fddfa28a51 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:29.285293 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9be16a-baca-426b-9065-8cce40bf33a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:29.285958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9be16a-baca-426b-9065-8cce40bf33a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:29.286236 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9be16a-baca-426b-9065-8cce40bf33a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:29.286505 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9be16a-baca-426b-9065-8cce40bf33a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:29.287491 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9be16a-baca-426b-9065-8cce40bf33a6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:29.287795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9be16a-baca-426b-9065-8cce40bf33a6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:29.290470 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9be16a-baca-426b-9065-8cce40bf33a6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:29.309141 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 562/1136] 10.222.0.20 () {56 vars in 1164 bytes} [Mon Nov 8 10:51:29 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:29.315789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112a94b-2663-4bb9-ada4-4fab20fb4a91 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:29.325396 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112a94b-2663-4bb9-ada4-4fab20fb4a91 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:29.330095 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0689e-c535-48ea-bfff-53db056aed8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:29.330726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0689e-c535-48ea-bfff-53db056aed8f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:29.331004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0689e-c535-48ea-bfff-53db056aed8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:29.331308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0689e-c535-48ea-bfff-53db056aed8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:29.339068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0689e-c535-48ea-bfff-53db056aed8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:29.340855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0689e-c535-48ea-bfff-53db056aed8f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:29.350075 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 575/1137] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:51:29 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:51:29.357260 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9be16a-baca-426b-9065-8cce40bf33a6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:29.369356 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9be16a-baca-426b-9065-8cce40bf33a6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:29.374011 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8607f-b295-4677-9dfc-d5acaf0751c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:29.374800 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8607f-b295-4677-9dfc-d5acaf0751c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:29.375075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8607f-b295-4677-9dfc-d5acaf0751c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:29.375441 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8607f-b295-4677-9dfc-d5acaf0751c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:29.386007 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8607f-b295-4677-9dfc-d5acaf0751c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:29.389893 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8607f-b295-4677-9dfc-d5acaf0751c3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:29.407021 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-2fc8607f-b295-4677-9dfc-d5acaf0751c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:51:29.408300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 563/1138] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:29.415156 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0689e-c535-48ea-bfff-53db056aed8f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:29.424166 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0689e-c535-48ea-bfff-53db056aed8f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:29.428927 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffcf61-29dc-4446-9f78-128a0d163917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:29.429577 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffcf61-29dc-4446-9f78-128a0d163917 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:29.429872 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffcf61-29dc-4446-9f78-128a0d163917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:29.430125 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffcf61-29dc-4446-9f78-128a0d163917 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:29.430882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffcf61-29dc-4446-9f78-128a0d163917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:29.431197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffcf61-29dc-4446-9f78-128a0d163917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:29.432829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffcf61-29dc-4446-9f78-128a0d163917 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:29.444614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 576/1139] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:51:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:29.451373 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8607f-b295-4677-9dfc-d5acaf0751c3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:29.461223 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8607f-b295-4677-9dfc-d5acaf0751c3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:29.467566 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df4a76-3c8d-4c88-85d4-83b694d35d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:29.468292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df4a76-3c8d-4c88-85d4-83b694d35d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:29.468664 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df4a76-3c8d-4c88-85d4-83b694d35d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:29.469053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df4a76-3c8d-4c88-85d4-83b694d35d48 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:29.478893 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df4a76-3c8d-4c88-85d4-83b694d35d48 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:29.481710 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df4a76-3c8d-4c88-85d4-83b694d35d48 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:29.498863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-27df4a76-3c8d-4c88-85d4-83b694d35d48 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:51:29.500354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 564/1140] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:51:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:29.507251 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffcf61-29dc-4446-9f78-128a0d163917 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:29.517312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffcf61-29dc-4446-9f78-128a0d163917 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:29.521973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f749982-ea6e-4a6d-8d96-82e009a4fb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:29.522964 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f749982-ea6e-4a6d-8d96-82e009a4fb92 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:29.523275 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f749982-ea6e-4a6d-8d96-82e009a4fb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:29.523570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f749982-ea6e-4a6d-8d96-82e009a4fb92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:29.524533 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f749982-ea6e-4a6d-8d96-82e009a4fb92 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:29.524845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f749982-ea6e-4a6d-8d96-82e009a4fb92 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:29.526689 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f749982-ea6e-4a6d-8d96-82e009a4fb92 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:29.540112 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 577/1141] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:51:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:29.547037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df4a76-3c8d-4c88-85d4-83b694d35d48 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:29.557601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df4a76-3c8d-4c88-85d4-83b694d35d48 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:29.562690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac99f9-ed7f-4ca9-beee-7303de2f878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:29.563365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac99f9-ed7f-4ca9-beee-7303de2f878c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:29.563682 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac99f9-ed7f-4ca9-beee-7303de2f878c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:29.564000 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac99f9-ed7f-4ca9-beee-7303de2f878c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:29.564900 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac99f9-ed7f-4ca9-beee-7303de2f878c admin admin] RBAC: Adding query filter params (role.id=2ba23f9ef2de43a6bf86f97ccf919c68, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=642c2b97ece34d69bacd821b108bd210) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:29.565226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac99f9-ed7f-4ca9-beee-7303de2f878c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:29.567238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac99f9-ed7f-4ca9-beee-7303de2f878c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:29.573203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 565/1142] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:51:29 2021] GET /identity/v3/role_assignments?user.id=642c2b97ece34d69bacd821b108bd210&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=2ba23f9ef2de43a6bf86f97ccf919c68 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:32.042006 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa99e7-b175-4574-bbe4-cda3634deb51 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:32.042591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa99e7-b175-4574-bbe4-cda3634deb51 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:32.042591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa99e7-b175-4574-bbe4-cda3634deb51 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:32.044409 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 578/1143] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:51:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:51:32.050930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d3685-afa7-4f59-8430-8bff6a5eb06b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:32.051565 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d3685-afa7-4f59-8430-8bff6a5eb06b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:32.051665 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d3685-afa7-4f59-8430-8bff6a5eb06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:32.069501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8b4d3685-afa7-4f59-8430-8bff6a5eb06b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:51:32.070754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8b4d3685-afa7-4f59-8430-8bff6a5eb06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:51:32.078640 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 566/1144] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:51:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:51:32.103403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa99e7-b175-4574-bbe4-cda3634deb51 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:32.118062 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa99e7-b175-4574-bbe4-cda3634deb51 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:32.123222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20134b3b-925d-49e7-b9bf-3112a672c67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:32.124291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20134b3b-925d-49e7-b9bf-3112a672c67f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:32.124677 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20134b3b-925d-49e7-b9bf-3112a672c67f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:32.124992 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20134b3b-925d-49e7-b9bf-3112a672c67f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:32.139467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20134b3b-925d-49e7-b9bf-3112a672c67f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:51:32.147513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-20134b3b-925d-49e7-b9bf-3112a672c67f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:51:32.148859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 579/1145] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:51:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:32.156278 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d3685-afa7-4f59-8430-8bff6a5eb06b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:32.166921 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d3685-afa7-4f59-8430-8bff6a5eb06b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:32.172896 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d13d2f-a72b-4db6-a12d-496f8fe56e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:32.174083 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d13d2f-a72b-4db6-a12d-496f8fe56e36 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:32.174403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d13d2f-a72b-4db6-a12d-496f8fe56e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:32.175640 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d13d2f-a72b-4db6-a12d-496f8fe56e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:32.175640 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d13d2f-a72b-4db6-a12d-496f8fe56e36 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:32.175856 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d13d2f-a72b-4db6-a12d-496f8fe56e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:32.177502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d13d2f-a72b-4db6-a12d-496f8fe56e36 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:32.187104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 567/1146] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:51:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:32.194231 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20134b3b-925d-49e7-b9bf-3112a672c67f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:32.204266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20134b3b-925d-49e7-b9bf-3112a672c67f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:32.208788 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38756ab-1ba5-47f6-b759-707c3ba0f576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:32.209572 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38756ab-1ba5-47f6-b759-707c3ba0f576 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:32.209852 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38756ab-1ba5-47f6-b759-707c3ba0f576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:32.210122 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38756ab-1ba5-47f6-b759-707c3ba0f576 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:32.221341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38756ab-1ba5-47f6-b759-707c3ba0f576 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:32.223283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38756ab-1ba5-47f6-b759-707c3ba0f576 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:32.239954 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-e38756ab-1ba5-47f6-b759-707c3ba0f576 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:51:32.241125 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 580/1147] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:51:32.248004 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d13d2f-a72b-4db6-a12d-496f8fe56e36 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:32.260624 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d13d2f-a72b-4db6-a12d-496f8fe56e36 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:32.265976 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27640f5a-96cf-44a8-bd3b-f8747f778e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:32.266644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27640f5a-96cf-44a8-bd3b-f8747f778e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:32.267236 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27640f5a-96cf-44a8-bd3b-f8747f778e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:32.267547 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27640f5a-96cf-44a8-bd3b-f8747f778e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:32.268360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27640f5a-96cf-44a8-bd3b-f8747f778e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:32.268692 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27640f5a-96cf-44a8-bd3b-f8747f778e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:32.270430 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27640f5a-96cf-44a8-bd3b-f8747f778e66 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:32.284472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 568/1148] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:51:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:32.291396 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38756ab-1ba5-47f6-b759-707c3ba0f576 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:32.302111 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38756ab-1ba5-47f6-b759-707c3ba0f576 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:32.306768 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc325796-db0f-4c0d-aa8b-0bacf6100269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:32.307613 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc325796-db0f-4c0d-aa8b-0bacf6100269 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:32.307878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc325796-db0f-4c0d-aa8b-0bacf6100269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:32.308149 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc325796-db0f-4c0d-aa8b-0bacf6100269 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:32.316470 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc325796-db0f-4c0d-aa8b-0bacf6100269 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:32.318497 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc325796-db0f-4c0d-aa8b-0bacf6100269 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:32.332182 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-dc325796-db0f-4c0d-aa8b-0bacf6100269 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 08 10:51:32.333553 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 581/1149] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:32 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:32.340415 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27640f5a-96cf-44a8-bd3b-f8747f778e66 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:32.350257 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27640f5a-96cf-44a8-bd3b-f8747f778e66 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:32.355010 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d05a37-adfb-423e-ba54-0420f99c312e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:32.355707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d05a37-adfb-423e-ba54-0420f99c312e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:32.356079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d05a37-adfb-423e-ba54-0420f99c312e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:32.356374 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d05a37-adfb-423e-ba54-0420f99c312e admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:32.357294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d05a37-adfb-423e-ba54-0420f99c312e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:32.357658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d05a37-adfb-423e-ba54-0420f99c312e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:32.359597 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d05a37-adfb-423e-ba54-0420f99c312e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:32.378838 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 569/1150] 10.222.0.20 () {56 vars in 1164 bytes} [Mon Nov 8 10:51:32 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:32.385577 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc325796-db0f-4c0d-aa8b-0bacf6100269 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:32.396833 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc325796-db0f-4c0d-aa8b-0bacf6100269 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:32.401589 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635540ce-b7bc-4225-817c-ed68606f66cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:32.402244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635540ce-b7bc-4225-817c-ed68606f66cd admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:32.402521 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635540ce-b7bc-4225-817c-ed68606f66cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:32.402789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635540ce-b7bc-4225-817c-ed68606f66cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:32.411415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635540ce-b7bc-4225-817c-ed68606f66cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:32.413215 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635540ce-b7bc-4225-817c-ed68606f66cd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:32.422952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 582/1151] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:51:32 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:51:32.429664 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d05a37-adfb-423e-ba54-0420f99c312e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:32.440514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d05a37-adfb-423e-ba54-0420f99c312e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:32.445883 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240d9bb-b37d-4e17-ad32-2ea7cd2f2fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:32.446838 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d9bb-b37d-4e17-ad32-2ea7cd2f2fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:32.447228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d9bb-b37d-4e17-ad32-2ea7cd2f2fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:32.447460 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d9bb-b37d-4e17-ad32-2ea7cd2f2fd3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:32.459177 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240d9bb-b37d-4e17-ad32-2ea7cd2f2fd3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:32.461330 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240d9bb-b37d-4e17-ad32-2ea7cd2f2fd3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:32.480087 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-8240d9bb-b37d-4e17-ad32-2ea7cd2f2fd3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:51:32.481455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 570/1152] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:51:32.488664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635540ce-b7bc-4225-817c-ed68606f66cd admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:32.502058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635540ce-b7bc-4225-817c-ed68606f66cd admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:32.508485 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ede3c-8a07-4257-b15f-19dfda29bc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:32.509164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ede3c-8a07-4257-b15f-19dfda29bc76 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:32.509450 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ede3c-8a07-4257-b15f-19dfda29bc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:32.509727 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ede3c-8a07-4257-b15f-19dfda29bc76 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:32.510478 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ede3c-8a07-4257-b15f-19dfda29bc76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:32.510786 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ede3c-8a07-4257-b15f-19dfda29bc76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:32.512431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ede3c-8a07-4257-b15f-19dfda29bc76 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:32.526479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 583/1153] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:51:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:32.533230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240d9bb-b37d-4e17-ad32-2ea7cd2f2fd3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:32.544905 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240d9bb-b37d-4e17-ad32-2ea7cd2f2fd3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:32.550915 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5e64e-f094-4452-837a-016783d7e0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:32.551746 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5e64e-f094-4452-837a-016783d7e0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:32.552029 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5e64e-f094-4452-837a-016783d7e0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:32.552353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5e64e-f094-4452-837a-016783d7e0a9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:32.559379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5e64e-f094-4452-837a-016783d7e0a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:32.561363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5e64e-f094-4452-837a-016783d7e0a9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:32.576720 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-6dd5e64e-f094-4452-837a-016783d7e0a9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:51:32.578158 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 571/1154] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:51:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:51:32.585633 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ede3c-8a07-4257-b15f-19dfda29bc76 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:32.597634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ede3c-8a07-4257-b15f-19dfda29bc76 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:32.602380 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150c700-8d76-49a7-80c7-6723eea02fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:32.603034 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150c700-8d76-49a7-80c7-6723eea02fdc admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:32.603340 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150c700-8d76-49a7-80c7-6723eea02fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:32.603609 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150c700-8d76-49a7-80c7-6723eea02fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:32.604421 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150c700-8d76-49a7-80c7-6723eea02fdc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:32.604713 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150c700-8d76-49a7-80c7-6723eea02fdc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:32.606572 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150c700-8d76-49a7-80c7-6723eea02fdc admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:32.619205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 584/1155] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:51:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:51:32.626744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5e64e-f094-4452-837a-016783d7e0a9 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:32.637146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5e64e-f094-4452-837a-016783d7e0a9 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:32.642018 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e6f84-53a8-4887-932e-280349d084f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:32.642742 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e6f84-53a8-4887-932e-280349d084f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:32.643017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e6f84-53a8-4887-932e-280349d084f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:32.643319 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e6f84-53a8-4887-932e-280349d084f4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:32.644168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e6f84-53a8-4887-932e-280349d084f4 admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=642c2b97ece34d69bacd821b108bd210) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:32.644467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e6f84-53a8-4887-932e-280349d084f4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:32.646345 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e6f84-53a8-4887-932e-280349d084f4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:32.652193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 572/1156] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:51:32 2021] GET /identity/v3/role_assignments?user.id=642c2b97ece34d69bacd821b108bd210&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:34.982073 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bc099-b193-43d3-9ca3-d6781a64b201 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:34.982674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bc099-b193-43d3-9ca3-d6781a64b201 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:34.982674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bc099-b193-43d3-9ca3-d6781a64b201 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:34.984605 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 585/1157] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:51:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:51:34.991005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf29ae-21b6-4136-baf9-1c183e8beb1d None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:34.991005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf29ae-21b6-4136-baf9-1c183e8beb1d None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:34.991581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf29ae-21b6-4136-baf9-1c183e8beb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:35.009730 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-abbf29ae-21b6-4136-baf9-1c183e8beb1d None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:51:35.010917 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-abbf29ae-21b6-4136-baf9-1c183e8beb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:51:35.019117 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 573/1158] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:51:34 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:51:35.042896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bc099-b193-43d3-9ca3-d6781a64b201 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:35.056794 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bc099-b193-43d3-9ca3-d6781a64b201 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:35.062435 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee05d6-056d-4f74-ae35-069ce1805982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:35.063546 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee05d6-056d-4f74-ae35-069ce1805982 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:35.064010 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee05d6-056d-4f74-ae35-069ce1805982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:35.064699 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee05d6-056d-4f74-ae35-069ce1805982 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:35.077524 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee05d6-056d-4f74-ae35-069ce1805982 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:51:35.085717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-84ee05d6-056d-4f74-ae35-069ce1805982 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:51:35.086949 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 586/1159] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:51:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:35.093861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf29ae-21b6-4136-baf9-1c183e8beb1d None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:35.103054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf29ae-21b6-4136-baf9-1c183e8beb1d None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:35.107648 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470983a3-0e93-4e5a-8769-51f9826cf349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:35.108324 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470983a3-0e93-4e5a-8769-51f9826cf349 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:35.108601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470983a3-0e93-4e5a-8769-51f9826cf349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:35.108870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470983a3-0e93-4e5a-8769-51f9826cf349 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:35.110261 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470983a3-0e93-4e5a-8769-51f9826cf349 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:35.110735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470983a3-0e93-4e5a-8769-51f9826cf349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:35.112450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470983a3-0e93-4e5a-8769-51f9826cf349 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:35.120860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 574/1160] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:51:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:35.127656 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee05d6-056d-4f74-ae35-069ce1805982 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:35.138512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee05d6-056d-4f74-ae35-069ce1805982 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:35.144183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab3447-5bb8-43c3-a606-6e95e4e11cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:35.144945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab3447-5bb8-43c3-a606-6e95e4e11cec admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:35.145252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab3447-5bb8-43c3-a606-6e95e4e11cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:35.145489 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab3447-5bb8-43c3-a606-6e95e4e11cec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:35.156545 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab3447-5bb8-43c3-a606-6e95e4e11cec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:35.158805 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab3447-5bb8-43c3-a606-6e95e4e11cec admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:35.178586 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-0dab3447-5bb8-43c3-a606-6e95e4e11cec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:51:35.179914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 587/1161] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:35.186944 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470983a3-0e93-4e5a-8769-51f9826cf349 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:35.199593 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470983a3-0e93-4e5a-8769-51f9826cf349 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:35.205944 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c05067-6b33-437e-8580-5b4873dfda6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:35.206609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c05067-6b33-437e-8580-5b4873dfda6a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:35.206888 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c05067-6b33-437e-8580-5b4873dfda6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:35.207581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c05067-6b33-437e-8580-5b4873dfda6a admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:35.207993 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c05067-6b33-437e-8580-5b4873dfda6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:35.208199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c05067-6b33-437e-8580-5b4873dfda6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:35.209813 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c05067-6b33-437e-8580-5b4873dfda6a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:35.222404 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 575/1162] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:51:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:51:35.229060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab3447-5bb8-43c3-a606-6e95e4e11cec admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:35.239039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab3447-5bb8-43c3-a606-6e95e4e11cec admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:35.243413 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4088cd8-db2b-45d3-90ae-5d9266d247eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:35.244197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4088cd8-db2b-45d3-90ae-5d9266d247eb admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:35.244477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4088cd8-db2b-45d3-90ae-5d9266d247eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:35.244754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4088cd8-db2b-45d3-90ae-5d9266d247eb admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:35.252881 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4088cd8-db2b-45d3-90ae-5d9266d247eb admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:35.254919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4088cd8-db2b-45d3-90ae-5d9266d247eb admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:35.269310 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-f4088cd8-db2b-45d3-90ae-5d9266d247eb admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 08 10:51:35.270502 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 588/1163] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:35 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:35.277127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c05067-6b33-437e-8580-5b4873dfda6a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:35.287652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c05067-6b33-437e-8580-5b4873dfda6a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:35.293005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a36666-3331-4e92-a856-741c9ada1e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:35.293684 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36666-3331-4e92-a856-741c9ada1e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:35.293961 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36666-3331-4e92-a856-741c9ada1e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:35.294231 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36666-3331-4e92-a856-741c9ada1e04 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:35.295099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a36666-3331-4e92-a856-741c9ada1e04 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:35.295439 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a36666-3331-4e92-a856-741c9ada1e04 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:35.298890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a36666-3331-4e92-a856-741c9ada1e04 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:35.318842 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 576/1164] 10.222.0.20 () {56 vars in 1164 bytes} [Mon Nov 8 10:51:35 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:35.325624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4088cd8-db2b-45d3-90ae-5d9266d247eb admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:35.336849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4088cd8-db2b-45d3-90ae-5d9266d247eb admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:35.341988 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a31ec-9ffd-4081-88a6-0d217536608a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:35.342776 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a31ec-9ffd-4081-88a6-0d217536608a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:35.343053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a31ec-9ffd-4081-88a6-0d217536608a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:35.343352 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a31ec-9ffd-4081-88a6-0d217536608a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:35.354669 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a31ec-9ffd-4081-88a6-0d217536608a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:35.356558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a31ec-9ffd-4081-88a6-0d217536608a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:35.373601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-691a31ec-9ffd-4081-88a6-0d217536608a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:51:35.374796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 589/1165] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:35.381795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a36666-3331-4e92-a856-741c9ada1e04 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:35.394676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a36666-3331-4e92-a856-741c9ada1e04 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:35.400220 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33787522-2bd8-42e2-9c52-875c21d31bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:35.401203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33787522-2bd8-42e2-9c52-875c21d31bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:35.401528 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33787522-2bd8-42e2-9c52-875c21d31bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:35.401852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33787522-2bd8-42e2-9c52-875c21d31bd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:35.402857 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33787522-2bd8-42e2-9c52-875c21d31bd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:35.403246 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33787522-2bd8-42e2-9c52-875c21d31bd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:35.405123 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33787522-2bd8-42e2-9c52-875c21d31bd6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:35.424179 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 577/1166] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:51:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:35.430563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a31ec-9ffd-4081-88a6-0d217536608a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:35.441872 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a31ec-9ffd-4081-88a6-0d217536608a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:35.447703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85228936-ac4c-4dea-bc27-6b1c505046e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:35.448571 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85228936-ac4c-4dea-bc27-6b1c505046e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:35.448953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85228936-ac4c-4dea-bc27-6b1c505046e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:35.449260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85228936-ac4c-4dea-bc27-6b1c505046e7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:35.457349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85228936-ac4c-4dea-bc27-6b1c505046e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:35.459438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85228936-ac4c-4dea-bc27-6b1c505046e7 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:35.473344 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-85228936-ac4c-4dea-bc27-6b1c505046e7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:51:35.474772 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 590/1167] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:51:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:51:35.481227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33787522-2bd8-42e2-9c52-875c21d31bd6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:35.493569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33787522-2bd8-42e2-9c52-875c21d31bd6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:35.499017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff87c2-d717-4fc2-ba91-055c34aa0b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:35.499820 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff87c2-d717-4fc2-ba91-055c34aa0b29 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:35.500164 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff87c2-d717-4fc2-ba91-055c34aa0b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:35.500559 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff87c2-d717-4fc2-ba91-055c34aa0b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:35.501646 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff87c2-d717-4fc2-ba91-055c34aa0b29 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:35.501949 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff87c2-d717-4fc2-ba91-055c34aa0b29 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:35.504064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff87c2-d717-4fc2-ba91-055c34aa0b29 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:35.518580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 578/1168] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:51:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:51:35.525897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85228936-ac4c-4dea-bc27-6b1c505046e7 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:35.537527 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85228936-ac4c-4dea-bc27-6b1c505046e7 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:35.543322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec8315-6a22-40e6-8c58-26c6422cdeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:35.544271 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec8315-6a22-40e6-8c58-26c6422cdeb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:35.544500 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec8315-6a22-40e6-8c58-26c6422cdeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:35.544774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec8315-6a22-40e6-8c58-26c6422cdeb1 admin admin] PATH_INFO: `/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/642c2b97ece34d69bacd821b108bd210/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:35.546849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec8315-6a22-40e6-8c58-26c6422cdeb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ae5e80b1f745dfaedd81a2c0ded718, user_id=642c2b97ece34d69bacd821b108bd210, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:35.549718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec8315-6a22-40e6-8c58-26c6422cdeb1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:35.562399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 591/1169] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Nov 8 10:51:35 2021] PUT /identity/v3/projects/41ae5e80b1f745dfaedd81a2c0ded718/users/642c2b97ece34d69bacd821b108bd210/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:51:37.909814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e48ad3-d0dd-4703-8c3b-12ed723c5421 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:37.910735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e48ad3-d0dd-4703-8c3b-12ed723c5421 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:37.910735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e48ad3-d0dd-4703-8c3b-12ed723c5421 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:37.913502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 579/1170] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:51:37 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:51:37.923738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0bbf-4ad5-48b1-bf13-b1b86419e941 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:37.924641 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0bbf-4ad5-48b1-bf13-b1b86419e941 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:37.924641 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0bbf-4ad5-48b1-bf13-b1b86419e941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:37.948930 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-335e0bbf-4ad5-48b1-bf13-b1b86419e941 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:51:37.950148 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-335e0bbf-4ad5-48b1-bf13-b1b86419e941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:51:38.014081 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 592/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:51:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:51:38.045862 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e48ad3-d0dd-4703-8c3b-12ed723c5421 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:38.061380 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e48ad3-d0dd-4703-8c3b-12ed723c5421 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:38.067012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5399e-f748-43aa-a697-e011a01a514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:38.067829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5399e-f748-43aa-a697-e011a01a514a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:38.068105 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5399e-f748-43aa-a697-e011a01a514a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:38.068374 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5399e-f748-43aa-a697-e011a01a514a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:38.080082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5399e-f748-43aa-a697-e011a01a514a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 08 10:51:38.086734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-50f5399e-f748-43aa-a697-e011a01a514a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 08 10:51:38.087897 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 580/1172] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Nov 8 10:51:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:38.094496 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e0bbf-4ad5-48b1-bf13-b1b86419e941 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:38.103935 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e0bbf-4ad5-48b1-bf13-b1b86419e941 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:38.108940 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383de8ac-24eb-4445-9a94-dec077b8a255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:38.109587 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383de8ac-24eb-4445-9a94-dec077b8a255 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:38.109863 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383de8ac-24eb-4445-9a94-dec077b8a255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:38.110133 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383de8ac-24eb-4445-9a94-dec077b8a255 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:38.111006 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383de8ac-24eb-4445-9a94-dec077b8a255 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:38.111340 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383de8ac-24eb-4445-9a94-dec077b8a255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:38.112926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383de8ac-24eb-4445-9a94-dec077b8a255 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:38.121966 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 593/1173] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Nov 8 10:51:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:38.129218 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5399e-f748-43aa-a697-e011a01a514a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:38.145113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5399e-f748-43aa-a697-e011a01a514a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:38.150440 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a703c4d-1097-447a-961f-4af739bf5eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:38.151371 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a703c4d-1097-447a-961f-4af739bf5eee admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:38.151692 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a703c4d-1097-447a-961f-4af739bf5eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:38.152046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a703c4d-1097-447a-961f-4af739bf5eee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:38.164635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a703c4d-1097-447a-961f-4af739bf5eee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:38.166560 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a703c4d-1097-447a-961f-4af739bf5eee admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:38.184590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-1a703c4d-1097-447a-961f-4af739bf5eee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:51:38.185949 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 581/1174] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:38.193838 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383de8ac-24eb-4445-9a94-dec077b8a255 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:38.204200 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383de8ac-24eb-4445-9a94-dec077b8a255 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:38.209051 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7bdeb-3c2d-4118-a15a-a0d3fc0212db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:38.209702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7bdeb-3c2d-4118-a15a-a0d3fc0212db admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:38.210003 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7bdeb-3c2d-4118-a15a-a0d3fc0212db admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:38.210275 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7bdeb-3c2d-4118-a15a-a0d3fc0212db admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:38.211006 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7bdeb-3c2d-4118-a15a-a0d3fc0212db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:38.211346 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7bdeb-3c2d-4118-a15a-a0d3fc0212db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:38.212938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7bdeb-3c2d-4118-a15a-a0d3fc0212db admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:38.224627 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 594/1175] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:51:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:38.230870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a703c4d-1097-447a-961f-4af739bf5eee admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:38.241249 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a703c4d-1097-447a-961f-4af739bf5eee admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:38.246689 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f43296-608b-4ff8-b2b1-6f76f08a9854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:38.247500 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f43296-608b-4ff8-b2b1-6f76f08a9854 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:38.247782 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f43296-608b-4ff8-b2b1-6f76f08a9854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:38.248048 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f43296-608b-4ff8-b2b1-6f76f08a9854 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:38.256140 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f43296-608b-4ff8-b2b1-6f76f08a9854 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:38.258159 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f43296-608b-4ff8-b2b1-6f76f08a9854 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:38.273935 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-41f43296-608b-4ff8-b2b1-6f76f08a9854 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 08 10:51:38.275031 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 582/1176] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:38 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:38.282046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7bdeb-3c2d-4118-a15a-a0d3fc0212db admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:38.298593 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7bdeb-3c2d-4118-a15a-a0d3fc0212db admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:38.305058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044277e-62e3-4075-a1c4-78dc40873556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:38.305711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044277e-62e3-4075-a1c4-78dc40873556 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:38.305993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044277e-62e3-4075-a1c4-78dc40873556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:38.306264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044277e-62e3-4075-a1c4-78dc40873556 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:38.307112 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044277e-62e3-4075-a1c4-78dc40873556 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:38.307450 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044277e-62e3-4075-a1c4-78dc40873556 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:38.309293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044277e-62e3-4075-a1c4-78dc40873556 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:38.328108 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 595/1177] 10.222.0.20 () {56 vars in 1164 bytes} [Mon Nov 8 10:51:38 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:38.337785 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f43296-608b-4ff8-b2b1-6f76f08a9854 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:38.354676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f43296-608b-4ff8-b2b1-6f76f08a9854 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:38.362814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efd5bd-f9c2-4f98-98a9-540a2f6df059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:38.363469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efd5bd-f9c2-4f98-98a9-540a2f6df059 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:38.363744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efd5bd-f9c2-4f98-98a9-540a2f6df059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:38.364007 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efd5bd-f9c2-4f98-98a9-540a2f6df059 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:38.372278 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efd5bd-f9c2-4f98-98a9-540a2f6df059 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:38.374028 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efd5bd-f9c2-4f98-98a9-540a2f6df059 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:38.383010 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 583/1178] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Nov 8 10:51:38 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:51:38.389657 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044277e-62e3-4075-a1c4-78dc40873556 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:38.401224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044277e-62e3-4075-a1c4-78dc40873556 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:38.407356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03137408-6be6-434a-bc59-4584a877c36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:38.407966 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03137408-6be6-434a-bc59-4584a877c36c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:38.408246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03137408-6be6-434a-bc59-4584a877c36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:38.408516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03137408-6be6-434a-bc59-4584a877c36c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:38.420571 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03137408-6be6-434a-bc59-4584a877c36c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:38.422405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03137408-6be6-434a-bc59-4584a877c36c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:38.439951 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-03137408-6be6-434a-bc59-4584a877c36c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 08 10:51:38.441093 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 596/1179] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Nov 8 10:51:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:51:38.450813 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efd5bd-f9c2-4f98-98a9-540a2f6df059 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:38.464770 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efd5bd-f9c2-4f98-98a9-540a2f6df059 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:38.471394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844aba2-0b71-4316-91f3-073320dc3d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:38.472049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844aba2-0b71-4316-91f3-073320dc3d61 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:38.472326 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844aba2-0b71-4316-91f3-073320dc3d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:38.472588 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844aba2-0b71-4316-91f3-073320dc3d61 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:38.473314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844aba2-0b71-4316-91f3-073320dc3d61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:38.473612 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844aba2-0b71-4316-91f3-073320dc3d61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:38.475337 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844aba2-0b71-4316-91f3-073320dc3d61 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:38.487227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 584/1180] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Nov 8 10:51:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:38.493596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03137408-6be6-434a-bc59-4584a877c36c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:38.503965 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03137408-6be6-434a-bc59-4584a877c36c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:38.509908 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0c778-09a5-40d6-a9c6-37c8788991b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:38.510695 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0c778-09a5-40d6-a9c6-37c8788991b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:38.510974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0c778-09a5-40d6-a9c6-37c8788991b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:38.511284 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0c778-09a5-40d6-a9c6-37c8788991b1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:38.519214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0c778-09a5-40d6-a9c6-37c8788991b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:38.521198 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0c778-09a5-40d6-a9c6-37c8788991b1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:38.537574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-a8b0c778-09a5-40d6-a9c6-37c8788991b1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 08 10:51:38.538718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 597/1181] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Nov 8 10:51:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 08 10:51:38.549206 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844aba2-0b71-4316-91f3-073320dc3d61 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:38.564597 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844aba2-0b71-4316-91f3-073320dc3d61 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:38.571097 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe72e8-8125-4510-b406-73a88f661ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:38.571772 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe72e8-8125-4510-b406-73a88f661ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:38.572047 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe72e8-8125-4510-b406-73a88f661ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:38.572312 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe72e8-8125-4510-b406-73a88f661ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:38.573112 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe72e8-8125-4510-b406-73a88f661ec6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:38.573418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe72e8-8125-4510-b406-73a88f661ec6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:38.575289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe72e8-8125-4510-b406-73a88f661ec6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:38.587641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 585/1182] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Nov 8 10:51:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:38.594259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0c778-09a5-40d6-a9c6-37c8788991b1 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:38.605792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0c778-09a5-40d6-a9c6-37c8788991b1 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:38.612071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b593b-4a13-4317-b863-0d4c1d3e8e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:38.612699 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b593b-4a13-4317-b863-0d4c1d3e8e4b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:38.612973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b593b-4a13-4317-b863-0d4c1d3e8e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:38.613245 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b593b-4a13-4317-b863-0d4c1d3e8e4b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:38.614085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b593b-4a13-4317-b863-0d4c1d3e8e4b admin admin] RBAC: Adding query filter params (role.id=c3d6b512a6934e798c32e75657cf3060, scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718, user.id=642c2b97ece34d69bacd821b108bd210) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:38.614392 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b593b-4a13-4317-b863-0d4c1d3e8e4b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:38.616247 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b593b-4a13-4317-b863-0d4c1d3e8e4b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:38.622925 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 598/1183] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Nov 8 10:51:38 2021] GET /identity/v3/role_assignments?user.id=642c2b97ece34d69bacd821b108bd210&scope.project.id=41ae5e80b1f745dfaedd81a2c0ded718&role.id=c3d6b512a6934e798c32e75657cf3060 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:51:40.882076 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993488-48d5-4526-aa45-6fdf4fe2599a None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:40.882603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993488-48d5-4526-aa45-6fdf4fe2599a None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:40.882603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993488-48d5-4526-aa45-6fdf4fe2599a None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:40.884335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 586/1184] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:51:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:51:40.891777 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac04175-e050-4fcd-9b55-7e502438fd71 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:40.892488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac04175-e050-4fcd-9b55-7e502438fd71 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:40.892632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac04175-e050-4fcd-9b55-7e502438fd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:40.917585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-fac04175-e050-4fcd-9b55-7e502438fd71 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:51:40.918795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-fac04175-e050-4fcd-9b55-7e502438fd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:51:40.931818 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 599/1185] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:51:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:51:40.955632 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a993488-48d5-4526-aa45-6fdf4fe2599a None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:40.974568 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a993488-48d5-4526-aa45-6fdf4fe2599a None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:40.980519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce278c-59a1-440d-b50d-9103d7b3e4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:40.981295 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce278c-59a1-440d-b50d-9103d7b3e4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:40.981574 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce278c-59a1-440d-b50d-9103d7b3e4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:40.981839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce278c-59a1-440d-b50d-9103d7b3e4a9 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:40.982502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce278c-59a1-440d-b50d-9103d7b3e4a9 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:40.984161 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce278c-59a1-440d-b50d-9103d7b3e4a9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:40.995071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-2bce278c-59a1-440d-b50d-9103d7b3e4a9 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 08 10:51:40.996180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 587/1186] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Nov 8 10:51:40 2021] GET /identity/v3/services/placement => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:41.003750 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac04175-e050-4fcd-9b55-7e502438fd71 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:41.019002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac04175-e050-4fcd-9b55-7e502438fd71 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:41.028194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498b31c-9f31-48bc-a737-5977ebbcfc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:41.029197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498b31c-9f31-48bc-a737-5977ebbcfc87 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:41.029595 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498b31c-9f31-48bc-a737-5977ebbcfc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:41.029958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498b31c-9f31-48bc-a737-5977ebbcfc87 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:41.031068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498b31c-9f31-48bc-a737-5977ebbcfc87 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:41.031514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498b31c-9f31-48bc-a737-5977ebbcfc87 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:41.033694 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498b31c-9f31-48bc-a737-5977ebbcfc87 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:41.039025 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 600/1187] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Nov 8 10:51:41 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:41.045148 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce278c-59a1-440d-b50d-9103d7b3e4a9 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:41.055864 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce278c-59a1-440d-b50d-9103d7b3e4a9 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:41.061580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27bb72-c6ae-4c14-af96-4386adedd1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:41.062201 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27bb72-c6ae-4c14-af96-4386adedd1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:41.062477 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27bb72-c6ae-4c14-af96-4386adedd1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:41.062744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27bb72-c6ae-4c14-af96-4386adedd1e6 admin admin] PATH_INFO: `/v3/services` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:41.063703 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27bb72-c6ae-4c14-af96-4386adedd1e6 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:41.064057 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27bb72-c6ae-4c14-af96-4386adedd1e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:41.065605 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27bb72-c6ae-4c14-af96-4386adedd1e6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:41.070877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 588/1188] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Nov 8 10:51:41 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:43.335798 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec96e19-41d1-4bba-90c1-48511a7fc6d4 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:43.336421 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec96e19-41d1-4bba-90c1-48511a7fc6d4 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:43.336515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec96e19-41d1-4bba-90c1-48511a7fc6d4 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:43.338580 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 601/1189] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:51:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:51:43.345966 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce718d36-0eec-4b79-93df-d508fc6f9697 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:43.346401 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce718d36-0eec-4b79-93df-d508fc6f9697 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:43.346618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce718d36-0eec-4b79-93df-d508fc6f9697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:43.366316 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-ce718d36-0eec-4b79-93df-d508fc6f9697 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:51:43.367574 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-ce718d36-0eec-4b79-93df-d508fc6f9697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:51:43.376882 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 589/1190] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:51:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:51:43.402275 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec96e19-41d1-4bba-90c1-48511a7fc6d4 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:43.424465 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec96e19-41d1-4bba-90c1-48511a7fc6d4 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:43.430272 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa63f8-5aba-4fc1-8542-8788d71fa8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:43.430920 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa63f8-5aba-4fc1-8542-8788d71fa8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:43.431200 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa63f8-5aba-4fc1-8542-8788d71fa8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:43.431498 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa63f8-5aba-4fc1-8542-8788d71fa8a9 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:43.432235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa63f8-5aba-4fc1-8542-8788d71fa8a9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:43.433818 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa63f8-5aba-4fc1-8542-8788d71fa8a9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:43.454977 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 602/1191] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Nov 8 10:51:43 2021] POST /identity/v3/services => generated 246 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:51:45.703702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8e7b7-f7e2-495d-858a-217de3f636ad None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:45.704545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8e7b7-f7e2-495d-858a-217de3f636ad None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:45.704545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8e7b7-f7e2-495d-858a-217de3f636ad None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:45.707630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 590/1192] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:51:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:51:45.716887 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544cd85-d593-4a26-a869-9a5dc62a4066 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:45.717354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544cd85-d593-4a26-a869-9a5dc62a4066 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:45.717451 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544cd85-d593-4a26-a869-9a5dc62a4066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:45.737114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-f544cd85-d593-4a26-a869-9a5dc62a4066 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:51:45.738296 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f544cd85-d593-4a26-a869-9a5dc62a4066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:51:45.761209 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 603/1193] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:51:45 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:51:45.788968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8e7b7-f7e2-495d-858a-217de3f636ad None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:45.804526 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8e7b7-f7e2-495d-858a-217de3f636ad None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:45.810569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5a04d-7b0b-413c-93d5-7cd8b8e597e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:45.811388 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5a04d-7b0b-413c-93d5-7cd8b8e597e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:45.811676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5a04d-7b0b-413c-93d5-7cd8b8e597e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:45.811946 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5a04d-7b0b-413c-93d5-7cd8b8e597e1 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:45.812620 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5a04d-7b0b-413c-93d5-7cd8b8e597e1 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:45.814377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5a04d-7b0b-413c-93d5-7cd8b8e597e1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:45.825496 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-e1b5a04d-7b0b-413c-93d5-7cd8b8e597e1 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 08 10:51:45.826621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 591/1194] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Nov 8 10:51:45 2021] GET /identity/v3/services/placement => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:45.837004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544cd85-d593-4a26-a869-9a5dc62a4066 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:45.852642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544cd85-d593-4a26-a869-9a5dc62a4066 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:45.861464 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d06af-9479-435a-a92f-15bbdfa08b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:45.862112 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d06af-9479-435a-a92f-15bbdfa08b6e admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:45.862391 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d06af-9479-435a-a92f-15bbdfa08b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:45.862658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d06af-9479-435a-a92f-15bbdfa08b6e admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:45.863418 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d06af-9479-435a-a92f-15bbdfa08b6e admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:45.863723 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d06af-9479-435a-a92f-15bbdfa08b6e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:45.865320 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d06af-9479-435a-a92f-15bbdfa08b6e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:45.870843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 604/1195] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Nov 8 10:51:45 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:45.877292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5a04d-7b0b-413c-93d5-7cd8b8e597e1 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:45.887095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5a04d-7b0b-413c-93d5-7cd8b8e597e1 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:45.892901 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918bc8c-e750-4d76-bf25-75cccc730c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:45.893573 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918bc8c-e750-4d76-bf25-75cccc730c8a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:45.893864 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918bc8c-e750-4d76-bf25-75cccc730c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:45.894135 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918bc8c-e750-4d76-bf25-75cccc730c8a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:45.894929 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918bc8c-e750-4d76-bf25-75cccc730c8a admin admin] RBAC: Adding query filter params (interface=public, service_id=f61369e4fc6546a980c157d5aecb2c75, region_id=RegionOne) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:45.895287 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918bc8c-e750-4d76-bf25-75cccc730c8a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:45.896869 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918bc8c-e750-4d76-bf25-75cccc730c8a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:45.901906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 592/1196] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Nov 8 10:51:45 2021] GET /identity/v3/endpoints?service_id=f61369e4fc6546a980c157d5aecb2c75&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:45.907908 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d06af-9479-435a-a92f-15bbdfa08b6e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:45.918368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d06af-9479-435a-a92f-15bbdfa08b6e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:45.924382 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17675252-b4ce-4676-87fb-331684253eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:45.925029 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17675252-b4ce-4676-87fb-331684253eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:45.925319 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17675252-b4ce-4676-87fb-331684253eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:45.925599 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17675252-b4ce-4676-87fb-331684253eb7 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:45.926290 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17675252-b4ce-4676-87fb-331684253eb7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:45.927924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17675252-b4ce-4676-87fb-331684253eb7 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:45.934772 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 605/1197] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Nov 8 10:51:45 2021] GET /identity/v3/services => generated 2191 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 10:51:48.141058 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34423089-828f-4be2-b025-9771c3889fcb None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:48.142119 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34423089-828f-4be2-b025-9771c3889fcb None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:48.142119 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34423089-828f-4be2-b025-9771c3889fcb None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:48.143985 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 593/1198] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:51:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:51:48.150599 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b103b-a47b-42b1-972b-298d817d2a79 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:48.151032 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b103b-a47b-42b1-972b-298d817d2a79 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:48.151181 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b103b-a47b-42b1-972b-298d817d2a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:48.169805 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-011b103b-a47b-42b1-972b-298d817d2a79 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:51:48.171042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-011b103b-a47b-42b1-972b-298d817d2a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:51:48.179792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 606/1199] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:51:48 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:51:48.205611 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34423089-828f-4be2-b025-9771c3889fcb None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:48.223666 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34423089-828f-4be2-b025-9771c3889fcb None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:48.228264 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb945-82eb-45ee-bc4b-b1b8d414b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:48.229062 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb945-82eb-45ee-bc4b-b1b8d414b33c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:48.229341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb945-82eb-45ee-bc4b-b1b8d414b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:48.229613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb945-82eb-45ee-bc4b-b1b8d414b33c admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:48.230310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fb945-82eb-45ee-bc4b-b1b8d414b33c admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:48.231946 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fb945-82eb-45ee-bc4b-b1b8d414b33c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:48.243175 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-608fb945-82eb-45ee-bc4b-b1b8d414b33c admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 08 10:51:48.244296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 594/1200] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Nov 8 10:51:48 2021] GET /identity/v3/services/placement => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 08 10:51:48.251434 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b103b-a47b-42b1-972b-298d817d2a79 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:48.267171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b103b-a47b-42b1-972b-298d817d2a79 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:48.277038 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eda5d4-d12d-4168-8d4f-5c23a9eabd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:48.278082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eda5d4-d12d-4168-8d4f-5c23a9eabd88 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:48.278549 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eda5d4-d12d-4168-8d4f-5c23a9eabd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:48.278995 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eda5d4-d12d-4168-8d4f-5c23a9eabd88 admin admin] PATH_INFO: `/v3/services` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:48.280230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eda5d4-d12d-4168-8d4f-5c23a9eabd88 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:51:48.280734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eda5d4-d12d-4168-8d4f-5c23a9eabd88 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:48.283051 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eda5d4-d12d-4168-8d4f-5c23a9eabd88 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:48.288649 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 607/1201] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Nov 8 10:51:48 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:51:48.298465 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb945-82eb-45ee-bc4b-b1b8d414b33c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:51:48.314371 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb945-82eb-45ee-bc4b-b1b8d414b33c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:51:48.320753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b467ff1-29b8-4eac-a121-fd25594206b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:51:48.321382 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b467ff1-29b8-4eac-a121-fd25594206b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:51:48.321646 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b467ff1-29b8-4eac-a121-fd25594206b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:51:48.321910 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b467ff1-29b8-4eac-a121-fd25594206b2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:51:48.322644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b467ff1-29b8-4eac-a121-fd25594206b2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:51:48.324230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b467ff1-29b8-4eac-a121-fd25594206b2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:51:48.347431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 595/1202] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Nov 8 10:51:48 2021] POST /identity/v3/endpoints => generated 331 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:52:51.698344 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea3c12-dab6-4b11-8b9d-b4afaee2daf9 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:52:51.699465 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea3c12-dab6-4b11-8b9d-b4afaee2daf9 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:52:51.699972 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea3c12-dab6-4b11-8b9d-b4afaee2daf9 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:52:51.706972 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 608/1203] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:52:51 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:52:51.708501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f869726-a24b-4df6-a95c-e88d7e23d65b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:52:51.708949 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f869726-a24b-4df6-a95c-e88d7e23d65b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:52:51.709031 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f869726-a24b-4df6-a95c-e88d7e23d65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:52:51.792990 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-5f869726-a24b-4df6-a95c-e88d7e23d65b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:52:51.794311 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5f869726-a24b-4df6-a95c-e88d7e23d65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:52:51.902172 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 596/1204] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:52:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:52:51.925861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea3c12-dab6-4b11-8b9d-b4afaee2daf9 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:52:51.927732 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-5dea3c12-dab6-4b11-8b9d-b4afaee2daf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:52:52.070393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea3c12-dab6-4b11-8b9d-b4afaee2daf9 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:52:52.168923 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4770666-6876-488e-8318-e097dc483b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:52:52.169960 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4770666-6876-488e-8318-e097dc483b27 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:52:52.170171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4770666-6876-488e-8318-e097dc483b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:52:52.170688 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4770666-6876-488e-8318-e097dc483b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:52:52.171720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4770666-6876-488e-8318-e097dc483b27 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:52:52.173957 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4770666-6876-488e-8318-e097dc483b27 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:52:52.195496 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 609/1205] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Nov 8 10:52:51 2021] GET /identity/v3/projects => generated 2553 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 10:52:54.528411 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afd92e-4a6c-4d55-977c-4c05d2cf435a None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:52:54.529344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afd92e-4a6c-4d55-977c-4c05d2cf435a None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:52:54.529854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afd92e-4a6c-4d55-977c-4c05d2cf435a None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:52:54.537479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 597/1206] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:52:54 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:52:54.539107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e566d1d-c087-47a8-bc43-0b40b8fe5133 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:52:54.539592 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e566d1d-c087-47a8-bc43-0b40b8fe5133 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:52:54.539671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e566d1d-c087-47a8-bc43-0b40b8fe5133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:52:54.624915 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-9e566d1d-c087-47a8-bc43-0b40b8fe5133 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:52:54.626148 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9e566d1d-c087-47a8-bc43-0b40b8fe5133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:52:54.728709 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 610/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:52:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:52:54.780086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dc0cb-43f0-4448-b032-6bf5922792b1 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:52:54.780279 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dc0cb-43f0-4448-b032-6bf5922792b1 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:52:54.780560 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dc0cb-43f0-4448-b032-6bf5922792b1 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:52:54.782343 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 598/1208] 10.222.0.20 () {54 vars in 964 bytes} [Mon Nov 8 10:52:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:52:54.788846 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb153fc0-0b29-41cf-9400-d592a5f1c854 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:52:54.789138 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb153fc0-0b29-41cf-9400-d592a5f1c854 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:52:54.789416 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb153fc0-0b29-41cf-9400-d592a5f1c854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:52:54.866118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-cb153fc0-0b29-41cf-9400-d592a5f1c854 None None] MFA Rules not processed for user `0e134083351e4493b2a05bea95233f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:52:54.867728 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-cb153fc0-0b29-41cf-9400-d592a5f1c854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:52:54.946465 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 611/1209] 10.222.0.20 () {58 vars in 1061 bytes} [Mon Nov 8 10:52:54 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:52:54.956430 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dc0cb-43f0-4448-b032-6bf5922792b1 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:52:54.958228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-083dc0cb-43f0-4448-b032-6bf5922792b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:52:55.065299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dc0cb-43f0-4448-b032-6bf5922792b1 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:52:55.140326 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff49fd-0f09-45d2-95a6-1ea73fb64cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:52:55.141001 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff49fd-0f09-45d2-95a6-1ea73fb64cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:52:55.141280 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff49fd-0f09-45d2-95a6-1ea73fb64cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:52:55.141732 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff49fd-0f09-45d2-95a6-1ea73fb64cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:52:55.143711 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-17ff49fd-0f09-45d2-95a6-1ea73fb64cb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:52:55.275217 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff49fd-0f09-45d2-95a6-1ea73fb64cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:52:55.276696 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff49fd-0f09-45d2-95a6-1ea73fb64cb9 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:52:55.299472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 599/1210] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:52:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:52:57.852623 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f7e93-3605-4515-b425-f57011833f33 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:52:57.853426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f7e93-3605-4515-b425-f57011833f33 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:52:57.853426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f7e93-3605-4515-b425-f57011833f33 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:52:57.856244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 612/1211] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:52:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:52:57.865457 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf69f9-44a5-4606-bc17-d73f13c6e9d5 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:52:57.865875 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf69f9-44a5-4606-bc17-d73f13c6e9d5 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:52:57.866257 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf69f9-44a5-4606-bc17-d73f13c6e9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:52:57.950349 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-27cf69f9-44a5-4606-bc17-d73f13c6e9d5 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:52:57.951605 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-27cf69f9-44a5-4606-bc17-d73f13c6e9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:52:58.046294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 600/1212] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:52:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:52:58.109855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f49956-2cc1-4fb7-8cb0-2d27484042fd None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:52:58.110160 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f49956-2cc1-4fb7-8cb0-2d27484042fd None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:52:58.110633 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f49956-2cc1-4fb7-8cb0-2d27484042fd None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:52:58.113549 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 613/1213] 10.222.0.20 () {54 vars in 964 bytes} [Mon Nov 8 10:52:58 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:52:58.120743 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8f1c9-0003-4e12-9787-8bd319ac0840 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:52:58.121227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8f1c9-0003-4e12-9787-8bd319ac0840 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:52:58.121687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8f1c9-0003-4e12-9787-8bd319ac0840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:52:58.204037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-27f8f1c9-0003-4e12-9787-8bd319ac0840 None None] MFA Rules not processed for user `0e134083351e4493b2a05bea95233f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:52:58.205443 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-27f8f1c9-0003-4e12-9787-8bd319ac0840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:52:58.281805 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 601/1214] 10.222.0.20 () {58 vars in 1061 bytes} [Mon Nov 8 10:52:58 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:52:58.291694 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f49956-2cc1-4fb7-8cb0-2d27484042fd None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:52:58.293221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-15f49956-2cc1-4fb7-8cb0-2d27484042fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:52:58.404493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f49956-2cc1-4fb7-8cb0-2d27484042fd None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:52:58.476389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa24e19-5eee-44a6-9428-ffb65dbf7109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:52:58.477041 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa24e19-5eee-44a6-9428-ffb65dbf7109 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:52:58.477318 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa24e19-5eee-44a6-9428-ffb65dbf7109 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:52:58.477590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa24e19-5eee-44a6-9428-ffb65dbf7109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:52:58.479253 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-5fa24e19-5eee-44a6-9428-ffb65dbf7109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:52:58.591580 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa24e19-5eee-44a6-9428-ffb65dbf7109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:52:58.593050 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa24e19-5eee-44a6-9428-ffb65dbf7109 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:52:58.612122 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 614/1215] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:52:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:01.430532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28793703-1f35-4513-80a0-ce79b0ca0b1c None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:01.431541 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28793703-1f35-4513-80a0-ce79b0ca0b1c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:01.431541 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28793703-1f35-4513-80a0-ce79b0ca0b1c None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:01.434307 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 602/1216] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:01 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:01.441793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef5daa-3b82-4f85-81d1-2cfad05c6b8d None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:01.442454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef5daa-3b82-4f85-81d1-2cfad05c6b8d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:01.442646 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef5daa-3b82-4f85-81d1-2cfad05c6b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:01.519686 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-64ef5daa-3b82-4f85-81d1-2cfad05c6b8d None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:01.520932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-64ef5daa-3b82-4f85-81d1-2cfad05c6b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:01.624535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 615/1217] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:01.668923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28793703-1f35-4513-80a0-ce79b0ca0b1c None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:01.671376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-28793703-1f35-4513-80a0-ce79b0ca0b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:01.803681 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28793703-1f35-4513-80a0-ce79b0ca0b1c None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:01.901467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b01711-2962-4f39-a6cd-94cf856be249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:01.902329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01711-2962-4f39-a6cd-94cf856be249 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:01.902601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01711-2962-4f39-a6cd-94cf856be249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:01.902867 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01711-2962-4f39-a6cd-94cf856be249 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:01.912770 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b01711-2962-4f39-a6cd-94cf856be249 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:01.914829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b01711-2962-4f39-a6cd-94cf856be249 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:01.916824 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 603/1218] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:53:01 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:53:01.929967 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef5daa-3b82-4f85-81d1-2cfad05c6b8d None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:01.931237 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-64ef5daa-3b82-4f85-81d1-2cfad05c6b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:02.022570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef5daa-3b82-4f85-81d1-2cfad05c6b8d None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:02.094903 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdae264-92a2-424a-ae08-e375cc28e60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:02.095514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdae264-92a2-424a-ae08-e375cc28e60c service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:02.095793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdae264-92a2-424a-ae08-e375cc28e60c service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:02.096066 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdae264-92a2-424a-ae08-e375cc28e60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:02.098082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0bdae264-92a2-424a-ae08-e375cc28e60c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:02.226616 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdae264-92a2-424a-ae08-e375cc28e60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:02.228055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdae264-92a2-424a-ae08-e375cc28e60c service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:02.245624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 616/1219] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:05.036332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aaa20-776b-46bb-8bb7-7d5428b38817 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:05.037239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aaa20-776b-46bb-8bb7-7d5428b38817 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:05.037239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aaa20-776b-46bb-8bb7-7d5428b38817 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:05.040147 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 604/1220] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:05 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:05.047112 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b589b45-1744-4667-8f31-50db4fb34012 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:05.047603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b589b45-1744-4667-8f31-50db4fb34012 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:05.047720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b589b45-1744-4667-8f31-50db4fb34012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:05.115113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-1b589b45-1744-4667-8f31-50db4fb34012 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:05.116370 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1b589b45-1744-4667-8f31-50db4fb34012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:05.226106 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 617/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:05.266181 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48aaa20-776b-46bb-8bb7-7d5428b38817 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:05.267753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f48aaa20-776b-46bb-8bb7-7d5428b38817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:05.397240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48aaa20-776b-46bb-8bb7-7d5428b38817 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:05.494971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488aa510-e875-4d20-aeb4-9832f83199d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:05.495877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488aa510-e875-4d20-aeb4-9832f83199d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:05.496300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488aa510-e875-4d20-aeb4-9832f83199d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:05.496437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488aa510-e875-4d20-aeb4-9832f83199d1 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:05.510516 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488aa510-e875-4d20-aeb4-9832f83199d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:05.512650 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488aa510-e875-4d20-aeb4-9832f83199d1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:05.514415 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 605/1222] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:53:05 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:53:05.531930 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b589b45-1744-4667-8f31-50db4fb34012 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:05.533836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1b589b45-1744-4667-8f31-50db4fb34012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:05.640956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b589b45-1744-4667-8f31-50db4fb34012 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:05.727774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1139a92-6229-49d5-baaa-51f4c6498992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:05.728426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1139a92-6229-49d5-baaa-51f4c6498992 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:05.728700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1139a92-6229-49d5-baaa-51f4c6498992 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:05.728968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1139a92-6229-49d5-baaa-51f4c6498992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:05.730622 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f1139a92-6229-49d5-baaa-51f4c6498992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:05.840559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1139a92-6229-49d5-baaa-51f4c6498992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:05.841999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1139a92-6229-49d5-baaa-51f4c6498992 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:05.861172 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 618/1223] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:08.763182 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712885d-d657-46a3-981c-f8b8ef1ff80b None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:08.763774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712885d-d657-46a3-981c-f8b8ef1ff80b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:08.763774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712885d-d657-46a3-981c-f8b8ef1ff80b None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:08.766022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 606/1224] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:08.772781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84174-f882-4e28-aa49-2dc3666d97fb None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:08.773347 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84174-f882-4e28-aa49-2dc3666d97fb None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:08.773347 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd84174-f882-4e28-aa49-2dc3666d97fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:08.842700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-edd84174-f882-4e28-aa49-2dc3666d97fb None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:08.843973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-edd84174-f882-4e28-aa49-2dc3666d97fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:08.946252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 619/1225] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:08.983582 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712885d-d657-46a3-981c-f8b8ef1ff80b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:08.985256 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-7712885d-d657-46a3-981c-f8b8ef1ff80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:09.089977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712885d-d657-46a3-981c-f8b8ef1ff80b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:09.164594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744d6de-5df6-49bd-982c-dcad7de19d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:09.165134 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744d6de-5df6-49bd-982c-dcad7de19d22 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:09.165413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744d6de-5df6-49bd-982c-dcad7de19d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:09.165684 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744d6de-5df6-49bd-982c-dcad7de19d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:09.167348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1744d6de-5df6-49bd-982c-dcad7de19d22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:09.282999 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744d6de-5df6-49bd-982c-dcad7de19d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:09.284560 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744d6de-5df6-49bd-982c-dcad7de19d22 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:09.302585 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 607/1226] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:11.648939 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e702f-f38a-42dd-a639-31a87a3046a4 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:11.649466 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e702f-f38a-42dd-a639-31a87a3046a4 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:11.649466 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e702f-f38a-42dd-a639-31a87a3046a4 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:11.651405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 620/1227] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:11.657369 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace3d91-70f4-477f-a240-ed330511c0ea None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:11.657792 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace3d91-70f4-477f-a240-ed330511c0ea None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:11.657902 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace3d91-70f4-477f-a240-ed330511c0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:11.730116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-9ace3d91-70f4-477f-a240-ed330511c0ea None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:11.731355 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9ace3d91-70f4-477f-a240-ed330511c0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:11.833234 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 608/1228] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:11.870252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e702f-f38a-42dd-a639-31a87a3046a4 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:11.871833 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a81e702f-f38a-42dd-a639-31a87a3046a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:11.979068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e702f-f38a-42dd-a639-31a87a3046a4 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:12.064468 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5aba73-0fca-4a21-b4d8-c6c620202d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:12.065178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aba73-0fca-4a21-b4d8-c6c620202d09 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:12.065427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aba73-0fca-4a21-b4d8-c6c620202d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:12.065747 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5aba73-0fca-4a21-b4d8-c6c620202d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:12.067658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0e5aba73-0fca-4a21-b4d8-c6c620202d09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:12.182571 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5aba73-0fca-4a21-b4d8-c6c620202d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:12.184060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5aba73-0fca-4a21-b4d8-c6c620202d09 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:12.201992 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 621/1229] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:14.515485 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cc374-39a5-411c-85e6-c8bf0907ec15 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:14.516088 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cc374-39a5-411c-85e6-c8bf0907ec15 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:14.516088 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cc374-39a5-411c-85e6-c8bf0907ec15 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:14.517832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 609/1230] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:14.525142 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef01310-77a9-4041-9626-f1723c3ee9df None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:14.525734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef01310-77a9-4041-9626-f1723c3ee9df None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:14.525734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef01310-77a9-4041-9626-f1723c3ee9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:14.592150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-8ef01310-77a9-4041-9626-f1723c3ee9df None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:14.593335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8ef01310-77a9-4041-9626-f1723c3ee9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:14.691882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 622/1231] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:14.725413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cc374-39a5-411c-85e6-c8bf0907ec15 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:14.726952 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e92cc374-39a5-411c-85e6-c8bf0907ec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:14.856857 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cc374-39a5-411c-85e6-c8bf0907ec15 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:14.949703 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e0465-3137-4378-a26d-7de05c53fc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:14.950476 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e0465-3137-4378-a26d-7de05c53fc43 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:14.950755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e0465-3137-4378-a26d-7de05c53fc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:14.951025 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e0465-3137-4378-a26d-7de05c53fc43 admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:14.961941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e0465-3137-4378-a26d-7de05c53fc43 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:14.964062 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e0465-3137-4378-a26d-7de05c53fc43 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:14.966020 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 610/1232] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:53:14 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:53:14.978453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef01310-77a9-4041-9626-f1723c3ee9df None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:14.979781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8ef01310-77a9-4041-9626-f1723c3ee9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:15.074922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef01310-77a9-4041-9626-f1723c3ee9df None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:15.148044 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7cf4a-0c03-414f-a79b-506394a32bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:15.148693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7cf4a-0c03-414f-a79b-506394a32bdd service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:15.148937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7cf4a-0c03-414f-a79b-506394a32bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:15.149239 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7cf4a-0c03-414f-a79b-506394a32bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:15.150881 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-dbe7cf4a-0c03-414f-a79b-506394a32bdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:15.260128 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7cf4a-0c03-414f-a79b-506394a32bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:15.261575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7cf4a-0c03-414f-a79b-506394a32bdd service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:15.279900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 623/1233] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:17.989858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec1fb-ba80-4217-a8a7-f93120c83266 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:17.990494 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec1fb-ba80-4217-a8a7-f93120c83266 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:17.990494 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec1fb-ba80-4217-a8a7-f93120c83266 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:17.992254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 611/1234] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:17.998568 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbc9fc-0dc2-4e5c-a9f9-316e671df612 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:17.999021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbc9fc-0dc2-4e5c-a9f9-316e671df612 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:17.999147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbc9fc-0dc2-4e5c-a9f9-316e671df612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:18.066782 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-1bfbc9fc-0dc2-4e5c-a9f9-316e671df612 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:18.068063 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1bfbc9fc-0dc2-4e5c-a9f9-316e671df612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:18.171508 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 624/1235] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:18.210069 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eec1fb-ba80-4217-a8a7-f93120c83266 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:18.212501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-47eec1fb-ba80-4217-a8a7-f93120c83266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:18.327228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eec1fb-ba80-4217-a8a7-f93120c83266 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:18.403933 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed0a6e-7d26-4162-998b-c7e0e133c612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:18.404572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed0a6e-7d26-4162-998b-c7e0e133c612 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:18.404859 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed0a6e-7d26-4162-998b-c7e0e133c612 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:18.405123 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed0a6e-7d26-4162-998b-c7e0e133c612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:18.406752 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-83ed0a6e-7d26-4162-998b-c7e0e133c612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:18.531143 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed0a6e-7d26-4162-998b-c7e0e133c612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:18.532668 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed0a6e-7d26-4162-998b-c7e0e133c612 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:18.550219 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 612/1236] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:20.890393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61f728-8fc6-4635-ad79-d8d76236ef89 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:20.890947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61f728-8fc6-4635-ad79-d8d76236ef89 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:20.890947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61f728-8fc6-4635-ad79-d8d76236ef89 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:20.892663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 625/1237] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:20.900169 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80840f6d-312a-4a8e-ab35-2a55a455c7eb None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:20.900912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80840f6d-312a-4a8e-ab35-2a55a455c7eb None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:20.901082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80840f6d-312a-4a8e-ab35-2a55a455c7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:20.976553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-80840f6d-312a-4a8e-ab35-2a55a455c7eb None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:20.977764 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-80840f6d-312a-4a8e-ab35-2a55a455c7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:21.075008 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 613/1238] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:21.117681 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61f728-8fc6-4635-ad79-d8d76236ef89 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:21.120093 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7c61f728-8fc6-4635-ad79-d8d76236ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:21.236431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61f728-8fc6-4635-ad79-d8d76236ef89 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:21.310523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a640d-9a92-44be-8220-80bfe1bc858d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:21.311165 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a640d-9a92-44be-8220-80bfe1bc858d service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:21.311468 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a640d-9a92-44be-8220-80bfe1bc858d service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:21.311742 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a640d-9a92-44be-8220-80bfe1bc858d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:21.313364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-348a640d-9a92-44be-8220-80bfe1bc858d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:21.423705 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a640d-9a92-44be-8220-80bfe1bc858d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:21.425482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a640d-9a92-44be-8220-80bfe1bc858d service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:21.443789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 626/1239] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:24.221809 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934235c-3cc7-4827-9849-07fb646de1e9 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:24.222411 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934235c-3cc7-4827-9849-07fb646de1e9 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:24.222411 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934235c-3cc7-4827-9849-07fb646de1e9 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:24.224210 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 614/1240] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:24.231171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1951f-63ee-4a6f-abbe-4f566c18128b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:24.231703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1951f-63ee-4a6f-abbe-4f566c18128b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:24.231703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1951f-63ee-4a6f-abbe-4f566c18128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:24.311639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-c2c1951f-63ee-4a6f-abbe-4f566c18128b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:24.312900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c2c1951f-63ee-4a6f-abbe-4f566c18128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:24.428831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 627/1241] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:24.470690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934235c-3cc7-4827-9849-07fb646de1e9 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:24.473395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1934235c-3cc7-4827-9849-07fb646de1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:24.578465 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934235c-3cc7-4827-9849-07fb646de1e9 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:24.582571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58be6b-1766-4886-94e0-a8fb5a3d2852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:24.583216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58be6b-1766-4886-94e0-a8fb5a3d2852 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:24.583492 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58be6b-1766-4886-94e0-a8fb5a3d2852 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:24.583765 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58be6b-1766-4886-94e0-a8fb5a3d2852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:24.593444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58be6b-1766-4886-94e0-a8fb5a3d2852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:24.594879 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58be6b-1766-4886-94e0-a8fb5a3d2852 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:24.604165 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 615/1242] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:28.895898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b2ac-d1ca-4317-afab-feb4a54ed916 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:28.896630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b2ac-d1ca-4317-afab-feb4a54ed916 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:28.896630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b2ac-d1ca-4317-afab-feb4a54ed916 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:28.898124 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 628/1243] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:28.904835 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0bf1c-0c8b-40fc-a8f9-6d22f8a1c360 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:28.905300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0bf1c-0c8b-40fc-a8f9-6d22f8a1c360 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:28.905386 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0bf1c-0c8b-40fc-a8f9-6d22f8a1c360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:28.923553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-3cf0bf1c-0c8b-40fc-a8f9-6d22f8a1c360 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:28.924833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3cf0bf1c-0c8b-40fc-a8f9-6d22f8a1c360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:28.933356 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 616/1244] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:28.973721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8b2ac-d1ca-4317-afab-feb4a54ed916 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:28.985288 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8b2ac-d1ca-4317-afab-feb4a54ed916 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:28.989370 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a3785-b834-4688-8834-dd9990e5a3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:28.990040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a3785-b834-4688-8834-dd9990e5a3ab service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:28.990302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a3785-b834-4688-8834-dd9990e5a3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:28.990572 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a3785-b834-4688-8834-dd9990e5a3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:28.999692 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a3785-b834-4688-8834-dd9990e5a3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:29.001122 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a3785-b834-4688-8834-dd9990e5a3ab service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:29.010484 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 629/1245] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:31.896974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd88d0-8997-4583-8d39-747cfba6ed51 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:31.897556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd88d0-8997-4583-8d39-747cfba6ed51 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:31.897556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd88d0-8997-4583-8d39-747cfba6ed51 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:31.899267 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 617/1246] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:31.905427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aef36f-326a-4b0b-92bf-c0f1e163fa7b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:31.905870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aef36f-326a-4b0b-92bf-c0f1e163fa7b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:31.905981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aef36f-326a-4b0b-92bf-c0f1e163fa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:31.925601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-43aef36f-326a-4b0b-92bf-c0f1e163fa7b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:31.926809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-43aef36f-326a-4b0b-92bf-c0f1e163fa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:31.935745 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 630/1247] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:31.974998 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd88d0-8997-4583-8d39-747cfba6ed51 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:31.986382 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd88d0-8997-4583-8d39-747cfba6ed51 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:31.990838 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af910e-cda9-407a-835f-446375279a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:31.991511 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af910e-cda9-407a-835f-446375279a53 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:31.991790 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af910e-cda9-407a-835f-446375279a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:31.992186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af910e-cda9-407a-835f-446375279a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:32.001841 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af910e-cda9-407a-835f-446375279a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:32.003498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af910e-cda9-407a-835f-446375279a53 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:32.012991 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 618/1248] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:36.337266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53560181-049e-4484-94fb-f654efb5fd48 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:36.337811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53560181-049e-4484-94fb-f654efb5fd48 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:36.337811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53560181-049e-4484-94fb-f654efb5fd48 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:36.339693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 631/1249] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:36.346146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9477f2-2e3c-41f0-bba5-e48bbd4d9935 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:36.346624 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9477f2-2e3c-41f0-bba5-e48bbd4d9935 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:36.346750 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9477f2-2e3c-41f0-bba5-e48bbd4d9935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:36.365100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-7a9477f2-2e3c-41f0-bba5-e48bbd4d9935 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:36.366304 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-7a9477f2-2e3c-41f0-bba5-e48bbd4d9935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:36.374642 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 619/1250] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:36.414004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53560181-049e-4484-94fb-f654efb5fd48 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:36.425053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53560181-049e-4484-94fb-f654efb5fd48 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:36.428624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555eb1e-47a0-4bf2-b66d-fdb5a7540522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:36.429305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555eb1e-47a0-4bf2-b66d-fdb5a7540522 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:36.429817 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555eb1e-47a0-4bf2-b66d-fdb5a7540522 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:36.430096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555eb1e-47a0-4bf2-b66d-fdb5a7540522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:36.439260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555eb1e-47a0-4bf2-b66d-fdb5a7540522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:36.440716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555eb1e-47a0-4bf2-b66d-fdb5a7540522 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:36.449979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 632/1251] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:41.609852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433bed8-3c04-4b5e-a5f2-6aade8ae880d None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:41.611011 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433bed8-3c04-4b5e-a5f2-6aade8ae880d None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:41.611558 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433bed8-3c04-4b5e-a5f2-6aade8ae880d None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:41.613549 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 620/1252] 10.222.0.20 () {54 vars in 921 bytes} [Mon Nov 8 10:53:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:41.619456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1e981-3e3f-4ee7-872d-0ba968a1ae3b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:41.620344 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1e981-3e3f-4ee7-872d-0ba968a1ae3b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:41.620867 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1e981-3e3f-4ee7-872d-0ba968a1ae3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:41.690367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-dcc1e981-3e3f-4ee7-872d-0ba968a1ae3b None None] MFA Rules not processed for user `642c2b97ece34d69bacd821b108bd210`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:41.692028 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-dcc1e981-3e3f-4ee7-872d-0ba968a1ae3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:41.775529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 633/1253] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Nov 8 10:53:41 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:46.046368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862a056-0acc-4752-abfd-9264442eebc6 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:46.047390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862a056-0acc-4752-abfd-9264442eebc6 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:46.047874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862a056-0acc-4752-abfd-9264442eebc6 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:46.050249 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 621/1254] 10.222.0.20 () {54 vars in 921 bytes} [Mon Nov 8 10:53:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:46.056031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664a0ad-ea65-49e3-a7ce-90ebeb6d212d None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:46.056553 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664a0ad-ea65-49e3-a7ce-90ebeb6d212d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:46.056553 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664a0ad-ea65-49e3-a7ce-90ebeb6d212d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:46.075692 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-a664a0ad-ea65-49e3-a7ce-90ebeb6d212d None None] MFA Rules not processed for user `642c2b97ece34d69bacd821b108bd210`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:46.076899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a664a0ad-ea65-49e3-a7ce-90ebeb6d212d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:46.086223 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 634/1255] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Nov 8 10:53:46 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:47.415933 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e974e-c03d-4b9a-84e9-3e86b3dc826b None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:47.416450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e974e-c03d-4b9a-84e9-3e86b3dc826b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:47.416450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e974e-c03d-4b9a-84e9-3e86b3dc826b None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:47.418314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 622/1256] 10.222.0.20 () {54 vars in 921 bytes} [Mon Nov 8 10:53:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:47.424371 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256948c5-31d0-4561-a193-01bca92e1a5b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:47.424852 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256948c5-31d0-4561-a193-01bca92e1a5b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:47.424944 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256948c5-31d0-4561-a193-01bca92e1a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:47.444229 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-256948c5-31d0-4561-a193-01bca92e1a5b None None] MFA Rules not processed for user `642c2b97ece34d69bacd821b108bd210`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:47.445685 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-256948c5-31d0-4561-a193-01bca92e1a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:47.454973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 635/1257] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Nov 8 10:53:47 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:51.472301 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c69d-a8fe-4389-9f4c-7326abe4ac16 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:51.472765 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c69d-a8fe-4389-9f4c-7326abe4ac16 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:51.472884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57c69d-a8fe-4389-9f4c-7326abe4ac16 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:51.476092 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 623/1258] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:51.480547 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f8f19-d3b4-4bf2-99a7-7e1ec37cfcd6 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:51.481296 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f8f19-d3b4-4bf2-99a7-7e1ec37cfcd6 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:51.481716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f8f19-d3b4-4bf2-99a7-7e1ec37cfcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:51.499993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-507f8f19-d3b4-4bf2-99a7-7e1ec37cfcd6 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:51.501532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-507f8f19-d3b4-4bf2-99a7-7e1ec37cfcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:51.511596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 636/1259] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:51.565217 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a51abc-1d28-410a-89ee-6a43f3784abb None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:51.565505 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a51abc-1d28-410a-89ee-6a43f3784abb None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:51.565785 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a51abc-1d28-410a-89ee-6a43f3784abb None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:51.567878 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 624/1260] 10.222.0.20 () {54 vars in 960 bytes} [Mon Nov 8 10:53:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:51.574386 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e01894-e8cf-488a-9466-b31d116b96f5 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:51.574673 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e01894-e8cf-488a-9466-b31d116b96f5 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:51.574946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e01894-e8cf-488a-9466-b31d116b96f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:51.624132 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-d6e01894-e8cf-488a-9466-b31d116b96f5 None None] MFA Rules not processed for user `d3421cf1bbb24423a2f24c4667adfdda`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:51.625296 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d6e01894-e8cf-488a-9466-b31d116b96f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:51.708770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 637/1261] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Nov 8 10:53:51 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:51.717647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a51abc-1d28-410a-89ee-6a43f3784abb None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:51.732854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a51abc-1d28-410a-89ee-6a43f3784abb None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:51.738830 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ae40f-f57c-4404-b87b-eb6a3551857c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:51.739689 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ae40f-f57c-4404-b87b-eb6a3551857c service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:51.740123 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ae40f-f57c-4404-b87b-eb6a3551857c service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:51.740569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ae40f-f57c-4404-b87b-eb6a3551857c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:51.749159 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ae40f-f57c-4404-b87b-eb6a3551857c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:51.750932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ae40f-f57c-4404-b87b-eb6a3551857c service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:51.761394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 625/1262] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:54.344396 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103d961-f967-46c9-a4a3-94aa5b90d3dd None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:54.345286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103d961-f967-46c9-a4a3-94aa5b90d3dd None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:54.345286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103d961-f967-46c9-a4a3-94aa5b90d3dd None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:54.346888 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 638/1263] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:54.353307 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c2009-64df-4b5a-908f-14c06e6aab9b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:54.353792 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c2009-64df-4b5a-908f-14c06e6aab9b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:54.353958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c2009-64df-4b5a-908f-14c06e6aab9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:54.373457 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-1e0c2009-64df-4b5a-908f-14c06e6aab9b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:54.374721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1e0c2009-64df-4b5a-908f-14c06e6aab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:54.385432 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 626/1264] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:54.431451 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103d961-f967-46c9-a4a3-94aa5b90d3dd None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:54.446558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103d961-f967-46c9-a4a3-94aa5b90d3dd None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:54.452073 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff5d07-7e2f-4b57-8018-61c47fa2fdd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:54.452704 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff5d07-7e2f-4b57-8018-61c47fa2fdd1 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:54.452982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff5d07-7e2f-4b57-8018-61c47fa2fdd1 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:54.453373 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff5d07-7e2f-4b57-8018-61c47fa2fdd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:54.475093 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff5d07-7e2f-4b57-8018-61c47fa2fdd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:54.476900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff5d07-7e2f-4b57-8018-61c47fa2fdd1 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:54.488893 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 639/1265] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:57.095447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc508b-7290-4154-a77a-c7cd006ff229 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:57.095977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc508b-7290-4154-a77a-c7cd006ff229 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:57.096079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc508b-7290-4154-a77a-c7cd006ff229 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:57.097935 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 627/1266] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:53:57.104691 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee5e8e-78ca-483f-a6b0-3091020f859c None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:57.105480 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee5e8e-78ca-483f-a6b0-3091020f859c None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:57.105762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee5e8e-78ca-483f-a6b0-3091020f859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:57.128915 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-27ee5e8e-78ca-483f-a6b0-3091020f859c None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:57.130393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-27ee5e8e-78ca-483f-a6b0-3091020f859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:57.141372 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 640/1267] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:57.191057 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a71f34-f724-456f-82ed-07d5ca22ad6a None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:57.191389 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a71f34-f724-456f-82ed-07d5ca22ad6a None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:57.191667 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a71f34-f724-456f-82ed-07d5ca22ad6a None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:57.193645 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 628/1268] 10.222.0.20 () {54 vars in 960 bytes} [Mon Nov 8 10:53:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:57.199460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd3f99-c391-46fb-b416-b792d9c28c8b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:57.199766 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd3f99-c391-46fb-b416-b792d9c28c8b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:57.200038 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd3f99-c391-46fb-b416-b792d9c28c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:57.218591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-32fd3f99-c391-46fb-b416-b792d9c28c8b None None] MFA Rules not processed for user `d3421cf1bbb24423a2f24c4667adfdda`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:57.220332 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-32fd3f99-c391-46fb-b416-b792d9c28c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:57.230561 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 641/1269] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Nov 8 10:53:57 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:57.239361 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a71f34-f724-456f-82ed-07d5ca22ad6a None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:57.254232 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a71f34-f724-456f-82ed-07d5ca22ad6a None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:57.261993 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0292901-b1fd-4bf3-879a-7a47a346f752 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:57.262857 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0292901-b1fd-4bf3-879a-7a47a346f752 service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:57.263391 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0292901-b1fd-4bf3-879a-7a47a346f752 service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:57.263664 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0292901-b1fd-4bf3-879a-7a47a346f752 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:57.273283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0292901-b1fd-4bf3-879a-7a47a346f752 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:57.275281 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0292901-b1fd-4bf3-879a-7a47a346f752 service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:57.286569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 629/1270] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:59.307078 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8f5c9-4389-42a3-ae4f-613440de9ad2 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:59.307660 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8f5c9-4389-42a3-ae4f-613440de9ad2 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:59.307660 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8f5c9-4389-42a3-ae4f-613440de9ad2 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:59.309444 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 642/1271] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:59.316173 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea12cf4-b7a9-415a-8493-91fafc7b410a None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:59.316647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea12cf4-b7a9-415a-8493-91fafc7b410a None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:59.316842 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea12cf4-b7a9-415a-8493-91fafc7b410a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:59.335894 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-2ea12cf4-b7a9-415a-8493-91fafc7b410a None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:59.337108 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2ea12cf4-b7a9-415a-8493-91fafc7b410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:59.345922 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 630/1272] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:59.400520 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d325c-8100-453a-8866-ad0f2ace9077 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:59.400775 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d325c-8100-453a-8866-ad0f2ace9077 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:59.401329 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d325c-8100-453a-8866-ad0f2ace9077 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:59.403231 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 643/1273] 10.222.0.20 () {54 vars in 962 bytes} [Mon Nov 8 10:53:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:59.410190 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e2dbd-2afc-40a9-8add-59491bd79b1d None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:59.410637 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e2dbd-2afc-40a9-8add-59491bd79b1d None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:59.410924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e2dbd-2afc-40a9-8add-59491bd79b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:59.468313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-613e2dbd-2afc-40a9-8add-59491bd79b1d None None] MFA Rules not processed for user `4b0a2df68bfc41ada3b2135fc2e1930f`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:59.469548 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-613e2dbd-2afc-40a9-8add-59491bd79b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:59.542782 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 631/1274] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Nov 8 10:53:59 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:53:59.548039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d325c-8100-453a-8866-ad0f2ace9077 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:59.560439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d325c-8100-453a-8866-ad0f2ace9077 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:59.564480 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf2d86-4df4-461e-ae34-f5c460594b92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:59.565136 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf2d86-4df4-461e-ae34-f5c460594b92 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:59.565418 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf2d86-4df4-461e-ae34-f5c460594b92 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:59.565689 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf2d86-4df4-461e-ae34-f5c460594b92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:59.575655 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf2d86-4df4-461e-ae34-f5c460594b92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:59.577110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf2d86-4df4-461e-ae34-f5c460594b92 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:59.587966 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 644/1275] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:53:59.651501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b8eb8-8ca7-41e5-a85f-c71d4a136cea None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:59.651788 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b8eb8-8ca7-41e5-a85f-c71d4a136cea None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:59.652053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b8eb8-8ca7-41e5-a85f-c71d4a136cea None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:59.653996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 632/1276] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:53:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:53:59.660407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd54e9-534b-4a10-80c5-09d6fe540680 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:59.660769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd54e9-534b-4a10-80c5-09d6fe540680 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:59.661118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd54e9-534b-4a10-80c5-09d6fe540680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:59.680378 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-acdd54e9-534b-4a10-80c5-09d6fe540680 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:53:59.681662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-acdd54e9-534b-4a10-80c5-09d6fe540680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:53:59.690112 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 645/1277] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:53:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:53:59.737270 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b8eb8-8ca7-41e5-a85f-c71d4a136cea None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:53:59.752570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b8eb8-8ca7-41e5-a85f-c71d4a136cea None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:53:59.758477 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e73e0-64be-4ffc-8682-82879fbe2842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:53:59.759234 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e73e0-64be-4ffc-8682-82879fbe2842 service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:53:59.759519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e73e0-64be-4ffc-8682-82879fbe2842 service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:53:59.759790 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e73e0-64be-4ffc-8682-82879fbe2842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:53:59.768959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e73e0-64be-4ffc-8682-82879fbe2842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:53:59.770562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e73e0-64be-4ffc-8682-82879fbe2842 service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:53:59.780344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 633/1278] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:53:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 10:54:02.091049 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35624489-20de-4216-8e7d-f5ab759fca8e None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:02.091619 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35624489-20de-4216-8e7d-f5ab759fca8e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:02.091619 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35624489-20de-4216-8e7d-f5ab759fca8e None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:02.093400 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 646/1279] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:02.099753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb1899-ba26-43c7-8295-d5e27c92a072 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:02.100214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb1899-ba26-43c7-8295-d5e27c92a072 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:02.100328 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb1899-ba26-43c7-8295-d5e27c92a072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:02.119155 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-cecb1899-ba26-43c7-8295-d5e27c92a072 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:02.120455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-cecb1899-ba26-43c7-8295-d5e27c92a072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:02.130572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 634/1280] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:02.178593 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35624489-20de-4216-8e7d-f5ab759fca8e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:02.195230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35624489-20de-4216-8e7d-f5ab759fca8e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:02.202789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660a12b-7126-4c6f-aeee-03716d96ebda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:02.203523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660a12b-7126-4c6f-aeee-03716d96ebda service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:02.203803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660a12b-7126-4c6f-aeee-03716d96ebda service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:02.204185 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660a12b-7126-4c6f-aeee-03716d96ebda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:02.213353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660a12b-7126-4c6f-aeee-03716d96ebda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:02.214942 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660a12b-7126-4c6f-aeee-03716d96ebda service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:02.224682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 647/1281] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:54:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:54:04.556828 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c500-5844-4a58-9f20-9f9be9cc7164 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:04.557394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c500-5844-4a58-9f20-9f9be9cc7164 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:04.557636 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c500-5844-4a58-9f20-9f9be9cc7164 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:04.560300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 635/1282] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:04.566634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42c8c3-3c51-4248-87ca-ab4c760517e0 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:04.567094 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42c8c3-3c51-4248-87ca-ab4c760517e0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:04.567224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42c8c3-3c51-4248-87ca-ab4c760517e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:04.586068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-4c42c8c3-3c51-4248-87ca-ab4c760517e0 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:04.587293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4c42c8c3-3c51-4248-87ca-ab4c760517e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:04.595654 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 648/1283] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:04.642216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071c500-5844-4a58-9f20-9f9be9cc7164 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:04.656475 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071c500-5844-4a58-9f20-9f9be9cc7164 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:04.662100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2a92e-ee23-4eea-bac4-35740bcfa5a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:04.662756 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2a92e-ee23-4eea-bac4-35740bcfa5a9 service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:04.663040 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2a92e-ee23-4eea-bac4-35740bcfa5a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:04.663346 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2a92e-ee23-4eea-bac4-35740bcfa5a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:04.671794 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2a92e-ee23-4eea-bac4-35740bcfa5a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:04.673701 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2a92e-ee23-4eea-bac4-35740bcfa5a9 service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:04.683353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 636/1284] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:54:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:54:07.016623 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8db9ca-9d4d-42a7-900b-e905b0241b7f None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:07.017167 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8db9ca-9d4d-42a7-900b-e905b0241b7f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:07.017167 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8db9ca-9d4d-42a7-900b-e905b0241b7f None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:07.018960 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 649/1285] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:07.025033 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae0bb8-79f6-4238-a902-b456c76c7a52 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:07.025464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae0bb8-79f6-4238-a902-b456c76c7a52 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:07.025562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae0bb8-79f6-4238-a902-b456c76c7a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:07.046594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-5aae0bb8-79f6-4238-a902-b456c76c7a52 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:07.047826 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5aae0bb8-79f6-4238-a902-b456c76c7a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:07.057552 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 637/1286] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:07.104672 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8db9ca-9d4d-42a7-900b-e905b0241b7f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:07.120728 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8db9ca-9d4d-42a7-900b-e905b0241b7f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:07.126997 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559e981-009f-49f3-a17c-7d5a2a0967bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:07.127696 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559e981-009f-49f3-a17c-7d5a2a0967bb service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:07.127974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559e981-009f-49f3-a17c-7d5a2a0967bb service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:07.128245 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559e981-009f-49f3-a17c-7d5a2a0967bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:07.136850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559e981-009f-49f3-a17c-7d5a2a0967bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:07.138488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559e981-009f-49f3-a17c-7d5a2a0967bb service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:07.148896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 650/1287] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:54:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:54:09.454630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1015b-3829-4616-9d2f-3762582ca1fa None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:09.455422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1015b-3829-4616-9d2f-3762582ca1fa None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:09.455422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1015b-3829-4616-9d2f-3762582ca1fa None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:09.457205 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 638/1288] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:09.464340 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432edae-17c3-4831-955d-21d394377b82 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:09.464932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432edae-17c3-4831-955d-21d394377b82 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:09.464932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432edae-17c3-4831-955d-21d394377b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:09.484878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-0432edae-17c3-4831-955d-21d394377b82 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:09.486171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0432edae-17c3-4831-955d-21d394377b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:09.494558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 651/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:09.545081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1015b-3829-4616-9d2f-3762582ca1fa None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:09.560139 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1015b-3829-4616-9d2f-3762582ca1fa None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:09.565976 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e001dc2-179d-41e5-b5a7-bdee0dd0ad0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:09.566690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001dc2-179d-41e5-b5a7-bdee0dd0ad0c service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:09.566976 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001dc2-179d-41e5-b5a7-bdee0dd0ad0c service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:09.567319 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001dc2-179d-41e5-b5a7-bdee0dd0ad0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:09.576065 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e001dc2-179d-41e5-b5a7-bdee0dd0ad0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:09.577746 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e001dc2-179d-41e5-b5a7-bdee0dd0ad0c service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:09.587596 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 639/1290] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:54:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 10:54:11.986694 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dd19c-6581-4e4c-82a9-473236f85f45 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:11.987642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dd19c-6581-4e4c-82a9-473236f85f45 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:11.987916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dd19c-6581-4e4c-82a9-473236f85f45 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:11.989805 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 652/1291] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:11.998431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4309ffb-3212-464a-9924-c815f7b1b429 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:11.999075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4309ffb-3212-464a-9924-c815f7b1b429 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:11.999075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4309ffb-3212-464a-9924-c815f7b1b429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:12.019507 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-c4309ffb-3212-464a-9924-c815f7b1b429 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:12.020772 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c4309ffb-3212-464a-9924-c815f7b1b429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:12.028788 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 640/1292] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:12.078779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dd19c-6581-4e4c-82a9-473236f85f45 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:12.095204 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dd19c-6581-4e4c-82a9-473236f85f45 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:12.102370 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d4c4d-8153-4cf7-8ffd-dfc369ed9d15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:12.103037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d4c4d-8153-4cf7-8ffd-dfc369ed9d15 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:12.103359 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d4c4d-8153-4cf7-8ffd-dfc369ed9d15 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:12.103634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d4c4d-8153-4cf7-8ffd-dfc369ed9d15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:12.112753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d4c4d-8153-4cf7-8ffd-dfc369ed9d15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:12.114399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d4c4d-8153-4cf7-8ffd-dfc369ed9d15 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:12.124318 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 653/1293] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:54:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:54:14.416081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769514a9-f19c-490c-9641-af92b3cede6f None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:14.416636 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769514a9-f19c-490c-9641-af92b3cede6f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:14.416636 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769514a9-f19c-490c-9641-af92b3cede6f None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:14.418302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 641/1294] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:14.424569 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace616a8-e78e-4491-b297-7e15efc8b4cc None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:14.425017 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace616a8-e78e-4491-b297-7e15efc8b4cc None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:14.425105 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace616a8-e78e-4491-b297-7e15efc8b4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:14.443279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-ace616a8-e78e-4491-b297-7e15efc8b4cc None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:14.444464 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ace616a8-e78e-4491-b297-7e15efc8b4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:14.452897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 654/1295] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:14.500447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace616a8-e78e-4491-b297-7e15efc8b4cc None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:14.501628 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f58137-afb3-456e-91ee-8ff90262ba20 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:14.502284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f58137-afb3-456e-91ee-8ff90262ba20 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:14.502912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f58137-afb3-456e-91ee-8ff90262ba20 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:14.507655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 642/1296] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:14 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:14.514517 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3fbfb-ffcd-441f-acf4-77ec27eaa32d None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:14.514808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3fbfb-ffcd-441f-acf4-77ec27eaa32d None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:14.515086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3fbfb-ffcd-441f-acf4-77ec27eaa32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:14.517884 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace616a8-e78e-4491-b297-7e15efc8b4cc None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:14.524479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be8498-b366-4037-ae0c-1489970fd55a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:14.525124 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8498-b366-4037-ae0c-1489970fd55a service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:14.525423 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8498-b366-4037-ae0c-1489970fd55a service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:14.525689 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8498-b366-4037-ae0c-1489970fd55a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:14.533107 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-f3f3fbfb-ffcd-441f-acf4-77ec27eaa32d None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:14.534350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f3f3fbfb-ffcd-441f-acf4-77ec27eaa32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:14.534669 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be8498-b366-4037-ae0c-1489970fd55a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:14.536275 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be8498-b366-4037-ae0c-1489970fd55a service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:14.542634 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 643/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:54:14.546451 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 655/1298] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:54:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 10:54:14.600992 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd612a0-c51a-4c1d-8f0e-73bcdb1d0a40 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:14.601362 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd612a0-c51a-4c1d-8f0e-73bcdb1d0a40 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:14.601629 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd612a0-c51a-4c1d-8f0e-73bcdb1d0a40 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:14.603783 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 644/1299] 10.222.0.20 () {54 vars in 962 bytes} [Mon Nov 8 10:54:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:14.609350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1bf21-ba79-4b96-b03c-d525ad905725 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:14.609638 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1bf21-ba79-4b96-b03c-d525ad905725 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:14.609978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1bf21-ba79-4b96-b03c-d525ad905725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:14.664143 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-8ba1bf21-ba79-4b96-b03c-d525ad905725 None None] MFA Rules not processed for user `07a71b8adef243049d3b055e66566a63`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:14.665367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8ba1bf21-ba79-4b96-b03c-d525ad905725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:14.730624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 656/1300] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Nov 8 10:54:14 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:14.739612 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd612a0-c51a-4c1d-8f0e-73bcdb1d0a40 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:14.751821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd612a0-c51a-4c1d-8f0e-73bcdb1d0a40 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:14.756483 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a2de9-ed48-4b7c-9797-66df60616aa7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a71b8adef243049d3b055e66566a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:14.757380 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a2de9-ed48-4b7c-9797-66df60616aa7 service glance] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:14.757667 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a2de9-ed48-4b7c-9797-66df60616aa7 service glance] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:14.757948 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a2de9-ed48-4b7c-9797-66df60616aa7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:14.769650 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a2de9-ed48-4b7c-9797-66df60616aa7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:14.771161 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a2de9-ed48-4b7c-9797-66df60616aa7 service glance] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:14.782631 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 645/1301] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:54:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:54:15.234199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8d422-048d-4530-ba9f-484bbb5888bd None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:15.234566 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8d422-048d-4530-ba9f-484bbb5888bd None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:15.235183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8d422-048d-4530-ba9f-484bbb5888bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:15.282369 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-0fd8d422-048d-4530-ba9f-484bbb5888bd None None] MFA Rules not processed for user `f9fc539f38364a648b9a4c25d3dbea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:15.283517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0fd8d422-048d-4530-ba9f-484bbb5888bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:15.347410 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 657/1302] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Nov 8 10:54:15 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:15.391055 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669ed4-0815-4e71-8504-23641bd49793 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:15.391427 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669ed4-0815-4e71-8504-23641bd49793 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:15.391669 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669ed4-0815-4e71-8504-23641bd49793 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:15.393652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 646/1303] 10.222.0.20 () {54 vars in 942 bytes} [Mon Nov 8 10:54:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:15.400621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09b470-7e50-438e-9435-c008c2298f4c None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:15.400995 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09b470-7e50-438e-9435-c008c2298f4c None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:15.401344 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09b470-7e50-438e-9435-c008c2298f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:15.451781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-0f09b470-7e50-438e-9435-c008c2298f4c None None] MFA Rules not processed for user `029506cc966a44c9bbe83eb084ac6feb`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:15.452958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0f09b470-7e50-438e-9435-c008c2298f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:15.530927 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 658/1304] 10.222.0.20 () {58 vars in 1039 bytes} [Mon Nov 8 10:54:15 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:15.540747 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d669ed4-0815-4e71-8504-23641bd49793 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:15.554731 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d669ed4-0815-4e71-8504-23641bd49793 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:15.560507 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb89483-a619-4a6a-bd2b-96251d0a4962 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '029506cc966a44c9bbe83eb084ac6feb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:15.561178 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89483-a619-4a6a-bd2b-96251d0a4962 service swift] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:15.561460 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89483-a619-4a6a-bd2b-96251d0a4962 service swift] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:15.561746 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89483-a619-4a6a-bd2b-96251d0a4962 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:15.570436 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb89483-a619-4a6a-bd2b-96251d0a4962 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:15.572094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb89483-a619-4a6a-bd2b-96251d0a4962 service swift] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:15.580517 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 647/1305] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Nov 8 10:54:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 10:54:16.850285 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84b87a-550a-41c1-a4f5-7485df8ba26f None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:16.850791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84b87a-550a-41c1-a4f5-7485df8ba26f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:16.850791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84b87a-550a-41c1-a4f5-7485df8ba26f None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:16.852603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 659/1306] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:16.860617 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23ff98-c37c-4835-9d09-c35df4232ca7 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:16.860617 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23ff98-c37c-4835-9d09-c35df4232ca7 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:16.860617 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23ff98-c37c-4835-9d09-c35df4232ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:16.877014 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-5c23ff98-c37c-4835-9d09-c35df4232ca7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:16.878225 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5c23ff98-c37c-4835-9d09-c35df4232ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:16.886105 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 648/1307] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:16.938352 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84b87a-550a-41c1-a4f5-7485df8ba26f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:16.954759 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84b87a-550a-41c1-a4f5-7485df8ba26f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:16.960476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba71d9-7997-4fa8-a22b-3146675feeb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:16.961239 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba71d9-7997-4fa8-a22b-3146675feeb7 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:16.961526 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba71d9-7997-4fa8-a22b-3146675feeb7 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:16.961806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba71d9-7997-4fa8-a22b-3146675feeb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:16.970200 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba71d9-7997-4fa8-a22b-3146675feeb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:16.971834 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba71d9-7997-4fa8-a22b-3146675feeb7 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:16.981337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 660/1308] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:54:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:54:19.343695 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406f26e-117d-4bad-bbb6-8f90c9e77e6a None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:19.344352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406f26e-117d-4bad-bbb6-8f90c9e77e6a None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:19.344454 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406f26e-117d-4bad-bbb6-8f90c9e77e6a None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:19.346241 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 649/1309] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:19.352359 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec679f-1f3f-483d-9408-1f6190321958 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:19.352849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec679f-1f3f-483d-9408-1f6190321958 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:19.352939 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec679f-1f3f-483d-9408-1f6190321958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:19.371442 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-d8ec679f-1f3f-483d-9408-1f6190321958 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:19.372644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d8ec679f-1f3f-483d-9408-1f6190321958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:19.380632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 661/1310] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:54:19.427872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406f26e-117d-4bad-bbb6-8f90c9e77e6a None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:19.442424 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406f26e-117d-4bad-bbb6-8f90c9e77e6a None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:19.447796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f66e48-7af0-4c5c-83f4-7984c09fb067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:19.448451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66e48-7af0-4c5c-83f4-7984c09fb067 service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:19.448737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66e48-7af0-4c5c-83f4-7984c09fb067 service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:19.449014 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66e48-7af0-4c5c-83f4-7984c09fb067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:19.457946 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f66e48-7af0-4c5c-83f4-7984c09fb067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:19.459687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f66e48-7af0-4c5c-83f4-7984c09fb067 service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:19.470066 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 650/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:54:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:54:32.794511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a823a-bc51-486e-a2db-9f553bb6d92e None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:32.795401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a823a-bc51-486e-a2db-9f553bb6d92e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:32.795401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a823a-bc51-486e-a2db-9f553bb6d92e None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:32.798336 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 662/1312] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:32.804797 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc924bbc-af2f-4d89-bc83-463c75ffb69a None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:32.805246 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc924bbc-af2f-4d89-bc83-463c75ffb69a None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:32.805351 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc924bbc-af2f-4d89-bc83-463c75ffb69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:32.823932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-cc924bbc-af2f-4d89-bc83-463c75ffb69a None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:32.825108 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-cc924bbc-af2f-4d89-bc83-463c75ffb69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:32.833753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 651/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:32.860744 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a823a-bc51-486e-a2db-9f553bb6d92e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:32.873682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a823a-bc51-486e-a2db-9f553bb6d92e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:32.878750 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ad562-37ba-4883-8186-e36844781852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:32.879426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ad562-37ba-4883-8186-e36844781852 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:32.879729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ad562-37ba-4883-8186-e36844781852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:32.879969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ad562-37ba-4883-8186-e36844781852 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:32.880711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ad562-37ba-4883-8186-e36844781852 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:32.882573 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ad562-37ba-4883-8186-e36844781852 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:32.896129 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 663/1314] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Nov 8 10:54:32 2021] GET /identity/v3/projects => generated 2553 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 10:54:35.087501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fa484-6dea-455a-aabe-3e112bce6de9 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:35.088423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fa484-6dea-455a-aabe-3e112bce6de9 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:35.088423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fa484-6dea-455a-aabe-3e112bce6de9 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:35.091262 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 652/1315] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:35.101042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a9a54-132f-481a-9d1b-b1a3c81548e9 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:35.101488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a9a54-132f-481a-9d1b-b1a3c81548e9 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:35.101616 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a9a54-132f-481a-9d1b-b1a3c81548e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:35.124179 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-a75a9a54-132f-481a-9d1b-b1a3c81548e9 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:35.125424 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a75a9a54-132f-481a-9d1b-b1a3c81548e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:35.135008 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 664/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:35.160075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fa484-6dea-455a-aabe-3e112bce6de9 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:35.175097 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fa484-6dea-455a-aabe-3e112bce6de9 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:35.183504 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cce9f-377b-4807-9053-295d7ef2c4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:35.184353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cce9f-377b-4807-9053-295d7ef2c4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:35.184633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cce9f-377b-4807-9053-295d7ef2c4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:35.184906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cce9f-377b-4807-9053-295d7ef2c4b4 admin admin] PATH_INFO: `/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:35.196026 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cce9f-377b-4807-9053-295d7ef2c4b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=0ee8f38f26434b01aac0d2c0ca2ce960)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:35.198088 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cce9f-377b-4807-9053-295d7ef2c4b4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:35.199808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 653/1317] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:54:35 2021] GET /identity/v3/projects/0ee8f38f26434b01aac0d2c0ca2ce960 => generated 311 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:35.206617 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a9a54-132f-481a-9d1b-b1a3c81548e9 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:35.216317 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a9a54-132f-481a-9d1b-b1a3c81548e9 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:35.222502 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262678f-72e4-4b7a-b436-3639e530f3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:35.223172 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262678f-72e4-4b7a-b436-3639e530f3ad admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:35.223457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262678f-72e4-4b7a-b436-3639e530f3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:35.223732 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262678f-72e4-4b7a-b436-3639e530f3ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:35.224546 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262678f-72e4-4b7a-b436-3639e530f3ad admin admin] RBAC: Adding query filter params (scope.project.id=0ee8f38f26434b01aac0d2c0ca2ce960) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:54:35.224854 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262678f-72e4-4b7a-b436-3639e530f3ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:35.226735 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262678f-72e4-4b7a-b436-3639e530f3ad admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:35.234047 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 665/1318] 10.222.0.20 () {56 vars in 1231 bytes} [Mon Nov 8 10:54:35 2021] GET /identity/v3/role_assignments?scope.project.id=0ee8f38f26434b01aac0d2c0ca2ce960 => generated 877 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:35.240752 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cce9f-377b-4807-9053-295d7ef2c4b4 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:35.251321 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cce9f-377b-4807-9053-295d7ef2c4b4 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:35.256373 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93406d85-6cf8-4e44-a0f6-52670511c0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:35.257236 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93406d85-6cf8-4e44-a0f6-52670511c0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:35.257515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93406d85-6cf8-4e44-a0f6-52670511c0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:35.257810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93406d85-6cf8-4e44-a0f6-52670511c0c5 admin admin] PATH_INFO: `/v3/users/711ceb7878d34a498dd53277b0260373` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:35.273095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93406d85-6cf8-4e44-a0f6-52670511c0c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=711ceb7878d34a498dd53277b0260373)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:35.275293 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93406d85-6cf8-4e44-a0f6-52670511c0c5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:35.276914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 654/1319] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:54:35 2021] GET /identity/v3/users/711ceb7878d34a498dd53277b0260373 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:35.283595 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262678f-72e4-4b7a-b436-3639e530f3ad admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:35.293972 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262678f-72e4-4b7a-b436-3639e530f3ad admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:35.300178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23208f-fcf6-4073-9481-4c117c89ca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:35.301050 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23208f-fcf6-4073-9481-4c117c89ca33 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:35.301328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23208f-fcf6-4073-9481-4c117c89ca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:35.301600 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23208f-fcf6-4073-9481-4c117c89ca33 admin admin] PATH_INFO: `/v3/users/12fb780c522340ff8063cd3aef396c7d` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:35.316517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23208f-fcf6-4073-9481-4c117c89ca33 admin admin] RBAC: Authorizing `identity:get_user(user_id=12fb780c522340ff8063cd3aef396c7d)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:35.318665 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23208f-fcf6-4073-9481-4c117c89ca33 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:35.320429 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 666/1320] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:54:35 2021] GET /identity/v3/users/12fb780c522340ff8063cd3aef396c7d => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:37.656471 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9a88e-9057-49f2-bf07-3d97f3a9293d None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:37.657326 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9a88e-9057-49f2-bf07-3d97f3a9293d None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:37.657480 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9a88e-9057-49f2-bf07-3d97f3a9293d None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:37.659342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 655/1321] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:37.668396 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a94c3d-f0ee-471d-b342-00a0cd43ab7b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:37.668882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a94c3d-f0ee-471d-b342-00a0cd43ab7b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:37.668993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a94c3d-f0ee-471d-b342-00a0cd43ab7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:37.689294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-42a94c3d-f0ee-471d-b342-00a0cd43ab7b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:37.690506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-42a94c3d-f0ee-471d-b342-00a0cd43ab7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:37.699779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 667/1322] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:37.724054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9a88e-9057-49f2-bf07-3d97f3a9293d None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:37.739572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9a88e-9057-49f2-bf07-3d97f3a9293d None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:37.745856 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43192e6-bbd4-488d-bae9-db62b20bc96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:37.746701 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43192e6-bbd4-488d-bae9-db62b20bc96f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:37.746997 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43192e6-bbd4-488d-bae9-db62b20bc96f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:37.747298 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43192e6-bbd4-488d-bae9-db62b20bc96f admin admin] PATH_INFO: `/v3/projects/27515e2cec514f3da80e13fa65b719ab` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:37.748614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43192e6-bbd4-488d-bae9-db62b20bc96f admin admin] RBAC: Authorizing `identity:get_project(project_id=27515e2cec514f3da80e13fa65b719ab)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:37.750400 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43192e6-bbd4-488d-bae9-db62b20bc96f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:37.752212 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 656/1323] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:54:37 2021] GET /identity/v3/projects/27515e2cec514f3da80e13fa65b719ab => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:37.758891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a94c3d-f0ee-471d-b342-00a0cd43ab7b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:37.769225 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a94c3d-f0ee-471d-b342-00a0cd43ab7b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:37.775025 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c87c11-98ad-465b-93d6-5d582bec9f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:37.775705 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c87c11-98ad-465b-93d6-5d582bec9f75 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:37.775978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c87c11-98ad-465b-93d6-5d582bec9f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:37.776249 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c87c11-98ad-465b-93d6-5d582bec9f75 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:37.777033 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c87c11-98ad-465b-93d6-5d582bec9f75 admin admin] RBAC: Adding query filter params (scope.project.id=27515e2cec514f3da80e13fa65b719ab) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:54:37.777338 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c87c11-98ad-465b-93d6-5d582bec9f75 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:37.779180 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c87c11-98ad-465b-93d6-5d582bec9f75 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:37.785995 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 668/1324] 10.222.0.20 () {56 vars in 1231 bytes} [Mon Nov 8 10:54:37 2021] GET /identity/v3/role_assignments?scope.project.id=27515e2cec514f3da80e13fa65b719ab => generated 879 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:37.792406 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43192e6-bbd4-488d-bae9-db62b20bc96f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:37.802767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43192e6-bbd4-488d-bae9-db62b20bc96f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:37.808673 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908aa69e-c2bf-4761-a700-240409523d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:37.809518 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aa69e-c2bf-4761-a700-240409523d35 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:37.809793 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aa69e-c2bf-4761-a700-240409523d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:37.810068 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aa69e-c2bf-4761-a700-240409523d35 admin admin] PATH_INFO: `/v3/users/23015594a30b49b885e3a6236f3a6f37` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:37.811442 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908aa69e-c2bf-4761-a700-240409523d35 admin admin] RBAC: Authorizing `identity:get_user(user_id=23015594a30b49b885e3a6236f3a6f37)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:37.813336 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908aa69e-c2bf-4761-a700-240409523d35 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:37.815022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 657/1325] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:54:37 2021] GET /identity/v3/users/23015594a30b49b885e3a6236f3a6f37 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:40.063568 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326679-6af7-4f17-87b0-6520073ba1c6 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:40.064134 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326679-6af7-4f17-87b0-6520073ba1c6 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:40.064134 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326679-6af7-4f17-87b0-6520073ba1c6 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:40.065943 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 669/1326] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:40.074560 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fce9f0-8fba-4fd5-bb36-539cfb42627f None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:40.075002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fce9f0-8fba-4fd5-bb36-539cfb42627f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:40.075101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fce9f0-8fba-4fd5-bb36-539cfb42627f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:40.095493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-99fce9f0-8fba-4fd5-bb36-539cfb42627f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:40.096686 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-99fce9f0-8fba-4fd5-bb36-539cfb42627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:40.104975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 658/1327] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:40.129593 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d326679-6af7-4f17-87b0-6520073ba1c6 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:40.144331 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d326679-6af7-4f17-87b0-6520073ba1c6 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:40.148884 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0106f6-9065-4c0d-b2b3-b73c2b2ab46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:40.149829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0106f6-9065-4c0d-b2b3-b73c2b2ab46a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:40.150115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0106f6-9065-4c0d-b2b3-b73c2b2ab46a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:40.150391 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0106f6-9065-4c0d-b2b3-b73c2b2ab46a admin admin] PATH_INFO: `/v3/projects/46af80d1a68f413e90039caa63e95d3d` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:40.161740 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0106f6-9065-4c0d-b2b3-b73c2b2ab46a admin admin] RBAC: Authorizing `identity:get_project(project_id=46af80d1a68f413e90039caa63e95d3d)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:40.163843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0106f6-9065-4c0d-b2b3-b73c2b2ab46a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:40.165562 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 670/1328] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:54:40 2021] GET /identity/v3/projects/46af80d1a68f413e90039caa63e95d3d => generated 312 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:40.172553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fce9f0-8fba-4fd5-bb36-539cfb42627f None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:40.182070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fce9f0-8fba-4fd5-bb36-539cfb42627f None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:40.187437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b67018-50f4-4f7d-a0b8-5c1881712414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:40.188133 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b67018-50f4-4f7d-a0b8-5c1881712414 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:40.188422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b67018-50f4-4f7d-a0b8-5c1881712414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:40.188716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b67018-50f4-4f7d-a0b8-5c1881712414 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:40.189497 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b67018-50f4-4f7d-a0b8-5c1881712414 admin admin] RBAC: Adding query filter params (scope.project.id=46af80d1a68f413e90039caa63e95d3d) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:54:40.189798 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b67018-50f4-4f7d-a0b8-5c1881712414 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:40.191667 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b67018-50f4-4f7d-a0b8-5c1881712414 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:40.198198 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 659/1329] 10.222.0.20 () {56 vars in 1231 bytes} [Mon Nov 8 10:54:40 2021] GET /identity/v3/role_assignments?scope.project.id=46af80d1a68f413e90039caa63e95d3d => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:54:40.204734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0106f6-9065-4c0d-b2b3-b73c2b2ab46a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:40.215091 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0106f6-9065-4c0d-b2b3-b73c2b2ab46a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:40.220906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72882335-c652-402c-82a9-c3d8df1774af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:40.221769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72882335-c652-402c-82a9-c3d8df1774af admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:40.222047 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72882335-c652-402c-82a9-c3d8df1774af admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:40.222316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72882335-c652-402c-82a9-c3d8df1774af admin admin] PATH_INFO: `/v3/users/d269fd97a1de43ec94f4736b3f123e1c` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:40.236267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72882335-c652-402c-82a9-c3d8df1774af admin admin] RBAC: Authorizing `identity:get_user(user_id=d269fd97a1de43ec94f4736b3f123e1c)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:40.238393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72882335-c652-402c-82a9-c3d8df1774af admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:40.240063 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 671/1330] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:54:40 2021] GET /identity/v3/users/d269fd97a1de43ec94f4736b3f123e1c => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:42.495732 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cdbec-4871-4b5e-baf5-ce42d52e7328 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:42.496239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cdbec-4871-4b5e-baf5-ce42d52e7328 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:42.496239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cdbec-4871-4b5e-baf5-ce42d52e7328 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:42.499098 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 660/1331] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:42.505258 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaef7dc-831c-4bd8-b4bd-1dc3079a8e51 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:42.505709 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaef7dc-831c-4bd8-b4bd-1dc3079a8e51 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:42.505798 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaef7dc-831c-4bd8-b4bd-1dc3079a8e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:42.525453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-eaaef7dc-831c-4bd8-b4bd-1dc3079a8e51 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:42.526629 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-eaaef7dc-831c-4bd8-b4bd-1dc3079a8e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:42.534845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 672/1332] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:42.559614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cdbec-4871-4b5e-baf5-ce42d52e7328 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:42.574798 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cdbec-4871-4b5e-baf5-ce42d52e7328 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:42.580210 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baaa59-8453-4587-af3d-6401d5143564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:42.581048 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baaa59-8453-4587-af3d-6401d5143564 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:42.581289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baaa59-8453-4587-af3d-6401d5143564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:42.581573 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baaa59-8453-4587-af3d-6401d5143564 admin admin] PATH_INFO: `/v3/projects/5012a4bb6e5144dc85c9c00926a88eba` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:42.592683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baaa59-8453-4587-af3d-6401d5143564 admin admin] RBAC: Authorizing `identity:get_project(project_id=5012a4bb6e5144dc85c9c00926a88eba)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:42.594759 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baaa59-8453-4587-af3d-6401d5143564 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:42.596461 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 661/1333] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:54:42 2021] GET /identity/v3/projects/5012a4bb6e5144dc85c9c00926a88eba => generated 361 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:42.603301 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaef7dc-831c-4bd8-b4bd-1dc3079a8e51 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:42.612774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaef7dc-831c-4bd8-b4bd-1dc3079a8e51 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:42.617751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c094e8-ed1d-4ee7-8e8c-0bce7cffec65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:42.618383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c094e8-ed1d-4ee7-8e8c-0bce7cffec65 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:42.618662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c094e8-ed1d-4ee7-8e8c-0bce7cffec65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:42.618937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c094e8-ed1d-4ee7-8e8c-0bce7cffec65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:42.619740 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c094e8-ed1d-4ee7-8e8c-0bce7cffec65 admin admin] RBAC: Adding query filter params (scope.project.id=5012a4bb6e5144dc85c9c00926a88eba) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:54:42.620040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c094e8-ed1d-4ee7-8e8c-0bce7cffec65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:42.621860 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c094e8-ed1d-4ee7-8e8c-0bce7cffec65 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:42.627467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 673/1334] 10.222.0.20 () {56 vars in 1231 bytes} [Mon Nov 8 10:54:42 2021] GET /identity/v3/role_assignments?scope.project.id=5012a4bb6e5144dc85c9c00926a88eba => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:54:42.633776 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baaa59-8453-4587-af3d-6401d5143564 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:42.645340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baaa59-8453-4587-af3d-6401d5143564 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:42.650995 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b309e8-81cc-4dd2-9a69-12c6182df0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:42.651887 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b309e8-81cc-4dd2-9a69-12c6182df0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:42.652171 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b309e8-81cc-4dd2-9a69-12c6182df0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:42.652469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b309e8-81cc-4dd2-9a69-12c6182df0c5 admin admin] PATH_INFO: `/v3/users/a6c1033cd71e4f8599dbbb4f8d18da9b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:42.671782 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b309e8-81cc-4dd2-9a69-12c6182df0c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=a6c1033cd71e4f8599dbbb4f8d18da9b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:42.674070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b309e8-81cc-4dd2-9a69-12c6182df0c5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:42.675827 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 662/1335] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:54:42 2021] GET /identity/v3/users/a6c1033cd71e4f8599dbbb4f8d18da9b => generated 311 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:45.021142 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75d18e-1bda-41c1-a709-5531173f19ce None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:45.021738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75d18e-1bda-41c1-a709-5531173f19ce None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:45.022044 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75d18e-1bda-41c1-a709-5531173f19ce None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:45.025116 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 674/1336] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:45.032668 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a66884-716d-4f08-88d3-df9422ebd427 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:45.033622 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a66884-716d-4f08-88d3-df9422ebd427 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:45.033622 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a66884-716d-4f08-88d3-df9422ebd427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:45.057214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-06a66884-716d-4f08-88d3-df9422ebd427 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:45.058434 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-06a66884-716d-4f08-88d3-df9422ebd427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:45.067872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 663/1337] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:45.092401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75d18e-1bda-41c1-a709-5531173f19ce None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:45.106654 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75d18e-1bda-41c1-a709-5531173f19ce None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:45.112485 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896681f-e382-40f0-9452-da4f64653e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:45.113330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896681f-e382-40f0-9452-da4f64653e6d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:45.113609 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896681f-e382-40f0-9452-da4f64653e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:45.113882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896681f-e382-40f0-9452-da4f64653e6d admin admin] PATH_INFO: `/v3/projects/9dec779bc5f842f88b59b29d486b4aa2` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:45.125077 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896681f-e382-40f0-9452-da4f64653e6d admin admin] RBAC: Authorizing `identity:get_project(project_id=9dec779bc5f842f88b59b29d486b4aa2)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:45.127751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896681f-e382-40f0-9452-da4f64653e6d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:45.129452 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 675/1338] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:54:45 2021] GET /identity/v3/projects/9dec779bc5f842f88b59b29d486b4aa2 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:45.136135 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a66884-716d-4f08-88d3-df9422ebd427 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:45.146875 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a66884-716d-4f08-88d3-df9422ebd427 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:45.153130 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d69a9-60d7-4990-a888-33efd9a7bf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:45.153787 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d69a9-60d7-4990-a888-33efd9a7bf2d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:45.154070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d69a9-60d7-4990-a888-33efd9a7bf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:45.154327 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d69a9-60d7-4990-a888-33efd9a7bf2d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:45.155114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d69a9-60d7-4990-a888-33efd9a7bf2d admin admin] RBAC: Adding query filter params (scope.project.id=9dec779bc5f842f88b59b29d486b4aa2) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:54:45.155462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d69a9-60d7-4990-a888-33efd9a7bf2d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:45.157455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d69a9-60d7-4990-a888-33efd9a7bf2d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:45.164602 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 664/1339] 10.222.0.20 () {56 vars in 1231 bytes} [Mon Nov 8 10:54:45 2021] GET /identity/v3/role_assignments?scope.project.id=9dec779bc5f842f88b59b29d486b4aa2 => generated 1934 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 10:54:45.171025 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896681f-e382-40f0-9452-da4f64653e6d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:45.184274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896681f-e382-40f0-9452-da4f64653e6d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:45.191112 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce459d6f-f5cf-40db-818b-b606b791867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:45.192033 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce459d6f-f5cf-40db-818b-b606b791867c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:45.192310 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce459d6f-f5cf-40db-818b-b606b791867c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:45.192582 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce459d6f-f5cf-40db-818b-b606b791867c admin admin] PATH_INFO: `/v3/users/23015594a30b49b885e3a6236f3a6f37` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:45.194018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce459d6f-f5cf-40db-818b-b606b791867c admin admin] RBAC: Authorizing `identity:get_user(user_id=23015594a30b49b885e3a6236f3a6f37)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:45.195858 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce459d6f-f5cf-40db-818b-b606b791867c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:45.197477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 676/1340] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:54:45 2021] GET /identity/v3/users/23015594a30b49b885e3a6236f3a6f37 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:45.204343 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d69a9-60d7-4990-a888-33efd9a7bf2d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:45.215528 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d69a9-60d7-4990-a888-33efd9a7bf2d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:45.221762 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b868d-77e8-4947-b27e-f59f437f69da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:45.222644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b868d-77e8-4947-b27e-f59f437f69da admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:45.222920 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b868d-77e8-4947-b27e-f59f437f69da admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:45.223216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b868d-77e8-4947-b27e-f59f437f69da admin admin] PATH_INFO: `/v3/users/d1c4f01bf6464c349a0eb731c3535142` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:45.238443 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b868d-77e8-4947-b27e-f59f437f69da admin admin] RBAC: Authorizing `identity:get_user(user_id=d1c4f01bf6464c349a0eb731c3535142)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:45.240636 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b868d-77e8-4947-b27e-f59f437f69da admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:45.242288 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 665/1341] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:54:45 2021] GET /identity/v3/users/d1c4f01bf6464c349a0eb731c3535142 => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:54:47.538465 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009d618-5822-4813-9494-f3a687983692 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:47.539422 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009d618-5822-4813-9494-f3a687983692 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:47.539422 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009d618-5822-4813-9494-f3a687983692 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:47.542358 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 677/1342] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:47 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:47.552391 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc6141-4c19-4faa-9dc0-67d6779d834e None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:47.552846 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc6141-4c19-4faa-9dc0-67d6779d834e None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:47.552986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc6141-4c19-4faa-9dc0-67d6779d834e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:47.574265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-54fc6141-4c19-4faa-9dc0-67d6779d834e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:47.575502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-54fc6141-4c19-4faa-9dc0-67d6779d834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:47.583849 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 666/1343] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:47.607439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009d618-5822-4813-9494-f3a687983692 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:47.625175 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009d618-5822-4813-9494-f3a687983692 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:47.630550 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cacd72-8fda-4af1-a992-72d4b328b495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:47.631434 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cacd72-8fda-4af1-a992-72d4b328b495 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:47.631712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cacd72-8fda-4af1-a992-72d4b328b495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:47.631985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cacd72-8fda-4af1-a992-72d4b328b495 admin admin] PATH_INFO: `/v3/projects/b234799dbdd24ab6a455ff56e4aa2a72` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:47.644361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cacd72-8fda-4af1-a992-72d4b328b495 admin admin] RBAC: Authorizing `identity:get_project(project_id=b234799dbdd24ab6a455ff56e4aa2a72)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:47.646473 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cacd72-8fda-4af1-a992-72d4b328b495 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:47.648262 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 678/1344] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:54:47 2021] GET /identity/v3/projects/b234799dbdd24ab6a455ff56e4aa2a72 => generated 311 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 10:54:47.655040 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc6141-4c19-4faa-9dc0-67d6779d834e None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:47.664337 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc6141-4c19-4faa-9dc0-67d6779d834e None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:47.669267 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60618b6-409c-46dc-ab86-09b01e9614cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:47.669902 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60618b6-409c-46dc-ab86-09b01e9614cc admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:47.670179 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60618b6-409c-46dc-ab86-09b01e9614cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:47.670457 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60618b6-409c-46dc-ab86-09b01e9614cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:47.671263 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60618b6-409c-46dc-ab86-09b01e9614cc admin admin] RBAC: Adding query filter params (scope.project.id=b234799dbdd24ab6a455ff56e4aa2a72) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:54:47.671564 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60618b6-409c-46dc-ab86-09b01e9614cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:47.673401 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60618b6-409c-46dc-ab86-09b01e9614cc admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:47.678931 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 667/1345] 10.222.0.20 () {56 vars in 1231 bytes} [Mon Nov 8 10:54:47 2021] GET /identity/v3/role_assignments?scope.project.id=b234799dbdd24ab6a455ff56e4aa2a72 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:47.685398 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cacd72-8fda-4af1-a992-72d4b328b495 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:47.696336 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cacd72-8fda-4af1-a992-72d4b328b495 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:47.702912 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0357a5-50ab-45a3-a702-23c3b34a4a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:47.703926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0357a5-50ab-45a3-a702-23c3b34a4a99 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:47.704203 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0357a5-50ab-45a3-a702-23c3b34a4a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:47.704475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0357a5-50ab-45a3-a702-23c3b34a4a99 admin admin] PATH_INFO: `/v3/users/8b8731bc9d504a409370371bfc53324c` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:47.720451 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0357a5-50ab-45a3-a702-23c3b34a4a99 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b8731bc9d504a409370371bfc53324c)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:47.722523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0357a5-50ab-45a3-a702-23c3b34a4a99 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:47.724219 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 679/1346] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:54:47 2021] GET /identity/v3/users/8b8731bc9d504a409370371bfc53324c => generated 286 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:50.034710 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85784587-d71b-46b6-8744-149417d0e160 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:50.035354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85784587-d71b-46b6-8744-149417d0e160 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:50.035354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85784587-d71b-46b6-8744-149417d0e160 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:50.037138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 668/1347] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:50.046460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2273c-2468-4a68-a6ea-0c0af7c99a00 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:50.046985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2273c-2468-4a68-a6ea-0c0af7c99a00 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:50.047092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2273c-2468-4a68-a6ea-0c0af7c99a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:50.077266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-36c2273c-2468-4a68-a6ea-0c0af7c99a00 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:50.079243 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-36c2273c-2468-4a68-a6ea-0c0af7c99a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:50.089397 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 680/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:50.113655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85784587-d71b-46b6-8744-149417d0e160 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:50.128398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85784587-d71b-46b6-8744-149417d0e160 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:50.134139 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98595-f449-449d-a576-92004d1de7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:50.135057 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98595-f449-449d-a576-92004d1de7ce admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:50.135428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98595-f449-449d-a576-92004d1de7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:50.135745 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98595-f449-449d-a576-92004d1de7ce admin admin] PATH_INFO: `/v3/projects/d6453f0e70ff411fbd16c7407a3e8446` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:50.149058 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d98595-f449-449d-a576-92004d1de7ce admin admin] RBAC: Authorizing `identity:get_project(project_id=d6453f0e70ff411fbd16c7407a3e8446)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:50.151265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d98595-f449-449d-a576-92004d1de7ce admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:50.152953 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 669/1349] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Nov 8 10:54:50 2021] GET /identity/v3/projects/d6453f0e70ff411fbd16c7407a3e8446 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:50.160107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2273c-2468-4a68-a6ea-0c0af7c99a00 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:50.169133 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2273c-2468-4a68-a6ea-0c0af7c99a00 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:50.173937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b579f4-aaca-48fc-a7ac-65146f768e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:50.174576 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b579f4-aaca-48fc-a7ac-65146f768e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:50.174851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b579f4-aaca-48fc-a7ac-65146f768e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:50.175149 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b579f4-aaca-48fc-a7ac-65146f768e48 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:50.175929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b579f4-aaca-48fc-a7ac-65146f768e48 admin admin] RBAC: Adding query filter params (scope.project.id=d6453f0e70ff411fbd16c7407a3e8446) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:54:50.176248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b579f4-aaca-48fc-a7ac-65146f768e48 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:50.178090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b579f4-aaca-48fc-a7ac-65146f768e48 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:50.184653 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 681/1350] 10.222.0.20 () {56 vars in 1231 bytes} [Mon Nov 8 10:54:50 2021] GET /identity/v3/role_assignments?scope.project.id=d6453f0e70ff411fbd16c7407a3e8446 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 10:54:50.192546 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98595-f449-449d-a576-92004d1de7ce admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:50.202350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98595-f449-449d-a576-92004d1de7ce admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:50.207492 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172178d6-fbd5-4165-b454-53c066ef9547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:50.208342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172178d6-fbd5-4165-b454-53c066ef9547 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:50.208618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172178d6-fbd5-4165-b454-53c066ef9547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:50.208885 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172178d6-fbd5-4165-b454-53c066ef9547 admin admin] PATH_INFO: `/v3/users/d269fd97a1de43ec94f4736b3f123e1c` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:50.210186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172178d6-fbd5-4165-b454-53c066ef9547 admin admin] RBAC: Authorizing `identity:get_user(user_id=d269fd97a1de43ec94f4736b3f123e1c)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:50.212313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172178d6-fbd5-4165-b454-53c066ef9547 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:50.213861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 670/1351] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:54:50 2021] GET /identity/v3/users/d269fd97a1de43ec94f4736b3f123e1c => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:50.220645 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b579f4-aaca-48fc-a7ac-65146f768e48 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:50.230979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b579f4-aaca-48fc-a7ac-65146f768e48 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:50.236810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc77224-9a92-488a-86a3-205909ed0596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:50.237715 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc77224-9a92-488a-86a3-205909ed0596 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:50.237996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc77224-9a92-488a-86a3-205909ed0596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:50.238341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc77224-9a92-488a-86a3-205909ed0596 admin admin] PATH_INFO: `/v3/users/23015594a30b49b885e3a6236f3a6f37` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:50.239641 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc77224-9a92-488a-86a3-205909ed0596 admin admin] RBAC: Authorizing `identity:get_user(user_id=23015594a30b49b885e3a6236f3a6f37)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:50.241418 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc77224-9a92-488a-86a3-205909ed0596 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:50.243005 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 682/1352] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Nov 8 10:54:50 2021] GET /identity/v3/users/23015594a30b49b885e3a6236f3a6f37 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:54:55.678051 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec459995-fa5a-443b-8d2e-1b28a7022941 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:55.678661 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec459995-fa5a-443b-8d2e-1b28a7022941 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:55.678661 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec459995-fa5a-443b-8d2e-1b28a7022941 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:55.681224 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 671/1353] 10.222.0.20 () {54 vars in 918 bytes} [Mon Nov 8 10:54:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:55.690273 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be10acd-ec70-4029-883e-bf6bea71bd19 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:55.690797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be10acd-ec70-4029-883e-bf6bea71bd19 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:55.691502 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be10acd-ec70-4029-883e-bf6bea71bd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:55.720412 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-8be10acd-ec70-4029-883e-bf6bea71bd19 None None] MFA Rules not processed for user `642c2b97ece34d69bacd821b108bd210`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:55.721774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8be10acd-ec70-4029-883e-bf6bea71bd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:55.732616 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 683/1354] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Nov 8 10:54:55 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:55.753968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba815e-4d82-4771-a4f4-34850015b363 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:55.754375 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba815e-4d82-4771-a4f4-34850015b363 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:55.754781 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba815e-4d82-4771-a4f4-34850015b363 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:55.756940 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 672/1355] 10.222.0.20 () {54 vars in 918 bytes} [Mon Nov 8 10:54:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:55.762762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1d78-2c52-4335-bca0-3cabe3df6f9c None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:55.763055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1d78-2c52-4335-bca0-3cabe3df6f9c None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:55.763406 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1d78-2c52-4335-bca0-3cabe3df6f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:55.783909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-157a1d78-2c52-4335-bca0-3cabe3df6f9c None None] MFA Rules not processed for user `d3421cf1bbb24423a2f24c4667adfdda`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:55.785149 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-157a1d78-2c52-4335-bca0-3cabe3df6f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:55.796240 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 684/1356] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Nov 8 10:54:55 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:54:58.732802 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a53b32-f902-4614-9a25-589134a82536 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:58.733615 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a53b32-f902-4614-9a25-589134a82536 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:58.733615 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a53b32-f902-4614-9a25-589134a82536 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:58.736505 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 673/1357] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:54:58 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:54:58.742661 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0e50f-e3a8-4452-a83b-394a5b89ba6b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:58.743098 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0e50f-e3a8-4452-a83b-394a5b89ba6b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:58.743248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0e50f-e3a8-4452-a83b-394a5b89ba6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:58.764361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-14d0e50f-e3a8-4452-a83b-394a5b89ba6b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:54:58.765554 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-14d0e50f-e3a8-4452-a83b-394a5b89ba6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:54:58.774302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 685/1358] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:54:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:54:58.821965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a53b32-f902-4614-9a25-589134a82536 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:54:58.841665 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a53b32-f902-4614-9a25-589134a82536 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:54:58.848795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f2f39-2234-48c7-99e8-364f4e09ed06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:54:58.849444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f2f39-2234-48c7-99e8-364f4e09ed06 service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:54:58.849723 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f2f39-2234-48c7-99e8-364f4e09ed06 service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:54:58.850205 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f2f39-2234-48c7-99e8-364f4e09ed06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:54:58.859566 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f2f39-2234-48c7-99e8-364f4e09ed06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:54:58.861414 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f2f39-2234-48c7-99e8-364f4e09ed06 service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:54:58.871477 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 674/1359] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:54:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:00.363689 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb6b93-d8a6-4c18-92d0-93c015204b3e None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:00.364528 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb6b93-d8a6-4c18-92d0-93c015204b3e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:00.364528 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb6b93-d8a6-4c18-92d0-93c015204b3e None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:00.367303 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 686/1360] 10.222.0.20 () {54 vars in 911 bytes} [Mon Nov 8 10:55:00 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:00.376252 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc78224-7a93-4726-aab1-de588d72d7b6 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:00.376705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc78224-7a93-4726-aab1-de588d72d7b6 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:00.376799 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc78224-7a93-4726-aab1-de588d72d7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:00.396945 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-0dc78224-7a93-4726-aab1-de588d72d7b6 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:00.398143 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-0dc78224-7a93-4726-aab1-de588d72d7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:00.406467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 675/1361] 10.222.0.20 () {58 vars in 1008 bytes} [Mon Nov 8 10:55:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:00.570437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb6b93-d8a6-4c18-92d0-93c015204b3e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:00.590376 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb6b93-d8a6-4c18-92d0-93c015204b3e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:00.598346 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4075a0e-666f-4dd9-8a21-7a52b12976a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:00.598996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4075a0e-666f-4dd9-8a21-7a52b12976a1 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:00.599322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4075a0e-666f-4dd9-8a21-7a52b12976a1 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:00.599596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4075a0e-666f-4dd9-8a21-7a52b12976a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:00.608904 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4075a0e-666f-4dd9-8a21-7a52b12976a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:00.610717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4075a0e-666f-4dd9-8a21-7a52b12976a1 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:00.620257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 687/1362] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:02.076126 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fc443-cea7-49ca-aa8a-5c5a4769e7a3 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:02.076702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fc443-cea7-49ca-aa8a-5c5a4769e7a3 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:02.076702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fc443-cea7-49ca-aa8a-5c5a4769e7a3 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:02.079276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 676/1363] 10.222.0.20 () {54 vars in 911 bytes} [Mon Nov 8 10:55:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:02.085164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347d29-20d3-43b2-80f1-541cee915ac8 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:02.085596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347d29-20d3-43b2-80f1-541cee915ac8 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:02.085713 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347d29-20d3-43b2-80f1-541cee915ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:02.105628 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-5a347d29-20d3-43b2-80f1-541cee915ac8 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:02.106844 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-5a347d29-20d3-43b2-80f1-541cee915ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:02.116312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 688/1364] 10.222.0.20 () {58 vars in 1008 bytes} [Mon Nov 8 10:55:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:02.276462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fc443-cea7-49ca-aa8a-5c5a4769e7a3 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:02.292894 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fc443-cea7-49ca-aa8a-5c5a4769e7a3 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:02.301811 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02886b-b8e9-412e-b44c-0beaccc30b68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:02.302673 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02886b-b8e9-412e-b44c-0beaccc30b68 service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:02.302968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02886b-b8e9-412e-b44c-0beaccc30b68 service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:02.303358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02886b-b8e9-412e-b44c-0beaccc30b68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:02.316810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02886b-b8e9-412e-b44c-0beaccc30b68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:02.319368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02886b-b8e9-412e-b44c-0beaccc30b68 service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:02.332229 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 677/1365] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:03.789932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1bd05-5d8e-401c-a3b0-f2046c238a9e None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:03.790507 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1bd05-5d8e-401c-a3b0-f2046c238a9e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:03.790507 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1bd05-5d8e-401c-a3b0-f2046c238a9e None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:03.792227 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 689/1366] 10.222.0.20 () {54 vars in 911 bytes} [Mon Nov 8 10:55:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:03.798198 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f12b4-7fca-478b-ab7a-99d29041a42f None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:03.798616 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f12b4-7fca-478b-ab7a-99d29041a42f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:03.798727 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f12b4-7fca-478b-ab7a-99d29041a42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:03.828043 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-913f12b4-7fca-478b-ab7a-99d29041a42f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:03.830011 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-913f12b4-7fca-478b-ab7a-99d29041a42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:03.839434 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 678/1367] 10.222.0.20 () {58 vars in 1008 bytes} [Mon Nov 8 10:55:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:03.996810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1bd05-5d8e-401c-a3b0-f2046c238a9e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:04.013166 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1bd05-5d8e-401c-a3b0-f2046c238a9e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:04.019532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b041e75-7cab-4adc-b551-dcd4c04f6773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:04.020196 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b041e75-7cab-4adc-b551-dcd4c04f6773 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:04.020483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b041e75-7cab-4adc-b551-dcd4c04f6773 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:04.020761 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b041e75-7cab-4adc-b551-dcd4c04f6773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:04.029327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b041e75-7cab-4adc-b551-dcd4c04f6773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:04.030941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b041e75-7cab-4adc-b551-dcd4c04f6773 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:04.040565 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 690/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:05.499302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0985de-b198-4d87-826c-ade27c35aa81 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:05.499827 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0985de-b198-4d87-826c-ade27c35aa81 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:05.499827 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0985de-b198-4d87-826c-ade27c35aa81 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:05.501705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 679/1369] 10.222.0.20 () {54 vars in 911 bytes} [Mon Nov 8 10:55:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:05.508437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae71ef-db99-4ead-ba88-d2977c4f7db7 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:05.508858 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae71ef-db99-4ead-ba88-d2977c4f7db7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:05.508970 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae71ef-db99-4ead-ba88-d2977c4f7db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:05.536054 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-25ae71ef-db99-4ead-ba88-d2977c4f7db7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:05.537259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-25ae71ef-db99-4ead-ba88-d2977c4f7db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:05.546157 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 691/1370] 10.222.0.20 () {58 vars in 1008 bytes} [Mon Nov 8 10:55:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:05.709036 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0985de-b198-4d87-826c-ade27c35aa81 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:05.729446 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0985de-b198-4d87-826c-ade27c35aa81 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:05.736331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6788ec3-83a7-44ff-8d0f-efdc519662f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:05.736977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6788ec3-83a7-44ff-8d0f-efdc519662f8 service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:05.737261 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6788ec3-83a7-44ff-8d0f-efdc519662f8 service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:05.737539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6788ec3-83a7-44ff-8d0f-efdc519662f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:05.745816 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6788ec3-83a7-44ff-8d0f-efdc519662f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:05.747447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6788ec3-83a7-44ff-8d0f-efdc519662f8 service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:05.757269 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 680/1371] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:07.192459 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f617d-4b83-4e34-9e0f-13399da3386a None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:07.193367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f617d-4b83-4e34-9e0f-13399da3386a None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:07.193367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f617d-4b83-4e34-9e0f-13399da3386a None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:07.196272 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 692/1372] 10.222.0.20 () {54 vars in 911 bytes} [Mon Nov 8 10:55:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:07.202797 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15f42-9084-494b-a3d1-16e172a1cce3 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:07.203425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15f42-9084-494b-a3d1-16e172a1cce3 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:07.203576 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15f42-9084-494b-a3d1-16e172a1cce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:07.229040 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-5fa15f42-9084-494b-a3d1-16e172a1cce3 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:07.230231 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5fa15f42-9084-494b-a3d1-16e172a1cce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:07.238900 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 681/1373] 10.222.0.20 () {58 vars in 1008 bytes} [Mon Nov 8 10:55:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:07.404651 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f617d-4b83-4e34-9e0f-13399da3386a None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:07.426236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f617d-4b83-4e34-9e0f-13399da3386a None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:07.432572 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87cf66-4b27-4601-841f-466fe0754098 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:07.433679 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87cf66-4b27-4601-841f-466fe0754098 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:07.433679 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87cf66-4b27-4601-841f-466fe0754098 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:07.433888 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87cf66-4b27-4601-841f-466fe0754098 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:07.442111 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87cf66-4b27-4601-841f-466fe0754098 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:07.443792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87cf66-4b27-4601-841f-466fe0754098 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:07.453189 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 693/1374] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:08.830495 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec0444-696f-40b8-8c51-5a26b0a33aff None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:08.831357 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec0444-696f-40b8-8c51-5a26b0a33aff None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:08.831357 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec0444-696f-40b8-8c51-5a26b0a33aff None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:08.834161 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 682/1375] 10.222.0.20 () {54 vars in 911 bytes} [Mon Nov 8 10:55:08 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:08.840863 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47ffa5-af65-4d00-bb65-ca48810ec1ee None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:08.841302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47ffa5-af65-4d00-bb65-ca48810ec1ee None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:08.841438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47ffa5-af65-4d00-bb65-ca48810ec1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:08.867118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-3e47ffa5-af65-4d00-bb65-ca48810ec1ee None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:08.868350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-3e47ffa5-af65-4d00-bb65-ca48810ec1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:08.877168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 694/1376] 10.222.0.20 () {58 vars in 1008 bytes} [Mon Nov 8 10:55:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:09.032943 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec0444-696f-40b8-8c51-5a26b0a33aff None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:09.049135 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec0444-696f-40b8-8c51-5a26b0a33aff None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:09.055825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d3feb-8806-42bf-a515-e300c16e5dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:09.056457 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d3feb-8806-42bf-a515-e300c16e5dfe service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:09.056733 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d3feb-8806-42bf-a515-e300c16e5dfe service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:09.057007 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d3feb-8806-42bf-a515-e300c16e5dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:09.067529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d3feb-8806-42bf-a515-e300c16e5dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:09.069125 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d3feb-8806-42bf-a515-e300c16e5dfe service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:09.078581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 683/1377] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:10.503811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43696e7-7d72-49eb-94e9-33bc6e65bda5 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:10.504381 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43696e7-7d72-49eb-94e9-33bc6e65bda5 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:10.504381 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43696e7-7d72-49eb-94e9-33bc6e65bda5 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:10.506160 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 695/1378] 10.222.0.20 () {54 vars in 911 bytes} [Mon Nov 8 10:55:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:10.511786 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f27fc-084f-4803-af32-ae04223b37e6 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:10.512227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f27fc-084f-4803-af32-ae04223b37e6 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:10.512327 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f27fc-084f-4803-af32-ae04223b37e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:10.531732 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-e89f27fc-084f-4803-af32-ae04223b37e6 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:10.532982 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e89f27fc-084f-4803-af32-ae04223b37e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:10.541657 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 684/1379] 10.222.0.20 () {58 vars in 1008 bytes} [Mon Nov 8 10:55:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:10.693385 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43696e7-7d72-49eb-94e9-33bc6e65bda5 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:10.708395 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43696e7-7d72-49eb-94e9-33bc6e65bda5 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:10.714765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ade4b-8410-4991-bc15-d4850a247853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:10.715453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ade4b-8410-4991-bc15-d4850a247853 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:10.715773 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ade4b-8410-4991-bc15-d4850a247853 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:10.716026 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ade4b-8410-4991-bc15-d4850a247853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:10.725023 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ade4b-8410-4991-bc15-d4850a247853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:10.726584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ade4b-8410-4991-bc15-d4850a247853 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:10.736573 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 696/1380] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:12.150628 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62e5fc-e6bb-47f6-9290-cf88be7c739c None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:12.151226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62e5fc-e6bb-47f6-9290-cf88be7c739c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:12.151226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62e5fc-e6bb-47f6-9290-cf88be7c739c None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:12.153015 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 685/1381] 10.222.0.20 () {54 vars in 911 bytes} [Mon Nov 8 10:55:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:12.162166 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ad003-1d8c-4a68-85b8-e3e211e00316 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:12.162690 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ad003-1d8c-4a68-85b8-e3e211e00316 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:12.162791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ad003-1d8c-4a68-85b8-e3e211e00316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:12.189509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-4c8ad003-1d8c-4a68-85b8-e3e211e00316 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:12.190784 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4c8ad003-1d8c-4a68-85b8-e3e211e00316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:12.200647 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 697/1382] 10.222.0.20 () {58 vars in 1008 bytes} [Mon Nov 8 10:55:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:12.364673 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62e5fc-e6bb-47f6-9290-cf88be7c739c None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:12.384552 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62e5fc-e6bb-47f6-9290-cf88be7c739c None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:12.391643 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096456f-65a9-4923-9299-4adb630f8ccf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:12.392291 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096456f-65a9-4923-9299-4adb630f8ccf service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:12.392582 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096456f-65a9-4923-9299-4adb630f8ccf service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:12.392850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096456f-65a9-4923-9299-4adb630f8ccf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:12.401366 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096456f-65a9-4923-9299-4adb630f8ccf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:12.402973 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096456f-65a9-4923-9299-4adb630f8ccf service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:12.412950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 686/1383] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:14.598333 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb014739-fc04-4b6b-9910-75951fd85bb7 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:14.599067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb014739-fc04-4b6b-9910-75951fd85bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:14.599067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb014739-fc04-4b6b-9910-75951fd85bb7 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:14.600715 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 698/1384] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:55:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:14.607025 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1631-b222-4400-9dee-df8d7000238f None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:14.607499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1631-b222-4400-9dee-df8d7000238f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:14.607611 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1631-b222-4400-9dee-df8d7000238f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:14.626334 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8cab1631-b222-4400-9dee-df8d7000238f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:14.627571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8cab1631-b222-4400-9dee-df8d7000238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:14.636386 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 687/1385] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:55:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:14.676601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb014739-fc04-4b6b-9910-75951fd85bb7 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:14.678678 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-cb014739-fc04-4b6b-9910-75951fd85bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:14.692059 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb014739-fc04-4b6b-9910-75951fd85bb7 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:14.695894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864aad47-42d5-431f-a2f6-c8f0b596587d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:14.696525 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aad47-42d5-431f-a2f6-c8f0b596587d service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:14.696806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aad47-42d5-431f-a2f6-c8f0b596587d service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:14.697082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aad47-42d5-431f-a2f6-c8f0b596587d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:14.706177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aad47-42d5-431f-a2f6-c8f0b596587d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:14.707647 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aad47-42d5-431f-a2f6-c8f0b596587d service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:14.716706 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 699/1386] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:17.127955 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888151f-60cd-466f-bf86-523c1244f230 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:17.128578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888151f-60cd-466f-bf86-523c1244f230 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:17.128578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888151f-60cd-466f-bf86-523c1244f230 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:17.130303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 688/1387] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:55:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:17.137397 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a46ae3-400a-4c45-a48f-4b4411d1a882 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:17.138125 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a46ae3-400a-4c45-a48f-4b4411d1a882 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:17.138291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a46ae3-400a-4c45-a48f-4b4411d1a882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:17.157778 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-c1a46ae3-400a-4c45-a48f-4b4411d1a882 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:17.158983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c1a46ae3-400a-4c45-a48f-4b4411d1a882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:17.168302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 700/1388] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:55:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:17.209310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888151f-60cd-466f-bf86-523c1244f230 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:17.221550 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888151f-60cd-466f-bf86-523c1244f230 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:17.225784 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6736add-6935-4c67-9352-4f09aef4047a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:17.226416 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6736add-6935-4c67-9352-4f09aef4047a service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:17.226694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6736add-6935-4c67-9352-4f09aef4047a service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:17.226966 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6736add-6935-4c67-9352-4f09aef4047a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:17.236690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6736add-6935-4c67-9352-4f09aef4047a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:17.238130 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6736add-6935-4c67-9352-4f09aef4047a service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:17.247396 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 689/1389] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:19.808570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b1e5e-6e62-418d-8338-fb9445a2c7c0 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:19.809206 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b1e5e-6e62-418d-8338-fb9445a2c7c0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:19.809206 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b1e5e-6e62-418d-8338-fb9445a2c7c0 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:19.810895 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 701/1390] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:55:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:19.817543 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db130f2-a6a8-4a09-8996-862054581fbf None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:19.818482 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db130f2-a6a8-4a09-8996-862054581fbf None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:19.819066 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db130f2-a6a8-4a09-8996-862054581fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:19.836704 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-5db130f2-a6a8-4a09-8996-862054581fbf None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:19.837884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5db130f2-a6a8-4a09-8996-862054581fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:19.845719 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 690/1391] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:55:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:55:19.886919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b1e5e-6e62-418d-8338-fb9445a2c7c0 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:19.898333 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b1e5e-6e62-418d-8338-fb9445a2c7c0 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:19.901833 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57b4e5-a7fc-499d-bb30-ec01159510f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:19.902468 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57b4e5-a7fc-499d-bb30-ec01159510f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:19.902745 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57b4e5-a7fc-499d-bb30-ec01159510f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:19.903011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57b4e5-a7fc-499d-bb30-ec01159510f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:19.912187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57b4e5-a7fc-499d-bb30-ec01159510f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:19.913634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57b4e5-a7fc-499d-bb30-ec01159510f6 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:19.923458 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 702/1392] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:22.340737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0522251-a492-4df6-9ca4-c1d1dea3711d None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:22.341303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0522251-a492-4df6-9ca4-c1d1dea3711d None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:22.341303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0522251-a492-4df6-9ca4-c1d1dea3711d None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:22.342981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 691/1393] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:55:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:22.350386 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388ef4-5e6d-4393-a38d-9e1352a50956 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:22.351101 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388ef4-5e6d-4393-a38d-9e1352a50956 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:22.351268 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388ef4-5e6d-4393-a38d-9e1352a50956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:22.373406 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-58388ef4-5e6d-4393-a38d-9e1352a50956 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:22.374618 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-58388ef4-5e6d-4393-a38d-9e1352a50956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:22.384439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 703/1394] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:55:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:22.425617 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0522251-a492-4df6-9ca4-c1d1dea3711d None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:22.444777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0522251-a492-4df6-9ca4-c1d1dea3711d None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:22.451986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2de67-092b-495e-a6db-dbc5bbf7ddca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:22.453149 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2de67-092b-495e-a6db-dbc5bbf7ddca service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:22.453560 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2de67-092b-495e-a6db-dbc5bbf7ddca service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:22.453968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2de67-092b-495e-a6db-dbc5bbf7ddca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:22.464010 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2de67-092b-495e-a6db-dbc5bbf7ddca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:22.465500 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2de67-092b-495e-a6db-dbc5bbf7ddca service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:22.478371 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 692/1395] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:24.767037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606ac3-8700-4aa3-b1cf-7a7cfc2d86e2 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:24.767621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606ac3-8700-4aa3-b1cf-7a7cfc2d86e2 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:24.767621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606ac3-8700-4aa3-b1cf-7a7cfc2d86e2 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:24.769303 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 704/1396] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:55:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:24.776499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc37ef-975f-435c-a7f0-f95afd40bf6f None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:24.777266 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc37ef-975f-435c-a7f0-f95afd40bf6f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:24.777391 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc37ef-975f-435c-a7f0-f95afd40bf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:24.803963 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-a1fc37ef-975f-435c-a7f0-f95afd40bf6f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:24.805160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-a1fc37ef-975f-435c-a7f0-f95afd40bf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:24.814948 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 693/1397] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:55:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:24.856837 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e606ac3-8700-4aa3-b1cf-7a7cfc2d86e2 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:24.871252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e606ac3-8700-4aa3-b1cf-7a7cfc2d86e2 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:24.876299 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e621d-038a-46b9-ba8e-29e66d4c34b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:24.876942 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e621d-038a-46b9-ba8e-29e66d4c34b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:24.877227 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e621d-038a-46b9-ba8e-29e66d4c34b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:24.877504 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e621d-038a-46b9-ba8e-29e66d4c34b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:24.888469 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e621d-038a-46b9-ba8e-29e66d4c34b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:24.891298 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e621d-038a-46b9-ba8e-29e66d4c34b9 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:24.906559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 705/1398] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:27.238870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c2907-165e-4601-8664-fab0f7ebf73c None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:27.239509 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c2907-165e-4601-8664-fab0f7ebf73c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:27.239509 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c2907-165e-4601-8664-fab0f7ebf73c None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:27.241240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 694/1399] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:55:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:27.247457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab376-73c8-4217-a8c5-cc29ece280e6 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:27.247933 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab376-73c8-4217-a8c5-cc29ece280e6 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:27.248027 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab376-73c8-4217-a8c5-cc29ece280e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:27.267393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-890ab376-73c8-4217-a8c5-cc29ece280e6 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:27.268597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-890ab376-73c8-4217-a8c5-cc29ece280e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:27.277634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 706/1400] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:55:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:27.321741 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c2907-165e-4601-8664-fab0f7ebf73c None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:27.339872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c2907-165e-4601-8664-fab0f7ebf73c None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:27.345027 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8ff45-6916-4f64-8985-84871a89151d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:27.345683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ff45-6916-4f64-8985-84871a89151d service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:27.345970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ff45-6916-4f64-8985-84871a89151d service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:27.346248 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ff45-6916-4f64-8985-84871a89151d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:27.355863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8ff45-6916-4f64-8985-84871a89151d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:27.357327 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8ff45-6916-4f64-8985-84871a89151d service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:27.367263 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 695/1401] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:29.712085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dbb2b-5068-436d-b86c-1c6e67eb7873 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:29.712697 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dbb2b-5068-436d-b86c-1c6e67eb7873 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:29.712697 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dbb2b-5068-436d-b86c-1c6e67eb7873 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:29.714436 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 707/1402] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:55:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:55:29.720979 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d565b-ff41-474a-b81e-19a24271f85e None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:29.721421 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d565b-ff41-474a-b81e-19a24271f85e None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:29.721421 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d565b-ff41-474a-b81e-19a24271f85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:29.741601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-2f3d565b-ff41-474a-b81e-19a24271f85e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:29.742843 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2f3d565b-ff41-474a-b81e-19a24271f85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:29.751409 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 696/1403] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:55:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:29.790167 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dbb2b-5068-436d-b86c-1c6e67eb7873 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:29.801561 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dbb2b-5068-436d-b86c-1c6e67eb7873 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:29.805536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae438a6-5499-4825-87a6-48e44b10663d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:29.806181 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae438a6-5499-4825-87a6-48e44b10663d service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:29.806460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae438a6-5499-4825-87a6-48e44b10663d service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:29.806751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae438a6-5499-4825-87a6-48e44b10663d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:29.818218 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae438a6-5499-4825-87a6-48e44b10663d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:29.819729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae438a6-5499-4825-87a6-48e44b10663d service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:29.829698 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 708/1404] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:32.161778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583fbd8-3b9a-4b08-9906-b6ce903f2ff3 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:32.162379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583fbd8-3b9a-4b08-9906-b6ce903f2ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:32.162379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583fbd8-3b9a-4b08-9906-b6ce903f2ff3 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:32.164143 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 697/1405] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:55:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:32.171451 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc536884-202e-4ec6-8cf2-af2300b9e7a8 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:32.171945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc536884-202e-4ec6-8cf2-af2300b9e7a8 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:32.172092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc536884-202e-4ec6-8cf2-af2300b9e7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:32.191026 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-cc536884-202e-4ec6-8cf2-af2300b9e7a8 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:32.192261 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-cc536884-202e-4ec6-8cf2-af2300b9e7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:32.201247 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 709/1406] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:55:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:32.244065 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583fbd8-3b9a-4b08-9906-b6ce903f2ff3 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:32.262806 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583fbd8-3b9a-4b08-9906-b6ce903f2ff3 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:32.269071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03aed2-3fa9-4c9b-9a32-d20960099239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:32.269713 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03aed2-3fa9-4c9b-9a32-d20960099239 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:32.269986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03aed2-3fa9-4c9b-9a32-d20960099239 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:32.270254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03aed2-3fa9-4c9b-9a32-d20960099239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:32.279988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03aed2-3fa9-4c9b-9a32-d20960099239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:32.281453 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03aed2-3fa9-4c9b-9a32-d20960099239 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:32.290656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 698/1407] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:34.593175 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda31bb-9557-4e78-a89e-f23c6707b09b None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:34.593763 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda31bb-9557-4e78-a89e-f23c6707b09b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:34.594048 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda31bb-9557-4e78-a89e-f23c6707b09b None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:34.595916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 710/1408] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:55:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:34.602392 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9b88d-7f74-4d47-8bdc-a807a544396f None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:34.602810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9b88d-7f74-4d47-8bdc-a807a544396f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:34.602921 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9b88d-7f74-4d47-8bdc-a807a544396f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:34.621888 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-44a9b88d-7f74-4d47-8bdc-a807a544396f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:34.623078 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-44a9b88d-7f74-4d47-8bdc-a807a544396f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:34.631870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 699/1409] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:55:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:34.675369 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda31bb-9557-4e78-a89e-f23c6707b09b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:34.692078 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda31bb-9557-4e78-a89e-f23c6707b09b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:34.696170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d2067-9003-4e7b-84a9-9e192bc770d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:34.696804 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2067-9003-4e7b-84a9-9e192bc770d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:34.697082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2067-9003-4e7b-84a9-9e192bc770d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:34.697353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2067-9003-4e7b-84a9-9e192bc770d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:34.707281 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d2067-9003-4e7b-84a9-9e192bc770d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:34.708741 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d2067-9003-4e7b-84a9-9e192bc770d8 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:34.718220 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 711/1410] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:36.953915 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e7f98-8850-4b77-9d57-63970b2f6893 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:36.954775 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e7f98-8850-4b77-9d57-63970b2f6893 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:36.954944 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e7f98-8850-4b77-9d57-63970b2f6893 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:36.957879 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 700/1411] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:55:36 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:36.968080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39629713-633f-45cd-86fb-3aedc8923fa4 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:36.969162 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39629713-633f-45cd-86fb-3aedc8923fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:36.969162 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39629713-633f-45cd-86fb-3aedc8923fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:36.988170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-39629713-633f-45cd-86fb-3aedc8923fa4 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:36.989384 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-39629713-633f-45cd-86fb-3aedc8923fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:36.998560 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 712/1412] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:55:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:37.051867 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e7f98-8850-4b77-9d57-63970b2f6893 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:37.068366 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e7f98-8850-4b77-9d57-63970b2f6893 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:37.073098 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10183df8-6dbe-44e1-85c6-1ad1e2783d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:37.073741 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10183df8-6dbe-44e1-85c6-1ad1e2783d8e service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:37.074028 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10183df8-6dbe-44e1-85c6-1ad1e2783d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:37.074294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10183df8-6dbe-44e1-85c6-1ad1e2783d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:37.083969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10183df8-6dbe-44e1-85c6-1ad1e2783d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:37.085400 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10183df8-6dbe-44e1-85c6-1ad1e2783d8e service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:37.094821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 701/1413] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:53.929814 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c34d0-bd1b-4465-8873-46251147fecb None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:53.930428 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c34d0-bd1b-4465-8873-46251147fecb None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:53.930428 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c34d0-bd1b-4465-8873-46251147fecb None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:53.932200 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 713/1414] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:55:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:53.940101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8458ef-4027-4817-b5e1-44da9b683bcd None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:53.940851 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8458ef-4027-4817-b5e1-44da9b683bcd None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:53.940955 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8458ef-4027-4817-b5e1-44da9b683bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:53.964228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-bf8458ef-4027-4817-b5e1-44da9b683bcd None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:53.965433 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-bf8458ef-4027-4817-b5e1-44da9b683bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:53.974258 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 702/1415] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:55:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 10:55:54.027389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bf750-aae3-4d5d-ac72-73395c437f4e None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:54.027673 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bf750-aae3-4d5d-ac72-73395c437f4e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:54.027949 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bf750-aae3-4d5d-ac72-73395c437f4e None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:54.029713 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 714/1416] 10.222.0.20 () {54 vars in 962 bytes} [Mon Nov 8 10:55:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:55:54.036516 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c9f12-5c32-4d0d-ab88-ca655b52de0d None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:54.036821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c9f12-5c32-4d0d-ab88-ca655b52de0d None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:54.037080 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c9f12-5c32-4d0d-ab88-ca655b52de0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:54.056815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-5b8c9f12-5c32-4d0d-ab88-ca655b52de0d None None] MFA Rules not processed for user `07a71b8adef243049d3b055e66566a63`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:54.058020 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5b8c9f12-5c32-4d0d-ab88-ca655b52de0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:54.065663 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 703/1417] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Nov 8 10:55:54 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:54.073457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bf750-aae3-4d5d-ac72-73395c437f4e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:54.085896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bf750-aae3-4d5d-ac72-73395c437f4e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:54.090629 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c93986-5d7b-4c86-b80d-b22001f5568c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a71b8adef243049d3b055e66566a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:54.091300 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c93986-5d7b-4c86-b80d-b22001f5568c service glance] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:54.091587 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c93986-5d7b-4c86-b80d-b22001f5568c service glance] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:54.091862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c93986-5d7b-4c86-b80d-b22001f5568c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:54.101269 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c93986-5d7b-4c86-b80d-b22001f5568c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:54.102704 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c93986-5d7b-4c86-b80d-b22001f5568c service glance] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:54.112239 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 715/1418] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:55:56.529807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db563-7f83-49dd-8467-18a5dac833d4 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:56.530515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db563-7f83-49dd-8467-18a5dac833d4 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:56.530515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db563-7f83-49dd-8467-18a5dac833d4 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:56.532265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 704/1419] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:55:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:56.539390 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badbf23-fce7-4d4f-ad5e-f397a1611722 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:56.540150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badbf23-fce7-4d4f-ad5e-f397a1611722 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:56.540335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badbf23-fce7-4d4f-ad5e-f397a1611722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:56.566849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-8badbf23-fce7-4d4f-ad5e-f397a1611722 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:56.568096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8badbf23-fce7-4d4f-ad5e-f397a1611722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:56.577257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 716/1420] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:55:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:56.602355 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2db563-7f83-49dd-8467-18a5dac833d4 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:56.616972 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2db563-7f83-49dd-8467-18a5dac833d4 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:56.622381 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22596e40-d7fc-4c3c-84cd-c73cf47062ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:56.623029 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22596e40-d7fc-4c3c-84cd-c73cf47062ad admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:56.623337 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22596e40-d7fc-4c3c-84cd-c73cf47062ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:56.623609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22596e40-d7fc-4c3c-84cd-c73cf47062ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:56.624402 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22596e40-d7fc-4c3c-84cd-c73cf47062ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:56.626245 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22596e40-d7fc-4c3c-84cd-c73cf47062ad admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:56.645268 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 705/1421] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Nov 8 10:55:56 2021] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 10:55:58.952359 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526be34d-66d3-41c3-bafe-b76363390f6d None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:58.952913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526be34d-66d3-41c3-bafe-b76363390f6d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:58.952913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526be34d-66d3-41c3-bafe-b76363390f6d None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:58.954774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 717/1422] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:55:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:55:58.961914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134c2d-2ba2-4199-bc53-9526d8487436 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:58.962722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134c2d-2ba2-4199-bc53-9526d8487436 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:58.962870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134c2d-2ba2-4199-bc53-9526d8487436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:58.984991 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-ac134c2d-2ba2-4199-bc53-9526d8487436 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:55:58.986195 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-ac134c2d-2ba2-4199-bc53-9526d8487436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:55:58.995182 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 706/1423] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:55:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:55:59.040938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526be34d-66d3-41c3-bafe-b76363390f6d None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:55:59.056578 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526be34d-66d3-41c3-bafe-b76363390f6d None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:55:59.063403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339558ce-f785-4937-91c7-99348fe70552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:55:59.064035 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339558ce-f785-4937-91c7-99348fe70552 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:55:59.064319 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339558ce-f785-4937-91c7-99348fe70552 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:55:59.064599 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339558ce-f785-4937-91c7-99348fe70552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:55:59.072760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339558ce-f785-4937-91c7-99348fe70552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:55:59.074357 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339558ce-f785-4937-91c7-99348fe70552 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:55:59.083740 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 718/1424] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:55:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:56:01.568835 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69769-7ad3-4a3a-aca6-0ebe8083832c None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:56:01.569423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69769-7ad3-4a3a-aca6-0ebe8083832c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:56:01.569423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69769-7ad3-4a3a-aca6-0ebe8083832c None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:56:01.571156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 707/1425] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:56:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:56:01.578289 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592b6cc-dc9e-4c5e-9b50-71878e4aaaa8 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:56:01.578712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592b6cc-dc9e-4c5e-9b50-71878e4aaaa8 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:56:01.578804 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592b6cc-dc9e-4c5e-9b50-71878e4aaaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:56:01.607187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-d592b6cc-dc9e-4c5e-9b50-71878e4aaaa8 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:56:01.608825 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d592b6cc-dc9e-4c5e-9b50-71878e4aaaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:56:01.617394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 719/1426] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:56:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:56:01.658103 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69769-7ad3-4a3a-aca6-0ebe8083832c None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:56:01.675546 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69769-7ad3-4a3a-aca6-0ebe8083832c None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:56:01.682408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611233c-d63b-4b53-9cfc-25be6e54b632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:56:01.683421 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611233c-d63b-4b53-9cfc-25be6e54b632 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:56:01.683802 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611233c-d63b-4b53-9cfc-25be6e54b632 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:56:01.684152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611233c-d63b-4b53-9cfc-25be6e54b632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:56:01.695164 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611233c-d63b-4b53-9cfc-25be6e54b632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:56:01.696642 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611233c-d63b-4b53-9cfc-25be6e54b632 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:56:01.706550 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 708/1427] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:56:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:56:04.020560 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901ea60-befa-4696-8e19-f49b3620f7cd None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:56:04.021067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901ea60-befa-4696-8e19-f49b3620f7cd None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:56:04.021067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901ea60-befa-4696-8e19-f49b3620f7cd None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:56:04.022912 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 720/1428] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:56:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:56:04.034223 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a926c3-4ada-42aa-b16d-e7f99b01a544 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:56:04.034680 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a926c3-4ada-42aa-b16d-e7f99b01a544 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:56:04.034794 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a926c3-4ada-42aa-b16d-e7f99b01a544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:56:04.063274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-e6a926c3-4ada-42aa-b16d-e7f99b01a544 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:56:04.064512 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e6a926c3-4ada-42aa-b16d-e7f99b01a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:56:04.073904 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 709/1429] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:56:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:56:04.113700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901ea60-befa-4696-8e19-f49b3620f7cd None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:56:04.125864 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901ea60-befa-4696-8e19-f49b3620f7cd None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:56:04.129891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6168fda-bbcb-42db-a061-96f5ed166459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:56:04.130527 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6168fda-bbcb-42db-a061-96f5ed166459 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:56:04.130812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6168fda-bbcb-42db-a061-96f5ed166459 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:56:04.131090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6168fda-bbcb-42db-a061-96f5ed166459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:56:04.141188 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6168fda-bbcb-42db-a061-96f5ed166459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:56:04.142634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6168fda-bbcb-42db-a061-96f5ed166459 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:56:04.152101 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 721/1430] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:56:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:56:06.587920 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a15a4-14c5-439c-bc01-20522fc06f7b None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:56:06.588700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a15a4-14c5-439c-bc01-20522fc06f7b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:56:06.588700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a15a4-14c5-439c-bc01-20522fc06f7b None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:56:06.591533 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 710/1431] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:56:06 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:56:06.597605 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f121fb3-e780-4106-a0dd-a91bd5045b14 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:56:06.598029 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f121fb3-e780-4106-a0dd-a91bd5045b14 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:56:06.598139 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f121fb3-e780-4106-a0dd-a91bd5045b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:56:06.623084 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-7f121fb3-e780-4106-a0dd-a91bd5045b14 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:56:06.624853 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7f121fb3-e780-4106-a0dd-a91bd5045b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:56:06.639232 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 722/1432] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:56:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:56:06.689534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a15a4-14c5-439c-bc01-20522fc06f7b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:56:06.704985 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a15a4-14c5-439c-bc01-20522fc06f7b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:56:06.709422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1caffd-4b9a-44ed-b577-e707caf456c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:56:06.710098 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1caffd-4b9a-44ed-b577-e707caf456c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:56:06.710384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1caffd-4b9a-44ed-b577-e707caf456c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:56:06.710668 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1caffd-4b9a-44ed-b577-e707caf456c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:56:06.720616 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1caffd-4b9a-44ed-b577-e707caf456c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:56:06.722006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1caffd-4b9a-44ed-b577-e707caf456c3 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:56:06.731485 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 711/1433] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:56:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:56:09.225167 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258188c4-b067-404d-adcc-585865508b3a None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:56:09.225797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258188c4-b067-404d-adcc-585865508b3a None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:56:09.225797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258188c4-b067-404d-adcc-585865508b3a None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:56:09.227536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 723/1434] 10.222.0.20 () {54 vars in 926 bytes} [Mon Nov 8 10:56:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:56:09.234646 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23c7ab-82d8-49b6-9b2a-6f3b4d24b15c None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:56:09.235397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23c7ab-82d8-49b6-9b2a-6f3b4d24b15c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:56:09.235547 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23c7ab-82d8-49b6-9b2a-6f3b4d24b15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:56:09.260036 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8b23c7ab-82d8-49b6-9b2a-6f3b4d24b15c None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:56:09.261279 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8b23c7ab-82d8-49b6-9b2a-6f3b4d24b15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:56:09.271256 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 712/1435] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Nov 8 10:56:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:56:09.312745 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258188c4-b067-404d-adcc-585865508b3a None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:56:09.331386 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258188c4-b067-404d-adcc-585865508b3a None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:56:09.338532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ffc29-d50a-49b3-97fc-992563f09cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:56:09.339500 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ffc29-d50a-49b3-97fc-992563f09cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:56:09.339882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ffc29-d50a-49b3-97fc-992563f09cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:56:09.340211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ffc29-d50a-49b3-97fc-992563f09cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:56:09.351208 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ffc29-d50a-49b3-97fc-992563f09cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:56:09.352670 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ffc29-d50a-49b3-97fc-992563f09cd7 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:56:09.364604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 724/1436] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:56:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:57:30.122154 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c6d86-ac9b-41e0-b048-a7c0549b52d1 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:30.123013 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c6d86-ac9b-41e0-b048-a7c0549b52d1 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:30.123013 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c6d86-ac9b-41e0-b048-a7c0549b52d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:30.149076 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8a4c6d86-ac9b-41e0-b048-a7c0549b52d1 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:57:30.150238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8a4c6d86-ac9b-41e0-b048-a7c0549b52d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:57:30.158958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 713/1437] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 10:57:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:57:30.167021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927bec0-7dcd-4580-9ed8-92e378a9bb51 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:30.167561 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927bec0-7dcd-4580-9ed8-92e378a9bb51 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:30.167561 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927bec0-7dcd-4580-9ed8-92e378a9bb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:30.186521 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-4927bec0-7dcd-4580-9ed8-92e378a9bb51 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:57:30.188070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4927bec0-7dcd-4580-9ed8-92e378a9bb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:57:30.197322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 725/1438] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 10:57:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:57:30.202811 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c6d86-ac9b-41e0-b048-a7c0549b52d1 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:57:30.214017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c6d86-ac9b-41e0-b048-a7c0549b52d1 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:57:30.219885 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e20e9d-55b0-4651-b542-a4da6914411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:57:30.220580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e20e9d-55b0-4651-b542-a4da6914411c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:30.220863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e20e9d-55b0-4651-b542-a4da6914411c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:30.221130 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e20e9d-55b0-4651-b542-a4da6914411c admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:30.221873 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e20e9d-55b0-4651-b542-a4da6914411c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 10:57:30.222175 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e20e9d-55b0-4651-b542-a4da6914411c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:57:30.223824 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e20e9d-55b0-4651-b542-a4da6914411c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:57:30.239299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 714/1439] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 10:57:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:57:30.247886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927bec0-7dcd-4580-9ed8-92e378a9bb51 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:57:30.257809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927bec0-7dcd-4580-9ed8-92e378a9bb51 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:57:30.264214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26522053-0fe7-405d-a9fd-cfff986a729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:57:30.264874 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26522053-0fe7-405d-a9fd-cfff986a729c admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:30.265156 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26522053-0fe7-405d-a9fd-cfff986a729c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:30.265660 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26522053-0fe7-405d-a9fd-cfff986a729c admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:30.266401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26522053-0fe7-405d-a9fd-cfff986a729c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:57:30.268345 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26522053-0fe7-405d-a9fd-cfff986a729c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:57:30.308535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 726/1440] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 10:57:30 2021] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:57:30.313025 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e20e9d-55b0-4651-b542-a4da6914411c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:57:30.323179 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e20e9d-55b0-4651-b542-a4da6914411c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:57:30.379325 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bf77b-6004-4026-af27-2fa32d4969fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:57:30.379995 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bf77b-6004-4026-af27-2fa32d4969fe admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:30.380278 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bf77b-6004-4026-af27-2fa32d4969fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:30.380557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bf77b-6004-4026-af27-2fa32d4969fe admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:30.381258 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bf77b-6004-4026-af27-2fa32d4969fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:57:30.383202 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bf77b-6004-4026-af27-2fa32d4969fe admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:57:30.403959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 715/1441] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 10:57:30 2021] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 10:57:30.411899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26522053-0fe7-405d-a9fd-cfff986a729c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:57:30.426092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26522053-0fe7-405d-a9fd-cfff986a729c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:57:30.431686 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d2a6-858f-403e-b599-7410e80a3cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:57:30.432353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d2a6-858f-403e-b599-7410e80a3cbd admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:30.432634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d2a6-858f-403e-b599-7410e80a3cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:30.432907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d2a6-858f-403e-b599-7410e80a3cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:30.433649 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577d2a6-858f-403e-b599-7410e80a3cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:57:30.435339 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577d2a6-858f-403e-b599-7410e80a3cbd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:57:30.447954 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 727/1442] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 10:57:30 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 10:57:30.452623 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bf77b-6004-4026-af27-2fa32d4969fe admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:57:30.466047 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bf77b-6004-4026-af27-2fa32d4969fe admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:57:30.472276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafa28d-bd3e-42ac-9409-9dc7201ff246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:57:30.472956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafa28d-bd3e-42ac-9409-9dc7201ff246 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:30.473237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafa28d-bd3e-42ac-9409-9dc7201ff246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:30.473579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafa28d-bd3e-42ac-9409-9dc7201ff246 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:30.474337 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafa28d-bd3e-42ac-9409-9dc7201ff246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:57:30.476001 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafa28d-bd3e-42ac-9409-9dc7201ff246 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:57:30.490260 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 716/1443] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 10:57:30 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 10:57:30.494671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d2a6-858f-403e-b599-7410e80a3cbd admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:57:30.504981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d2a6-858f-403e-b599-7410e80a3cbd admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:57:30.510232 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1c996-7117-46d8-8ed4-59c4eec1868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:57:30.511140 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1c996-7117-46d8-8ed4-59c4eec1868f admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:30.511443 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1c996-7117-46d8-8ed4-59c4eec1868f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:30.511721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1c996-7117-46d8-8ed4-59c4eec1868f admin admin] PATH_INFO: `/v3/projects/4f3e0423c4cf4eb29ed4b1b2456ef3c9/users/bda0df46a4444b5a88e23c2532f971d2/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:30.526737 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1c996-7117-46d8-8ed4-59c4eec1868f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3e0423c4cf4eb29ed4b1b2456ef3c9, user_id=bda0df46a4444b5a88e23c2532f971d2, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:57:30.529482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1c996-7117-46d8-8ed4-59c4eec1868f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:57:30.546038 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 728/1444] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 10:57:30 2021] PUT /identity/v3/projects/4f3e0423c4cf4eb29ed4b1b2456ef3c9/users/bda0df46a4444b5a88e23c2532f971d2/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:57:30.558509 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d10c93-f22c-4332-b9e8-0fc714747c2f None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:30.558939 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d10c93-f22c-4332-b9e8-0fc714747c2f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:30.559378 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d10c93-f22c-4332-b9e8-0fc714747c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:30.586778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-62d10c93-f22c-4332-b9e8-0fc714747c2f None None] MFA Rules not processed for user `bda0df46a4444b5a88e23c2532f971d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:57:30.587942 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-62d10c93-f22c-4332-b9e8-0fc714747c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:57:30.661422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 717/1445] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 10:57:30 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:57:30.673259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1c996-7117-46d8-8ed4-59c4eec1868f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:57:30.749401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1c996-7117-46d8-8ed4-59c4eec1868f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:57:30.757987 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d756220-1ea0-4f57-8109-9c9c189c04dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:57:30.758751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d756220-1ea0-4f57-8109-9c9c189c04dd service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:30.759043 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d756220-1ea0-4f57-8109-9c9c189c04dd service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:30.759311 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d756220-1ea0-4f57-8109-9c9c189c04dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:30.768265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d756220-1ea0-4f57-8109-9c9c189c04dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:57:30.769878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d756220-1ea0-4f57-8109-9c9c189c04dd service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:57:30.779151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 729/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:57:30 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:57:30.857227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bc7ce-e597-4074-b1c1-be49bb371a11 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:30.857511 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bc7ce-e597-4074-b1c1-be49bb371a11 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:30.857788 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bc7ce-e597-4074-b1c1-be49bb371a11 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:30.859615 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 718/1447] 10.222.0.20 () {52 vars in 829 bytes} [Mon Nov 8 10:57:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:57:30.863537 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d756220-1ea0-4f57-8109-9c9c189c04dd service nova] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:57:30.928888 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d756220-1ea0-4f57-8109-9c9c189c04dd service nova] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:57:30.933897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:57:30.934772 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:30.935051 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:30.935360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] PATH_INFO: `/v3/users/bda0df46a4444b5a88e23c2532f971d2` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:30.936584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda0df46a4444b5a88e23c2532f971d2)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:57:30.937604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:57:30.937604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 10:57:30.937604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 10:57:30.938809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:57:31.012146 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda0df46a4444b5a88e23c2532f971d2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 10:57:31.013015 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda0df46a4444b5a88e23c2532f971d2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 10:57:31.025968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda0df46a4444b5a88e23c2532f971d2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 10:57:31.026701 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda0df46a4444b5a88e23c2532f971d2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 10:57:31.046662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda0df46a4444b5a88e23c2532f971d2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 10:57:31.066064 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 730/1448] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 10:57:30 2021] DELETE /identity/v3/users/bda0df46a4444b5a88e23c2532f971d2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 10:57:31.071630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15b472-7bb2-401f-ac9c-018e2a318a2c None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:31.072025 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15b472-7bb2-401f-ac9c-018e2a318a2c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:31.072341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15b472-7bb2-401f-ac9c-018e2a318a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:31.093539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-9f15b472-7bb2-401f-ac9c-018e2a318a2c None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:57:31.094982 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9f15b472-7bb2-401f-ac9c-018e2a318a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:57:31.161395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 719/1449] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 10:57:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:57:31.173052 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:57:31.174512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:57:31.234305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7956bd0-657f-49ba-8322-293b00c9249c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:57:31.238739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f4025-8457-4ed7-bb3e-d87c6bdc4ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:57:31.239420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f4025-8457-4ed7-bb3e-d87c6bdc4ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:31.239696 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f4025-8457-4ed7-bb3e-d87c6bdc4ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:31.239960 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f4025-8457-4ed7-bb3e-d87c6bdc4ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:31.250090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f4025-8457-4ed7-bb3e-d87c6bdc4ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:57:31.251613 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f4025-8457-4ed7-bb3e-d87c6bdc4ea0 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:57:31.261192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 731/1450] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:57:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:57:31.617022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15b472-7bb2-401f-ac9c-018e2a318a2c None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:57:31.618691 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9f15b472-7bb2-401f-ac9c-018e2a318a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:57:31.631225 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15b472-7bb2-401f-ac9c-018e2a318a2c None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:57:31.636154 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5245df-ff25-4845-a3d0-85f86e3a5c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:57:31.637023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5245df-ff25-4845-a3d0-85f86e3a5c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:57:31.637395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5245df-ff25-4845-a3d0-85f86e3a5c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:57:31.637557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5245df-ff25-4845-a3d0-85f86e3a5c30 admin admin] PATH_INFO: `/v3/projects/4f3e0423c4cf4eb29ed4b1b2456ef3c9` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:57:31.639225 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5245df-ff25-4845-a3d0-85f86e3a5c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f3e0423c4cf4eb29ed4b1b2456ef3c9)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:57:31.646903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-8e5245df-ff25-4845-a3d0-85f86e3a5c30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 10:57:31.646903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 10:57:31.646903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 10:57:31.648338 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5245df-ff25-4845-a3d0-85f86e3a5c30 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:57:31.708891 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-8e5245df-ff25-4845-a3d0-85f86e3a5c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f3e0423c4cf4eb29ed4b1b2456ef3c9', 'request_id': 'req-8e5245df-ff25-4845-a3d0-85f86e3a5c30'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 10:57:31.722241 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-8e5245df-ff25-4845-a3d0-85f86e3a5c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f3e0423c4cf4eb29ed4b1b2456ef3c9', 'request_id': 'req-8e5245df-ff25-4845-a3d0-85f86e3a5c30'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 10:57:31.729299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-8e5245df-ff25-4845-a3d0-85f86e3a5c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f3e0423c4cf4eb29ed4b1b2456ef3c9', 'request_id': 'req-8e5245df-ff25-4845-a3d0-85f86e3a5c30'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 10:57:31.746055 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-8e5245df-ff25-4845-a3d0-85f86e3a5c30 admin admin] The token cache is being invalidate because project 4f3e0423c4cf4eb29ed4b1b2456ef3c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 10:57:31.746390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-8e5245df-ff25-4845-a3d0-85f86e3a5c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 10:57:31.747150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-8e5245df-ff25-4845-a3d0-85f86e3a5c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 10:57:31.748828 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 720/1451] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 10:57:31 2021] DELETE /identity/v3/projects/4f3e0423c4cf4eb29ed4b1b2456ef3c9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 10:59:02.755979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c0d94-118b-4c5d-9eaa-cccb58134a90 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:02.756556 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c0d94-118b-4c5d-9eaa-cccb58134a90 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:02.756556 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c0d94-118b-4c5d-9eaa-cccb58134a90 None None] PATH_INFO: `/v3` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:02.757878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 732/1452] 10.222.0.39 () {54 vars in 925 bytes} [Mon Nov 8 10:59:02 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 10:59:02.766935 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cc1b9-7cc2-4b8b-b0e8-3fe0c432f9d0 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:02.767439 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cc1b9-7cc2-4b8b-b0e8-3fe0c432f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:02.767542 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cc1b9-7cc2-4b8b-b0e8-3fe0c432f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:02.786553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-3a8cc1b9-7cc2-4b8b-b0e8-3fe0c432f9d0 None None] MFA Rules not processed for user `642c2b97ece34d69bacd821b108bd210`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:59:02.787791 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3a8cc1b9-7cc2-4b8b-b0e8-3fe0c432f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:02.852995 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 721/1453] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Nov 8 10:59:02 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:59:03.166237 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019370d8-d231-4982-989e-965b6b60fd37 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:03.166461 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019370d8-d231-4982-989e-965b6b60fd37 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:03.166685 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019370d8-d231-4982-989e-965b6b60fd37 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:03.168531 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 733/1454] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 8 10:59:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 10:59:03.174153 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484731aa-a9e2-4e8f-b99e-c5be90535c5a None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:03.174491 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484731aa-a9e2-4e8f-b99e-c5be90535c5a None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:03.174744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484731aa-a9e2-4e8f-b99e-c5be90535c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:03.196074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-484731aa-a9e2-4e8f-b99e-c5be90535c5a None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:59:03.197826 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-484731aa-a9e2-4e8f-b99e-c5be90535c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:03.269832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 722/1455] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 8 10:59:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:59:03.448909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019370d8-d231-4982-989e-965b6b60fd37 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:59:03.451967 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-019370d8-d231-4982-989e-965b6b60fd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:03.533085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019370d8-d231-4982-989e-965b6b60fd37 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:59:03.539101 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f1837-92fe-49d6-8d28-939e3bea4c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:59:03.539764 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f1837-92fe-49d6-8d28-939e3bea4c1c service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:03.540048 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f1837-92fe-49d6-8d28-939e3bea4c1c service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:03.540325 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f1837-92fe-49d6-8d28-939e3bea4c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:03.548909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f1837-92fe-49d6-8d28-939e3bea4c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:59:03.550500 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f1837-92fe-49d6-8d28-939e3bea4c1c service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:59:03.560235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 734/1456] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:59:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:59:05.027824 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ea11b-8763-4a8e-bf48-e94994dde7e1 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:05.028435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ea11b-8763-4a8e-bf48-e94994dde7e1 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:05.028435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ea11b-8763-4a8e-bf48-e94994dde7e1 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:05.030131 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 723/1457] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 8 10:59:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:59:05.036735 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3fe15-76fe-4a41-abde-4378c4207ecf None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:05.037178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3fe15-76fe-4a41-abde-4378c4207ecf None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:05.037312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3fe15-76fe-4a41-abde-4378c4207ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:05.058654 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-7aa3fe15-76fe-4a41-abde-4378c4207ecf None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:59:05.059968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7aa3fe15-76fe-4a41-abde-4378c4207ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:05.069067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 735/1458] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 8 10:59:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:59:05.227961 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ea11b-8763-4a8e-bf48-e94994dde7e1 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:59:05.244462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ea11b-8763-4a8e-bf48-e94994dde7e1 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:59:05.251077 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5a69d-a363-4ca3-9de8-28ebfce9578e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:59:05.251744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5a69d-a363-4ca3-9de8-28ebfce9578e service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:05.251983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5a69d-a363-4ca3-9de8-28ebfce9578e service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:05.252278 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5a69d-a363-4ca3-9de8-28ebfce9578e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:05.262743 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5a69d-a363-4ca3-9de8-28ebfce9578e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:59:05.264813 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5a69d-a363-4ca3-9de8-28ebfce9578e service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:59:05.274543 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 724/1459] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:59:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 10:59:06.538092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee57b30-7138-49aa-9598-51ae9c45e294 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:06.538552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee57b30-7138-49aa-9598-51ae9c45e294 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:06.538646 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee57b30-7138-49aa-9598-51ae9c45e294 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:06.540517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 736/1460] 10.222.0.20 () {54 vars in 960 bytes} [Mon Nov 8 10:59:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:59:06.546322 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1a6dd-29c4-4a50-b539-f590eadd4d41 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:06.546793 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1a6dd-29c4-4a50-b539-f590eadd4d41 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:06.546902 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1a6dd-29c4-4a50-b539-f590eadd4d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:06.565208 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-30e1a6dd-29c4-4a50-b539-f590eadd4d41 None None] MFA Rules not processed for user `642c2b97ece34d69bacd821b108bd210`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:59:06.567066 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-30e1a6dd-29c4-4a50-b539-f590eadd4d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:06.577050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 725/1461] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Nov 8 10:59:06 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:59:06.585168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee57b30-7138-49aa-9598-51ae9c45e294 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:59:06.598938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee57b30-7138-49aa-9598-51ae9c45e294 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:59:06.604440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9daf7-588d-4f3a-b90b-5541b296ed2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '642c2b97ece34d69bacd821b108bd210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:59:06.605151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9daf7-588d-4f3a-b90b-5541b296ed2d service placement] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:06.605433 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9daf7-588d-4f3a-b90b-5541b296ed2d service placement] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:06.605703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9daf7-588d-4f3a-b90b-5541b296ed2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:06.614215 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9daf7-588d-4f3a-b90b-5541b296ed2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:59:06.615875 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9daf7-588d-4f3a-b90b-5541b296ed2d service placement] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:59:06.625852 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 737/1462] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:59:06 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 10:59:17.116481 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7682fb1-f083-4ef7-953a-0103a4d72768 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:17.117058 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7682fb1-f083-4ef7-953a-0103a4d72768 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:17.117058 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7682fb1-f083-4ef7-953a-0103a4d72768 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:17.118923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 726/1463] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 8 10:59:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:59:17.124629 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f6a6b-5530-4021-abdd-fab46b7245e7 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:17.125094 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f6a6b-5530-4021-abdd-fab46b7245e7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:17.125192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f6a6b-5530-4021-abdd-fab46b7245e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:17.145540 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-e81f6a6b-5530-4021-abdd-fab46b7245e7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:59:17.146738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e81f6a6b-5530-4021-abdd-fab46b7245e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:17.158187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 738/1464] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 8 10:59:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:59:17.322576 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7682fb1-f083-4ef7-953a-0103a4d72768 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:59:17.339389 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7682fb1-f083-4ef7-953a-0103a4d72768 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:59:17.345744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a081de9-da80-4ef4-bca5-4f046ab6eade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:59:17.346379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a081de9-da80-4ef4-bca5-4f046ab6eade service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:17.346661 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a081de9-da80-4ef4-bca5-4f046ab6eade service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:17.346932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a081de9-da80-4ef4-bca5-4f046ab6eade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:17.355369 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a081de9-da80-4ef4-bca5-4f046ab6eade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:59:17.356960 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a081de9-da80-4ef4-bca5-4f046ab6eade service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:59:17.366146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 727/1465] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:59:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:59:18.809671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86370d-dc06-4df4-b929-a6b67cf9ae0f None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:18.810230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86370d-dc06-4df4-b929-a6b67cf9ae0f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:18.810230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86370d-dc06-4df4-b929-a6b67cf9ae0f None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:18.811976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 739/1466] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 8 10:59:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:59:18.817503 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613646-e1be-4d78-b90b-c902655b569d None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:18.817956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613646-e1be-4d78-b90b-c902655b569d None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:18.818064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613646-e1be-4d78-b90b-c902655b569d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:18.837498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-79613646-e1be-4d78-b90b-c902655b569d None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:59:18.838673 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-79613646-e1be-4d78-b90b-c902655b569d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:18.847582 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 728/1467] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 8 10:59:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:59:19.002845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86370d-dc06-4df4-b929-a6b67cf9ae0f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:59:19.020594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86370d-dc06-4df4-b929-a6b67cf9ae0f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:59:19.027835 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36596589-13ad-45a5-a998-1dfd1b21dd14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:59:19.028490 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596589-13ad-45a5-a998-1dfd1b21dd14 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:19.028770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596589-13ad-45a5-a998-1dfd1b21dd14 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:19.029050 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596589-13ad-45a5-a998-1dfd1b21dd14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:19.038452 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36596589-13ad-45a5-a998-1dfd1b21dd14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:59:19.040101 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36596589-13ad-45a5-a998-1dfd1b21dd14 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:59:19.051363 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 740/1468] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:59:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:59:23.230483 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90886ff7-321c-4eba-a2ec-86aa81fb8fc7 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:23.231093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90886ff7-321c-4eba-a2ec-86aa81fb8fc7 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:23.231093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90886ff7-321c-4eba-a2ec-86aa81fb8fc7 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:23.232898 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 729/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 8 10:59:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:59:23.239794 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f5e4-3fc4-4249-a4b4-53615c50132d None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:23.240509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f5e4-3fc4-4249-a4b4-53615c50132d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:23.240684 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f5e4-3fc4-4249-a4b4-53615c50132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:23.267932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-ae37f5e4-3fc4-4249-a4b4-53615c50132d None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:59:23.269147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ae37f5e4-3fc4-4249-a4b4-53615c50132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:23.277458 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 741/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 8 10:59:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:59:23.320329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90886ff7-321c-4eba-a2ec-86aa81fb8fc7 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:59:23.323354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-90886ff7-321c-4eba-a2ec-86aa81fb8fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:23.387063 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90886ff7-321c-4eba-a2ec-86aa81fb8fc7 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:59:23.394393 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ce52e-34b5-4e60-a8d6-5113f52fe891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:59:23.395512 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ce52e-34b5-4e60-a8d6-5113f52fe891 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:23.395970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ce52e-34b5-4e60-a8d6-5113f52fe891 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:23.396421 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ce52e-34b5-4e60-a8d6-5113f52fe891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:23.410200 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ce52e-34b5-4e60-a8d6-5113f52fe891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:59:23.411715 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ce52e-34b5-4e60-a8d6-5113f52fe891 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:59:23.421956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 730/1471] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:59:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:59:25.666951 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86884-af33-48af-a8d7-ca02267f278b None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:25.667610 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86884-af33-48af-a8d7-ca02267f278b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:25.667610 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86884-af33-48af-a8d7-ca02267f278b None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:25.669334 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 742/1472] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 8 10:59:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:59:25.675264 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8bfa3-207d-4dff-a1ad-d6d813621856 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:25.675728 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8bfa3-207d-4dff-a1ad-d6d813621856 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:25.675842 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8bfa3-207d-4dff-a1ad-d6d813621856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:25.702416 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-19c8bfa3-207d-4dff-a1ad-d6d813621856 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:59:25.704286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-19c8bfa3-207d-4dff-a1ad-d6d813621856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:25.717928 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 731/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 8 10:59:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:59:25.763114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee86884-af33-48af-a8d7-ca02267f278b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:59:25.767196 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4ee86884-af33-48af-a8d7-ca02267f278b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:25.787394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee86884-af33-48af-a8d7-ca02267f278b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:59:25.791305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d4f84-5093-48ef-91a7-f65c287de6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:59:25.791960 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d4f84-5093-48ef-91a7-f65c287de6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:25.792238 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d4f84-5093-48ef-91a7-f65c287de6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:25.792505 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d4f84-5093-48ef-91a7-f65c287de6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:25.802696 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d4f84-5093-48ef-91a7-f65c287de6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:59:25.804168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d4f84-5093-48ef-91a7-f65c287de6f5 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:59:25.814707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 743/1474] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:59:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:59:29.672747 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa6db1-fdd5-4fc9-862b-ccfd64c9d372 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:29.673364 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa6db1-fdd5-4fc9-862b-ccfd64c9d372 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:29.673364 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa6db1-fdd5-4fc9-862b-ccfd64c9d372 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:29.675967 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 732/1475] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 8 10:59:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:59:29.685150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78a4ae-b86c-40f9-8f37-9175b9a1e3fd None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:29.685662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78a4ae-b86c-40f9-8f37-9175b9a1e3fd None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:29.685942 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78a4ae-b86c-40f9-8f37-9175b9a1e3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:29.704908 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-7c78a4ae-b86c-40f9-8f37-9175b9a1e3fd None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:59:29.706106 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7c78a4ae-b86c-40f9-8f37-9175b9a1e3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:29.714554 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 744/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 8 10:59:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:59:29.768192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa6db1-fdd5-4fc9-862b-ccfd64c9d372 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:59:29.773274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-61aa6db1-fdd5-4fc9-862b-ccfd64c9d372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:29.852096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa6db1-fdd5-4fc9-862b-ccfd64c9d372 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:59:29.856939 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d6998-ca2f-40be-ac20-ec0be029bd7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:59:29.857780 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d6998-ca2f-40be-ac20-ec0be029bd7c service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:29.858059 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d6998-ca2f-40be-ac20-ec0be029bd7c service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:29.858329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d6998-ca2f-40be-ac20-ec0be029bd7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:29.867824 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d6998-ca2f-40be-ac20-ec0be029bd7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:59:29.869271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d6998-ca2f-40be-ac20-ec0be029bd7c service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:59:29.878834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 733/1477] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:59:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 10:59:32.139328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3a2f5-4899-4fe4-bc32-e024933c2ae9 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:32.139928 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3a2f5-4899-4fe4-bc32-e024933c2ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:32.139928 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3a2f5-4899-4fe4-bc32-e024933c2ae9 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:32.141669 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 745/1478] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 8 10:59:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:59:32.147900 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870406c-ff04-4e5e-99c9-244ac73bc3ef None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:32.148305 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870406c-ff04-4e5e-99c9-244ac73bc3ef None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:32.148545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870406c-ff04-4e5e-99c9-244ac73bc3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:32.166614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-a870406c-ff04-4e5e-99c9-244ac73bc3ef None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:59:32.167967 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-a870406c-ff04-4e5e-99c9-244ac73bc3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:32.176292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 734/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 8 10:59:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:59:32.227754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2316296-d6a4-4961-9541-dbc78488f2c6 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:32.228002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2316296-d6a4-4961-9541-dbc78488f2c6 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:32.228307 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2316296-d6a4-4961-9541-dbc78488f2c6 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:32.230103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 746/1480] 10.222.0.20 () {54 vars in 962 bytes} [Mon Nov 8 10:59:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 10:59:32.236384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b9ccd-2b99-4065-a41c-a342ecdac33c None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:32.236735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b9ccd-2b99-4065-a41c-a342ecdac33c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:32.237111 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b9ccd-2b99-4065-a41c-a342ecdac33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:32.265645 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-966b9ccd-2b99-4065-a41c-a342ecdac33c None None] MFA Rules not processed for user `4b0a2df68bfc41ada3b2135fc2e1930f`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 10:59:32.266844 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-966b9ccd-2b99-4065-a41c-a342ecdac33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 10:59:32.274912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 735/1481] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Nov 8 10:59:32 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 10:59:32.283109 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2316296-d6a4-4961-9541-dbc78488f2c6 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 10:59:32.296029 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2316296-d6a4-4961-9541-dbc78488f2c6 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 10:59:32.300266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538235b-a17e-4510-95ab-7b3a3716e354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 10:59:32.300904 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538235b-a17e-4510-95ab-7b3a3716e354 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 10:59:32.301187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538235b-a17e-4510-95ab-7b3a3716e354 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 10:59:32.301462 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538235b-a17e-4510-95ab-7b3a3716e354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 10:59:32.311603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538235b-a17e-4510-95ab-7b3a3716e354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 10:59:32.313049 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538235b-a17e-4510-95ab-7b3a3716e354 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 10:59:32.322513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 747/1482] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 10:59:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:00:52.720476 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633ffa8-a2a4-4edf-bbb6-b6425d836c7c None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:52.721563 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633ffa8-a2a4-4edf-bbb6-b6425d836c7c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:52.722068 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633ffa8-a2a4-4edf-bbb6-b6425d836c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:52.744823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-e633ffa8-a2a4-4edf-bbb6-b6425d836c7c None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:52.746382 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e633ffa8-a2a4-4edf-bbb6-b6425d836c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:52.758448 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 736/1483] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:52.768288 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b827b-f6fb-47f8-8877-1d1a87eeadd2 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:52.768827 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b827b-f6fb-47f8-8877-1d1a87eeadd2 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:52.769115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b827b-f6fb-47f8-8877-1d1a87eeadd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:52.790735 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-153b827b-f6fb-47f8-8877-1d1a87eeadd2 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:52.791975 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-153b827b-f6fb-47f8-8877-1d1a87eeadd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:52.808765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 748/1484] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:52.813947 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633ffa8-a2a4-4edf-bbb6-b6425d836c7c None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:52.826760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633ffa8-a2a4-4edf-bbb6-b6425d836c7c None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:52.835515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d577e53-f190-430e-8653-c4f38e11ef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:52.836431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d577e53-f190-430e-8653-c4f38e11ef3b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:52.836947 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d577e53-f190-430e-8653-c4f38e11ef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:52.837437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d577e53-f190-430e-8653-c4f38e11ef3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:52.838387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d577e53-f190-430e-8653-c4f38e11ef3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:00:52.838900 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d577e53-f190-430e-8653-c4f38e11ef3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:52.840787 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d577e53-f190-430e-8653-c4f38e11ef3b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:52.858459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 737/1485] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:00:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:00:52.867281 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b827b-f6fb-47f8-8877-1d1a87eeadd2 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:52.876779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b827b-f6fb-47f8-8877-1d1a87eeadd2 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:52.891662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a2b36-e615-43ad-8b34-49ae0ba9bb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:52.892339 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a2b36-e615-43ad-8b34-49ae0ba9bb78 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:52.892623 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a2b36-e615-43ad-8b34-49ae0ba9bb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:52.892899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a2b36-e615-43ad-8b34-49ae0ba9bb78 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:52.893618 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a2b36-e615-43ad-8b34-49ae0ba9bb78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:52.895587 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a2b36-e615-43ad-8b34-49ae0ba9bb78 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:52.945164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 749/1486] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:00:52 2021] POST /identity/v3/projects => generated 405 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:52.949631 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d577e53-f190-430e-8653-c4f38e11ef3b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:52.974881 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d577e53-f190-430e-8653-c4f38e11ef3b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.074231 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d6837-5c02-4fab-aa15-8dc649dbc0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.074920 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d6837-5c02-4fab-aa15-8dc649dbc0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.075273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d6837-5c02-4fab-aa15-8dc649dbc0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.075683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d6837-5c02-4fab-aa15-8dc649dbc0b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.076624 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d6837-5c02-4fab-aa15-8dc649dbc0b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.078810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d6837-5c02-4fab-aa15-8dc649dbc0b8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.112820 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4eeb4-db7b-435a-a946-debb694d346f None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.121007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4eeb4-db7b-435a-a946-debb694d346f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.121007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4eeb4-db7b-435a-a946-debb694d346f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.121279 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 738/1487] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:00:52 2021] POST /identity/v3/users => generated 303 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:53.132814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f4a4-a12e-4b3d-8c01-2493808b6c83 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.133180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f4a4-a12e-4b3d-8c01-2493808b6c83 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.133434 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f4a4-a12e-4b3d-8c01-2493808b6c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.151230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-9dc4eeb4-db7b-435a-a946-debb694d346f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.152456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9dc4eeb4-db7b-435a-a946-debb694d346f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.160295 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-0693f4a4-a12e-4b3d-8c01-2493808b6c83 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.161448 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-0693f4a4-a12e-4b3d-8c01-2493808b6c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.174464 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 750/1488] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.175436 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4eeb4-db7b-435a-a946-debb694d346f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.176545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 739/1489] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.185384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505893a-7184-4ef1-8d0e-95f84e32bb46 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.185796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505893a-7184-4ef1-8d0e-95f84e32bb46 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.186100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505893a-7184-4ef1-8d0e-95f84e32bb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.189972 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4eeb4-db7b-435a-a946-debb694d346f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.205438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea70f3-1a50-413e-8d3b-740f7f378a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.206131 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea70f3-1a50-413e-8d3b-740f7f378a6c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.206416 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea70f3-1a50-413e-8d3b-740f7f378a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.206689 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea70f3-1a50-413e-8d3b-740f7f378a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.207482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea70f3-1a50-413e-8d3b-740f7f378a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.209121 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea70f3-1a50-413e-8d3b-740f7f378a6c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.225131 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 751/1490] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:53 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:53.226506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f61248-192b-45ca-a08b-52eaa7c250c3 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.226806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f61248-192b-45ca-a08b-52eaa7c250c3 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.227151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f61248-192b-45ca-a08b-52eaa7c250c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.228230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-6505893a-7184-4ef1-8d0e-95f84e32bb46 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.229649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6505893a-7184-4ef1-8d0e-95f84e32bb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.259039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-13f61248-192b-45ca-a08b-52eaa7c250c3 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.260295 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-13f61248-192b-45ca-a08b-52eaa7c250c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.261595 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 740/1491] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.263674 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505893a-7184-4ef1-8d0e-95f84e32bb46 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.282060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505893a-7184-4ef1-8d0e-95f84e32bb46 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.284001 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 752/1492] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.295916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f61248-192b-45ca-a08b-52eaa7c250c3 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.306697 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f61248-192b-45ca-a08b-52eaa7c250c3 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.307828 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5eeeb5-37e9-4fee-a634-c0e20c446206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.308541 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5eeeb5-37e9-4fee-a634-c0e20c446206 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.308829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5eeeb5-37e9-4fee-a634-c0e20c446206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.309104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5eeeb5-37e9-4fee-a634-c0e20c446206 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.310157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5eeeb5-37e9-4fee-a634-c0e20c446206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.312345 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5eeeb5-37e9-4fee-a634-c0e20c446206 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.324930 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d8804-d36e-4ddc-882d-0945e880aad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.325832 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8804-d36e-4ddc-882d-0945e880aad0 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.326118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8804-d36e-4ddc-882d-0945e880aad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.326394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8804-d36e-4ddc-882d-0945e880aad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.327169 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d8804-d36e-4ddc-882d-0945e880aad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:00:53.327481 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d8804-d36e-4ddc-882d-0945e880aad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.328079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 741/1493] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:53 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:53.328992 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5eeeb5-37e9-4fee-a634-c0e20c446206 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.329591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d8804-d36e-4ddc-882d-0945e880aad0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.342928 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 753/1494] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:00:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:00:53.356190 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5eeeb5-37e9-4fee-a634-c0e20c446206 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.356493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca9e57-7fcc-424c-a075-ff0d7ce21369 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.357041 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca9e57-7fcc-424c-a075-ff0d7ce21369 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.357337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca9e57-7fcc-424c-a075-ff0d7ce21369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.383228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eb681-4c45-4f01-83ef-51b47b156b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.387144 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eb681-4c45-4f01-83ef-51b47b156b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.387144 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eb681-4c45-4f01-83ef-51b47b156b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.387144 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eb681-4c45-4f01-83ef-51b47b156b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.387144 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24eb681-4c45-4f01-83ef-51b47b156b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:00:53.387144 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24eb681-4c45-4f01-83ef-51b47b156b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.388424 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24eb681-4c45-4f01-83ef-51b47b156b86 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.397474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-35ca9e57-7fcc-424c-a075-ff0d7ce21369 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.398698 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-35ca9e57-7fcc-424c-a075-ff0d7ce21369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.401335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 742/1495] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:00:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:00:53.402479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67776e-b52f-41b5-9858-7f6ffac26f99 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.403299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67776e-b52f-41b5-9858-7f6ffac26f99 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.403299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67776e-b52f-41b5-9858-7f6ffac26f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.414244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 754/1496] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.414930 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca9e57-7fcc-424c-a075-ff0d7ce21369 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.426025 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca9e57-7fcc-424c-a075-ff0d7ce21369 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.430603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41da2d0-ff93-495e-bcfa-6561a5485a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.431529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41da2d0-ff93-495e-bcfa-6561a5485a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.431811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41da2d0-ff93-495e-bcfa-6561a5485a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.432085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41da2d0-ff93-495e-bcfa-6561a5485a62 admin admin] PATH_INFO: `/v3/projects/52e8bc4892f249399fd5675c504095ad/users/b2abfda55d4843caa96c0225823fe529/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.432804 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-3b67776e-b52f-41b5-9858-7f6ffac26f99 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.434013 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3b67776e-b52f-41b5-9858-7f6ffac26f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.442213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 743/1497] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.442968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67776e-b52f-41b5-9858-7f6ffac26f99 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.446327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41da2d0-ff93-495e-bcfa-6561a5485a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e8bc4892f249399fd5675c504095ad, user_id=b2abfda55d4843caa96c0225823fe529, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.449056 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41da2d0-ff93-495e-bcfa-6561a5485a62 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.452422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67776e-b52f-41b5-9858-7f6ffac26f99 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.457139 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5d114-81a0-4eb5-b4e6-bf5927122c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.457798 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5d114-81a0-4eb5-b4e6-bf5927122c83 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.458089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5d114-81a0-4eb5-b4e6-bf5927122c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.458358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5d114-81a0-4eb5-b4e6-bf5927122c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.459100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5d114-81a0-4eb5-b4e6-bf5927122c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.461854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5d114-81a0-4eb5-b4e6-bf5927122c83 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.470400 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 755/1498] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:00:53 2021] PUT /identity/v3/projects/52e8bc4892f249399fd5675c504095ad/users/b2abfda55d4843caa96c0225823fe529/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:53.471752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a994e63-87a4-4337-b18a-75f545da67ec None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.472043 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a994e63-87a4-4337-b18a-75f545da67ec None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.472322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a994e63-87a4-4337-b18a-75f545da67ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.490663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-6a994e63-87a4-4337-b18a-75f545da67ec None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.491866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6a994e63-87a4-4337-b18a-75f545da67ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.498394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 744/1499] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:53.499769 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846746-4790-4c8a-9430-6e3af71c2a7b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.500055 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846746-4790-4c8a-9430-6e3af71c2a7b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.500338 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846746-4790-4c8a-9430-6e3af71c2a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.518068 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-6e846746-4790-4c8a-9430-6e3af71c2a7b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.519302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6e846746-4790-4c8a-9430-6e3af71c2a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.551162 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 756/1500] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.551964 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a994e63-87a4-4337-b18a-75f545da67ec None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.561521 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a994e63-87a4-4337-b18a-75f545da67ec None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.582460 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 745/1501] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.584686 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6be07-1436-4985-87bf-d5229c8928cd None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.585304 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6be07-1436-4985-87bf-d5229c8928cd None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.585304 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6be07-1436-4985-87bf-d5229c8928cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.609024 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-99e6be07-1436-4985-87bf-d5229c8928cd None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.610305 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-99e6be07-1436-4985-87bf-d5229c8928cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.618403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 746/1502] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.619740 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a26c9-64ad-4d6c-a430-1346e4ac256f None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.620024 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a26c9-64ad-4d6c-a430-1346e4ac256f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.620294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a26c9-64ad-4d6c-a430-1346e4ac256f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.622164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154953a-6686-4866-a743-81201ee7998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.622847 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154953a-6686-4866-a743-81201ee7998e admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.623113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154953a-6686-4866-a743-81201ee7998e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.623419 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154953a-6686-4866-a743-81201ee7998e admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.624135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154953a-6686-4866-a743-81201ee7998e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.626051 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154953a-6686-4866-a743-81201ee7998e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.638353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-711a26c9-64ad-4d6c-a430-1346e4ac256f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.639647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-711a26c9-64ad-4d6c-a430-1346e4ac256f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.647678 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 747/1503] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.648868 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6b89e-aa7a-4899-a2b6-460748ef65b6 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.649157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6b89e-aa7a-4899-a2b6-460748ef65b6 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.649429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6b89e-aa7a-4899-a2b6-460748ef65b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.659071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 757/1504] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:53.660631 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd695c1-ca95-4b2d-880c-622ed6004ebd None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.660949 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd695c1-ca95-4b2d-880c-622ed6004ebd None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.661227 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd695c1-ca95-4b2d-880c-622ed6004ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.669510 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-a4c6b89e-aa7a-4899-a2b6-460748ef65b6 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.670939 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-a4c6b89e-aa7a-4899-a2b6-460748ef65b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.688383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-ddd695c1-ca95-4b2d-880c-622ed6004ebd None None] MFA Rules not processed for user `b2abfda55d4843caa96c0225823fe529`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.689583 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ddd695c1-ca95-4b2d-880c-622ed6004ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.733000 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 748/1505] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.733841 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6b89e-aa7a-4899-a2b6-460748ef65b6 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.743300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6b89e-aa7a-4899-a2b6-460748ef65b6 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.749527 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a6ade-d169-4c14-b2cd-5b2d7af29c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.750210 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a6ade-d169-4c14-b2cd-5b2d7af29c83 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.750493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a6ade-d169-4c14-b2cd-5b2d7af29c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.750767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a6ade-d169-4c14-b2cd-5b2d7af29c83 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.751514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a6ade-d169-4c14-b2cd-5b2d7af29c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.753484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a6ade-d169-4c14-b2cd-5b2d7af29c83 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.754940 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 758/1506] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.756377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ae85e-d202-4374-ac01-706d02b0d8a3 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.756668 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ae85e-d202-4374-ac01-706d02b0d8a3 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.756941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ae85e-d202-4374-ac01-706d02b0d8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.775547 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-9b3ae85e-d202-4374-ac01-706d02b0d8a3 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.776700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 749/1507] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/users => generated 283 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:53.776861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9b3ae85e-d202-4374-ac01-706d02b0d8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.778005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528cd5e-c5a9-4ddd-9b3e-38511c1e667e None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.778475 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528cd5e-c5a9-4ddd-9b3e-38511c1e667e None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.778766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528cd5e-c5a9-4ddd-9b3e-38511c1e667e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.788292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 759/1508] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.792164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ae85e-d202-4374-ac01-706d02b0d8a3 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.797117 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-2528cd5e-c5a9-4ddd-9b3e-38511c1e667e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.798334 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2528cd5e-c5a9-4ddd-9b3e-38511c1e667e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.798945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ae85e-d202-4374-ac01-706d02b0d8a3 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.803976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7fd5a-00b7-4254-9a03-1015267f2119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.804645 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7fd5a-00b7-4254-9a03-1015267f2119 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.804918 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7fd5a-00b7-4254-9a03-1015267f2119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.805195 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7fd5a-00b7-4254-9a03-1015267f2119 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.805935 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7fd5a-00b7-4254-9a03-1015267f2119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:00:53.806242 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7fd5a-00b7-4254-9a03-1015267f2119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.806663 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 750/1509] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.807902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7fd5a-00b7-4254-9a03-1015267f2119 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.808040 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e07ead-2d5a-498c-9a02-a92d023ae687 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.808255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e07ead-2d5a-498c-9a02-a92d023ae687 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.808455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e07ead-2d5a-498c-9a02-a92d023ae687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.820159 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 760/1510] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:00:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:00:53.820835 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7fd5a-00b7-4254-9a03-1015267f2119 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.827580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-57e07ead-2d5a-498c-9a02-a92d023ae687 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:53.828760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-57e07ead-2d5a-498c-9a02-a92d023ae687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:53.830444 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7fd5a-00b7-4254-9a03-1015267f2119 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.834958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88db0f6-b761-49f9-974c-5b1a621baef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.835644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88db0f6-b761-49f9-974c-5b1a621baef0 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.835931 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88db0f6-b761-49f9-974c-5b1a621baef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.836211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88db0f6-b761-49f9-974c-5b1a621baef0 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.836522 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 751/1511] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:53.836906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88db0f6-b761-49f9-974c-5b1a621baef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.837452 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e07ead-2d5a-498c-9a02-a92d023ae687 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.838822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88db0f6-b761-49f9-974c-5b1a621baef0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.846870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e07ead-2d5a-498c-9a02-a92d023ae687 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.852321 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef0027-8f8f-422e-9ab1-c90c40385179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.853019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef0027-8f8f-422e-9ab1-c90c40385179 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.853454 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef0027-8f8f-422e-9ab1-c90c40385179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.853886 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef0027-8f8f-422e-9ab1-c90c40385179 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.854838 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef0027-8f8f-422e-9ab1-c90c40385179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:00:53.855134 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef0027-8f8f-422e-9ab1-c90c40385179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.856823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef0027-8f8f-422e-9ab1-c90c40385179 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.860102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 761/1512] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/users => generated 294 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:53.861027 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88db0f6-b761-49f9-974c-5b1a621baef0 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.876126 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 752/1513] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:00:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:00:53.876126 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef0027-8f8f-422e-9ab1-c90c40385179 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.876389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88db0f6-b761-49f9-974c-5b1a621baef0 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.876389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f00c4-d7bb-46db-9f10-d4fd66ef363e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.876389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f00c4-d7bb-46db-9f10-d4fd66ef363e admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.876389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f00c4-d7bb-46db-9f10-d4fd66ef363e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.876760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f00c4-d7bb-46db-9f10-d4fd66ef363e admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.877147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f00c4-d7bb-46db-9f10-d4fd66ef363e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.879068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f00c4-d7bb-46db-9f10-d4fd66ef363e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.879243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef0027-8f8f-422e-9ab1-c90c40385179 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.884391 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054d11d-33fb-47bc-8ae0-15763e6f23a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.885040 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d11d-33fb-47bc-8ae0-15763e6f23a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.885314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d11d-33fb-47bc-8ae0-15763e6f23a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.885583 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d11d-33fb-47bc-8ae0-15763e6f23a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.886313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054d11d-33fb-47bc-8ae0-15763e6f23a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.888325 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054d11d-33fb-47bc-8ae0-15763e6f23a2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.901814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 753/1514] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:53 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:53.901814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054d11d-33fb-47bc-8ae0-15763e6f23a2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.909970 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 762/1515] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:53.909970 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f00c4-d7bb-46db-9f10-d4fd66ef363e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.910216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054d11d-33fb-47bc-8ae0-15763e6f23a2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.962607 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d11d4-eaa0-4349-bbc1-42b62737b358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.963304 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d11d4-eaa0-4349-bbc1-42b62737b358 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.963586 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d11d4-eaa0-4349-bbc1-42b62737b358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.963861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d11d4-eaa0-4349-bbc1-42b62737b358 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.964590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d11d4-eaa0-4349-bbc1-42b62737b358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:00:53.964891 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d11d4-eaa0-4349-bbc1-42b62737b358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.966658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d11d4-eaa0-4349-bbc1-42b62737b358 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.967623 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f00c4-d7bb-46db-9f10-d4fd66ef363e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.972122 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9660394-4ee3-4880-8289-dfe36d167b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.972771 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9660394-4ee3-4880-8289-dfe36d167b2b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.973049 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9660394-4ee3-4880-8289-dfe36d167b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:53.973320 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9660394-4ee3-4880-8289-dfe36d167b2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:53.974046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9660394-4ee3-4880-8289-dfe36d167b2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:00:53.974346 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9660394-4ee3-4880-8289-dfe36d167b2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:53.975956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9660394-4ee3-4880-8289-dfe36d167b2b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:53.977940 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 754/1516] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:00:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:00:53.978705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d11d4-eaa0-4349-bbc1-42b62737b358 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.988058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 763/1517] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:00:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:00:53.988245 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d11d4-eaa0-4349-bbc1-42b62737b358 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:53.988878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9660394-4ee3-4880-8289-dfe36d167b2b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:53.998949 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9aff89-4181-4dce-9638-e7b8e52e0105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:53.999574 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aff89-4181-4dce-9638-e7b8e52e0105 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:53.999858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aff89-4181-4dce-9638-e7b8e52e0105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.000143 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aff89-4181-4dce-9638-e7b8e52e0105 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.000835 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9aff89-4181-4dce-9638-e7b8e52e0105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.002771 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9aff89-4181-4dce-9638-e7b8e52e0105 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.004664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9660394-4ee3-4880-8289-dfe36d167b2b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.010278 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37eea08-55c4-4dc8-99fa-25060dc1f38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.010951 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eea08-55c4-4dc8-99fa-25060dc1f38f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.011268 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eea08-55c4-4dc8-99fa-25060dc1f38f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.011546 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eea08-55c4-4dc8-99fa-25060dc1f38f admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.012288 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37eea08-55c4-4dc8-99fa-25060dc1f38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:00:54.012597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37eea08-55c4-4dc8-99fa-25060dc1f38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.014600 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37eea08-55c4-4dc8-99fa-25060dc1f38f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.027530 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 764/1518] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:00:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:00:54.028876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37eea08-55c4-4dc8-99fa-25060dc1f38f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.030915 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 755/1519] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:00:53 2021] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:54.030915 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9aff89-4181-4dce-9638-e7b8e52e0105 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.043063 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37eea08-55c4-4dc8-99fa-25060dc1f38f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.093982 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9aff89-4181-4dce-9638-e7b8e52e0105 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.097876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664b555-cdf0-4119-bb81-bdeb3a6c1bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.098627 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664b555-cdf0-4119-bb81-bdeb3a6c1bee admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.098982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664b555-cdf0-4119-bb81-bdeb3a6c1bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.099143 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a636b-9eb9-4d46-bf73-eaee30fd6e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.099427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664b555-cdf0-4119-bb81-bdeb3a6c1bee admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.099694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a636b-9eb9-4d46-bf73-eaee30fd6e11 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.099997 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a636b-9eb9-4d46-bf73-eaee30fd6e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.100243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a636b-9eb9-4d46-bf73-eaee30fd6e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.100361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664b555-cdf0-4119-bb81-bdeb3a6c1bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.100959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a636b-9eb9-4d46-bf73-eaee30fd6e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.102036 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664b555-cdf0-4119-bb81-bdeb3a6c1bee admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.102948 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a636b-9eb9-4d46-bf73-eaee30fd6e11 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.112031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 765/1520] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:54.112838 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664b555-cdf0-4119-bb81-bdeb3a6c1bee admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.124498 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664b555-cdf0-4119-bb81-bdeb3a6c1bee admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.129413 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e5d0c-cd20-4cf1-8efd-f299e29f75a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.130050 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e5d0c-cd20-4cf1-8efd-f299e29f75a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.130337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e5d0c-cd20-4cf1-8efd-f299e29f75a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.130616 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e5d0c-cd20-4cf1-8efd-f299e29f75a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.130731 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 756/1521] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:00:54 2021] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:54.131661 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e5d0c-cd20-4cf1-8efd-f299e29f75a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.131768 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a636b-9eb9-4d46-bf73-eaee30fd6e11 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.133269 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e5d0c-cd20-4cf1-8efd-f299e29f75a2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.144284 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 766/1522] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:54.145077 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e5d0c-cd20-4cf1-8efd-f299e29f75a2 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.155268 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e5d0c-cd20-4cf1-8efd-f299e29f75a2 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.193168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a636b-9eb9-4d46-bf73-eaee30fd6e11 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.199977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb522a-8c0b-4945-8cea-55602f2d40d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.200750 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb522a-8c0b-4945-8cea-55602f2d40d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.201034 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb522a-8c0b-4945-8cea-55602f2d40d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.201306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb522a-8c0b-4945-8cea-55602f2d40d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.202023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb522a-8c0b-4945-8cea-55602f2d40d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.204463 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb522a-8c0b-4945-8cea-55602f2d40d8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.211792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201432-6e72-44f1-be50-ee854fd9b70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.212483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201432-6e72-44f1-be50-ee854fd9b70a admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.212789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201432-6e72-44f1-be50-ee854fd9b70a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.213029 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201432-6e72-44f1-be50-ee854fd9b70a admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.213770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23201432-6e72-44f1-be50-ee854fd9b70a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.215769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23201432-6e72-44f1-be50-ee854fd9b70a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.229203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 757/1523] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:00:54 2021] POST /identity/v3/users => generated 309 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:54.230105 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb522a-8c0b-4945-8cea-55602f2d40d8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.239763 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb522a-8c0b-4945-8cea-55602f2d40d8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.244646 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fafb5e-1cf6-4435-ba37-8d3878e26ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.245312 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fafb5e-1cf6-4435-ba37-8d3878e26ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.245608 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fafb5e-1cf6-4435-ba37-8d3878e26ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.245874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fafb5e-1cf6-4435-ba37-8d3878e26ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.246577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fafb5e-1cf6-4435-ba37-8d3878e26ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.250874 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 767/1524] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:00:54 2021] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:54.250874 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201432-6e72-44f1-be50-ee854fd9b70a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.251107 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fafb5e-1cf6-4435-ba37-8d3878e26ee6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.278577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 758/1525] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:00:54 2021] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:54.278577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fafb5e-1cf6-4435-ba37-8d3878e26ee6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.311148 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201432-6e72-44f1-be50-ee854fd9b70a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.337383 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fafb5e-1cf6-4435-ba37-8d3878e26ee6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.342247 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a6ecd-540e-44dd-950f-b9bd209b1002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.342913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a6ecd-540e-44dd-950f-b9bd209b1002 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.343301 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a6ecd-540e-44dd-950f-b9bd209b1002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.343662 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a6ecd-540e-44dd-950f-b9bd209b1002 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.344214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a6ecd-540e-44dd-950f-b9bd209b1002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.346152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a6ecd-540e-44dd-950f-b9bd209b1002 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.365477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84113f-1d99-4c4c-a686-bfb703d20310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.366170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84113f-1d99-4c4c-a686-bfb703d20310 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.366460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84113f-1d99-4c4c-a686-bfb703d20310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.366700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84113f-1d99-4c4c-a686-bfb703d20310 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.367517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84113f-1d99-4c4c-a686-bfb703d20310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.369433 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84113f-1d99-4c4c-a686-bfb703d20310 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.376332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 759/1526] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:00:54 2021] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:54.376332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a6ecd-540e-44dd-950f-b9bd209b1002 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.390931 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 768/1527] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:00:54 2021] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:54.391842 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84113f-1d99-4c4c-a686-bfb703d20310 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.401224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84113f-1d99-4c4c-a686-bfb703d20310 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.437468 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a6ecd-540e-44dd-950f-b9bd209b1002 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.442076 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df40df-d37a-4bde-b2da-f44c9c3109a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.442745 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df40df-d37a-4bde-b2da-f44c9c3109a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.443021 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df40df-d37a-4bde-b2da-f44c9c3109a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.443323 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df40df-d37a-4bde-b2da-f44c9c3109a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.444052 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df40df-d37a-4bde-b2da-f44c9c3109a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.445643 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df40df-d37a-4bde-b2da-f44c9c3109a6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.454976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227003a-ce92-4e36-a605-210cd66bc1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.455559 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 760/1528] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:54.458767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227003a-ce92-4e36-a605-210cd66bc1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.458767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227003a-ce92-4e36-a605-210cd66bc1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.458767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227003a-ce92-4e36-a605-210cd66bc1c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.459006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df40df-d37a-4bde-b2da-f44c9c3109a6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.459087 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227003a-ce92-4e36-a605-210cd66bc1c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.459087 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227003a-ce92-4e36-a605-210cd66bc1c1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.465919 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df40df-d37a-4bde-b2da-f44c9c3109a6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.470603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e99b5-da18-47b8-b868-7a0f8f233a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.472074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e99b5-da18-47b8-b868-7a0f8f233a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.472074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e99b5-da18-47b8-b868-7a0f8f233a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.473958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e99b5-da18-47b8-b868-7a0f8f233a53 admin admin] PATH_INFO: `/v3/projects/4c5faa9f2c4048bd9c40878bcb8a057c/users/575e913d0cd34dfb9eef961f7ec79652/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.483356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 769/1529] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:00:54 2021] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:54.484394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227003a-ce92-4e36-a605-210cd66bc1c1 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.491638 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e99b5-da18-47b8-b868-7a0f8f233a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5faa9f2c4048bd9c40878bcb8a057c, user_id=575e913d0cd34dfb9eef961f7ec79652, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.494139 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227003a-ce92-4e36-a605-210cd66bc1c1 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.494331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e99b5-da18-47b8-b868-7a0f8f233a53 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.499721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55c019-51f1-496f-bd43-5ca6e744f942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.500538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55c019-51f1-496f-bd43-5ca6e744f942 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.500934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55c019-51f1-496f-bd43-5ca6e744f942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.501286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55c019-51f1-496f-bd43-5ca6e744f942 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.502139 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55c019-51f1-496f-bd43-5ca6e744f942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.504110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55c019-51f1-496f-bd43-5ca6e744f942 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.510036 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 761/1530] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:00:54 2021] PUT /identity/v3/projects/4c5faa9f2c4048bd9c40878bcb8a057c/users/575e913d0cd34dfb9eef961f7ec79652/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:54.510888 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e99b5-da18-47b8-b868-7a0f8f233a53 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.516043 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 770/1531] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:54.517102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55c019-51f1-496f-bd43-5ca6e744f942 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.527775 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55c019-51f1-496f-bd43-5ca6e744f942 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.571863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e99b5-da18-47b8-b868-7a0f8f233a53 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.576438 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b369b-4479-4e0a-b41e-338e89403084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.577110 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b369b-4479-4e0a-b41e-338e89403084 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.577388 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b369b-4479-4e0a-b41e-338e89403084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.577655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b369b-4479-4e0a-b41e-338e89403084 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.578357 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b369b-4479-4e0a-b41e-338e89403084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.580309 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b369b-4479-4e0a-b41e-338e89403084 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.584764 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b6fd6-9754-4c4b-96d9-05db52c73907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.585439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b6fd6-9754-4c4b-96d9-05db52c73907 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.585729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b6fd6-9754-4c4b-96d9-05db52c73907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.586007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b6fd6-9754-4c4b-96d9-05db52c73907 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.586711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b6fd6-9754-4c4b-96d9-05db52c73907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.588677 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b6fd6-9754-4c4b-96d9-05db52c73907 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.601782 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 762/1532] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:00:54 2021] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:54.602789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b369b-4479-4e0a-b41e-338e89403084 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.610350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 771/1533] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:00:54 2021] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:54.611465 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b6fd6-9754-4c4b-96d9-05db52c73907 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.615832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b369b-4479-4e0a-b41e-338e89403084 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.620461 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571da24-8b3e-4809-850e-dad0b99c65f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.620883 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b6fd6-9754-4c4b-96d9-05db52c73907 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.621121 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571da24-8b3e-4809-850e-dad0b99c65f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.621403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571da24-8b3e-4809-850e-dad0b99c65f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.621676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571da24-8b3e-4809-850e-dad0b99c65f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.622555 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571da24-8b3e-4809-850e-dad0b99c65f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.624675 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571da24-8b3e-4809-850e-dad0b99c65f4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.625810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24821682-2647-42cd-938d-bb60039c32f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.626448 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24821682-2647-42cd-938d-bb60039c32f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.626723 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24821682-2647-42cd-938d-bb60039c32f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.626990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24821682-2647-42cd-938d-bb60039c32f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.627756 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24821682-2647-42cd-938d-bb60039c32f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.629324 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24821682-2647-42cd-938d-bb60039c32f3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.639812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 772/1534] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:54.640589 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24821682-2647-42cd-938d-bb60039c32f3 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.648707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 763/1535] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:00:54 2021] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:54.651931 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24821682-2647-42cd-938d-bb60039c32f3 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.652995 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571da24-8b3e-4809-850e-dad0b99c65f4 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.655108 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c86ef7-0c30-4da7-8a30-6b76fb03622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.656007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c86ef7-0c30-4da7-8a30-6b76fb03622b admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.656293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c86ef7-0c30-4da7-8a30-6b76fb03622b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.656564 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c86ef7-0c30-4da7-8a30-6b76fb03622b admin admin] PATH_INFO: `/v3/projects/b19dc35017c244c9b22e6c55c3091b29/users/fd75fa7d42a5418e87ebc4176e5a2790/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.664444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571da24-8b3e-4809-850e-dad0b99c65f4 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.669141 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf40de-22c8-4235-afcb-7b3778c34d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.669802 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf40de-22c8-4235-afcb-7b3778c34d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.670078 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf40de-22c8-4235-afcb-7b3778c34d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.670345 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf40de-22c8-4235-afcb-7b3778c34d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.671082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf40de-22c8-4235-afcb-7b3778c34d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.672708 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c86ef7-0c30-4da7-8a30-6b76fb03622b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19dc35017c244c9b22e6c55c3091b29, user_id=fd75fa7d42a5418e87ebc4176e5a2790, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.672829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf40de-22c8-4235-afcb-7b3778c34d0f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.675404 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c86ef7-0c30-4da7-8a30-6b76fb03622b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.682929 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 764/1536] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:54.683763 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf40de-22c8-4235-afcb-7b3778c34d0f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.693152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf40de-22c8-4235-afcb-7b3778c34d0f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.696835 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 773/1537] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:00:54 2021] PUT /identity/v3/projects/b19dc35017c244c9b22e6c55c3091b29/users/fd75fa7d42a5418e87ebc4176e5a2790/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:54.696835 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ae333-37cd-4c03-958f-8bd3751e640a None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.696835 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ae333-37cd-4c03-958f-8bd3751e640a None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.696835 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ae333-37cd-4c03-958f-8bd3751e640a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.721720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-010ae333-37cd-4c03-958f-8bd3751e640a None None] MFA Rules not processed for user `575e913d0cd34dfb9eef961f7ec79652`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:54.723050 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-010ae333-37cd-4c03-958f-8bd3751e640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:54.747245 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863a679-b0fd-4ef5-9efc-e76898086499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.748146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a679-b0fd-4ef5-9efc-e76898086499 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.748420 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a679-b0fd-4ef5-9efc-e76898086499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.748793 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a679-b0fd-4ef5-9efc-e76898086499 admin admin] PATH_INFO: `/v3/projects/9b003f9b99eb41f78d330cb823dc2e96/users/dc00c3d3cd5247bfb021074fcd46389c/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.763587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863a679-b0fd-4ef5-9efc-e76898086499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b003f9b99eb41f78d330cb823dc2e96, user_id=dc00c3d3cd5247bfb021074fcd46389c, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.766178 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863a679-b0fd-4ef5-9efc-e76898086499 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.780211 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 765/1538] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:00:54 2021] PUT /identity/v3/projects/9b003f9b99eb41f78d330cb823dc2e96/users/dc00c3d3cd5247bfb021074fcd46389c/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:54.780954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863a679-b0fd-4ef5-9efc-e76898086499 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.790735 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 774/1539] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:54 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:54.791597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ae333-37cd-4c03-958f-8bd3751e640a None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.801960 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ae333-37cd-4c03-958f-8bd3751e640a None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.839567 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863a679-b0fd-4ef5-9efc-e76898086499 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.844338 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e6f7b-2b99-4d91-bfb5-a684c04bdb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.845006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e6f7b-2b99-4d91-bfb5-a684c04bdb11 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.845284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e6f7b-2b99-4d91-bfb5-a684c04bdb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.845552 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e6f7b-2b99-4d91-bfb5-a684c04bdb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.846288 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e6f7b-2b99-4d91-bfb5-a684c04bdb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.847918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e6f7b-2b99-4d91-bfb5-a684c04bdb11 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.855771 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331d7d5-34cf-4bf2-9061-ee40f829d242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.856513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331d7d5-34cf-4bf2-9061-ee40f829d242 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.856790 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331d7d5-34cf-4bf2-9061-ee40f829d242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.857071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331d7d5-34cf-4bf2-9061-ee40f829d242 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.857425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 766/1540] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:54.857804 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331d7d5-34cf-4bf2-9061-ee40f829d242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.858220 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e6f7b-2b99-4d91-bfb5-a684c04bdb11 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.859735 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331d7d5-34cf-4bf2-9061-ee40f829d242 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.867193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e6f7b-2b99-4d91-bfb5-a684c04bdb11 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.870233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 775/1541] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:54.871014 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331d7d5-34cf-4bf2-9061-ee40f829d242 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.872365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2a6f9-74c7-4372-9393-177a8d7f1fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.873130 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2a6f9-74c7-4372-9393-177a8d7f1fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.873412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2a6f9-74c7-4372-9393-177a8d7f1fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.873891 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2a6f9-74c7-4372-9393-177a8d7f1fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.874414 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2a6f9-74c7-4372-9393-177a8d7f1fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.876030 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2a6f9-74c7-4372-9393-177a8d7f1fa8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.880930 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331d7d5-34cf-4bf2-9061-ee40f829d242 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.889290 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 767/1542] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:54.889460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bc7fd-228d-47b1-893b-5d5e7ef3bcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.889596 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2a6f9-74c7-4372-9393-177a8d7f1fa8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.889687 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bc7fd-228d-47b1-893b-5d5e7ef3bcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.889687 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bc7fd-228d-47b1-893b-5d5e7ef3bcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.889687 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bc7fd-228d-47b1-893b-5d5e7ef3bcc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.889687 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bc7fd-228d-47b1-893b-5d5e7ef3bcc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.890350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bc7fd-228d-47b1-893b-5d5e7ef3bcc9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.898829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2a6f9-74c7-4372-9393-177a8d7f1fa8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.900817 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 776/1543] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:54.902037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407b193-308a-471b-9556-666539dafaa4 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.902325 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407b193-308a-471b-9556-666539dafaa4 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.902596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407b193-308a-471b-9556-666539dafaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.906325 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aced8a-675b-4e9f-94b7-c3433e5e50ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.906977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aced8a-675b-4e9f-94b7-c3433e5e50ba admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.907292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aced8a-675b-4e9f-94b7-c3433e5e50ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.907569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aced8a-675b-4e9f-94b7-c3433e5e50ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.908295 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aced8a-675b-4e9f-94b7-c3433e5e50ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.909866 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aced8a-675b-4e9f-94b7-c3433e5e50ba admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.919807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 768/1544] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:54.920731 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-4407b193-308a-471b-9556-666539dafaa4 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:54.921585 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aced8a-675b-4e9f-94b7-c3433e5e50ba admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.921948 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4407b193-308a-471b-9556-666539dafaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:54.929706 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 777/1545] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:54.932913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407b193-308a-471b-9556-666539dafaa4 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.933017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aced8a-675b-4e9f-94b7-c3433e5e50ba admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.944545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17932704-14ac-4657-aa5b-c95c99b63c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.945219 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17932704-14ac-4657-aa5b-c95c99b63c2d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.945503 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17932704-14ac-4657-aa5b-c95c99b63c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.945777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17932704-14ac-4657-aa5b-c95c99b63c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.946529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17932704-14ac-4657-aa5b-c95c99b63c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.948204 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17932704-14ac-4657-aa5b-c95c99b63c2d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.959339 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 769/1546] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:54.960276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17932704-14ac-4657-aa5b-c95c99b63c2d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.970436 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17932704-14ac-4657-aa5b-c95c99b63c2d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.976749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2590b-248e-4e27-b405-9f2d2876de70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.977412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2590b-248e-4e27-b405-9f2d2876de70 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.977694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2590b-248e-4e27-b405-9f2d2876de70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.977968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2590b-248e-4e27-b405-9f2d2876de70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:54.978708 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2590b-248e-4e27-b405-9f2d2876de70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:54.980334 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2590b-248e-4e27-b405-9f2d2876de70 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:54.988287 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407b193-308a-471b-9556-666539dafaa4 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:54.990669 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 770/1547] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:54.991534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2590b-248e-4e27-b405-9f2d2876de70 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:54.992357 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29001570-33fe-4f55-ba16-7eca9a115bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:54.993004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29001570-33fe-4f55-ba16-7eca9a115bee service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:54.993286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29001570-33fe-4f55-ba16-7eca9a115bee service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:54.993601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29001570-33fe-4f55-ba16-7eca9a115bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.002922 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2590b-248e-4e27-b405-9f2d2876de70 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:55.008232 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e28ac-6a6e-4ec2-8c8e-71bfb978a149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:55.008879 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e28ac-6a6e-4ec2-8c8e-71bfb978a149 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.009162 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e28ac-6a6e-4ec2-8c8e-71bfb978a149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.009436 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e28ac-6a6e-4ec2-8c8e-71bfb978a149 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.010172 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e28ac-6a6e-4ec2-8c8e-71bfb978a149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:55.011809 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e28ac-6a6e-4ec2-8c8e-71bfb978a149 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:55.022777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 771/1548] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:55.023517 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e28ac-6a6e-4ec2-8c8e-71bfb978a149 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:55.033567 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e28ac-6a6e-4ec2-8c8e-71bfb978a149 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:55.039150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b67c4-e75d-4c67-9756-3484c652f5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:55.040048 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b67c4-e75d-4c67-9756-3484c652f5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.040352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b67c4-e75d-4c67-9756-3484c652f5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.040622 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b67c4-e75d-4c67-9756-3484c652f5e8 admin admin] PATH_INFO: `/v3/projects/236b45bfe3d24be58e0702d292294977/users/42ceeb5939b34fe8bb7457ff67a4fbc4/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.053987 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29001570-33fe-4f55-ba16-7eca9a115bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:55.055520 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29001570-33fe-4f55-ba16-7eca9a115bee service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:55.055921 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b67c4-e75d-4c67-9756-3484c652f5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236b45bfe3d24be58e0702d292294977, user_id=42ceeb5939b34fe8bb7457ff67a4fbc4, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:55.058570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b67c4-e75d-4c67-9756-3484c652f5e8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:55.064545 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 778/1549] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:00:54 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:00:55.065390 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29001570-33fe-4f55-ba16-7eca9a115bee service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:55.081503 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 772/1550] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:00:55 2021] PUT /identity/v3/projects/236b45bfe3d24be58e0702d292294977/users/42ceeb5939b34fe8bb7457ff67a4fbc4/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:55.081676 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29001570-33fe-4f55-ba16-7eca9a115bee service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:55.081778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b67c4-e75d-4c67-9756-3484c652f5e8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:55.140511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176882f1-49b5-4a19-90c8-4be4f0051c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:55.141194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176882f1-49b5-4a19-90c8-4be4f0051c26 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.141476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176882f1-49b5-4a19-90c8-4be4f0051c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.141749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176882f1-49b5-4a19-90c8-4be4f0051c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.142689 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176882f1-49b5-4a19-90c8-4be4f0051c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:55.144398 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176882f1-49b5-4a19-90c8-4be4f0051c26 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:55.145348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b67c4-e75d-4c67-9756-3484c652f5e8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:55.151038 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dd46e-cf5b-4f0f-b4dd-786160d4a7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:55.151960 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dd46e-cf5b-4f0f-b4dd-786160d4a7dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.152242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dd46e-cf5b-4f0f-b4dd-786160d4a7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.152523 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dd46e-cf5b-4f0f-b4dd-786160d4a7dc admin admin] PATH_INFO: `/v3/projects/8104285dcc5e40e38b326bce5751bfb0/users/435e41436b5749919eb106fe40355a25/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.158266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 779/1551] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:55 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:55.159333 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176882f1-49b5-4a19-90c8-4be4f0051c26 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:55.169186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dd46e-cf5b-4f0f-b4dd-786160d4a7dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8104285dcc5e40e38b326bce5751bfb0, user_id=435e41436b5749919eb106fe40355a25, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:55.172161 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dd46e-cf5b-4f0f-b4dd-786160d4a7dc admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:55.187729 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 773/1552] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:00:55 2021] PUT /identity/v3/projects/8104285dcc5e40e38b326bce5751bfb0/users/435e41436b5749919eb106fe40355a25/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:55.188558 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dd46e-cf5b-4f0f-b4dd-786160d4a7dc admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:55.215659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176882f1-49b5-4a19-90c8-4be4f0051c26 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:55.248791 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dd46e-cf5b-4f0f-b4dd-786160d4a7dc admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:55.253635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae547745-d5b6-461d-aae8-0ad501ce7a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:55.254552 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae547745-d5b6-461d-aae8-0ad501ce7a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.254832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae547745-d5b6-461d-aae8-0ad501ce7a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.255180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae547745-d5b6-461d-aae8-0ad501ce7a36 admin admin] PATH_INFO: `/v3/projects/9b003f9b99eb41f78d330cb823dc2e96/users/dc00c3d3cd5247bfb021074fcd46389c/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.257367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae547745-d5b6-461d-aae8-0ad501ce7a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b003f9b99eb41f78d330cb823dc2e96, user_id=dc00c3d3cd5247bfb021074fcd46389c, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:55.260106 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae547745-d5b6-461d-aae8-0ad501ce7a36 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:55.267615 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652de0f7-ce64-482d-8532-b180e399ee06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:55.268277 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652de0f7-ce64-482d-8532-b180e399ee06 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.268559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652de0f7-ce64-482d-8532-b180e399ee06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.268841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652de0f7-ce64-482d-8532-b180e399ee06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.271566 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 774/1553] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:00:55 2021] PUT /identity/v3/projects/9b003f9b99eb41f78d330cb823dc2e96/users/dc00c3d3cd5247bfb021074fcd46389c/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:55.272450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae547745-d5b6-461d-aae8-0ad501ce7a36 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:55.290678 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652de0f7-ce64-482d-8532-b180e399ee06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:55.293236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652de0f7-ce64-482d-8532-b180e399ee06 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:55.308469 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 780/1554] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:00:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:00:55.309823 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652de0f7-ce64-482d-8532-b180e399ee06 service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:55.320924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652de0f7-ce64-482d-8532-b180e399ee06 service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:55.354222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae547745-d5b6-461d-aae8-0ad501ce7a36 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:55.360760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83f678-8156-4336-b2b1-e7d6114d2529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:55.361841 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83f678-8156-4336-b2b1-e7d6114d2529 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.362161 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83f678-8156-4336-b2b1-e7d6114d2529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.362475 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83f678-8156-4336-b2b1-e7d6114d2529 admin admin] PATH_INFO: `/v3/projects/513edfe04394445eac9fba7e014af92f/users/4f95dd5d1b47415e830d6fa518d56766/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.379234 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83f678-8156-4336-b2b1-e7d6114d2529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513edfe04394445eac9fba7e014af92f, user_id=4f95dd5d1b47415e830d6fa518d56766, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:55.383186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83f678-8156-4336-b2b1-e7d6114d2529 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:55.392732 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a2c67-541c-4318-8095-70572fe00a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:55.393953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a2c67-541c-4318-8095-70572fe00a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.394335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a2c67-541c-4318-8095-70572fe00a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.394754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a2c67-541c-4318-8095-70572fe00a9a admin admin] PATH_INFO: `/v3/projects/d06106d622254aaf928e1fb487c101fa/users/763c552499cc4f2ca8e7070f822f51b9/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.400197 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 775/1555] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:00:55 2021] PUT /identity/v3/projects/513edfe04394445eac9fba7e014af92f/users/4f95dd5d1b47415e830d6fa518d56766/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:55.401945 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49c4a-373f-497d-9256-eadb2a29ffa7 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.402846 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49c4a-373f-497d-9256-eadb2a29ffa7 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.403907 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49c4a-373f-497d-9256-eadb2a29ffa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.412659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a2c67-541c-4318-8095-70572fe00a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06106d622254aaf928e1fb487c101fa, user_id=763c552499cc4f2ca8e7070f822f51b9, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:55.415966 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a2c67-541c-4318-8095-70572fe00a9a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:55.434038 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 781/1556] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:00:55 2021] PUT /identity/v3/projects/d06106d622254aaf928e1fb487c101fa/users/763c552499cc4f2ca8e7070f822f51b9/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:55.435536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a2c67-541c-4318-8095-70572fe00a9a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:55.437862 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-aeb49c4a-373f-497d-9256-eadb2a29ffa7 None None] MFA Rules not processed for user `42ceeb5939b34fe8bb7457ff67a4fbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:55.439905 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-aeb49c4a-373f-497d-9256-eadb2a29ffa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:55.507503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a2c67-541c-4318-8095-70572fe00a9a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:55.514686 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a984d-0f0b-4958-b1e0-c06cc8d82125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:55.515877 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a984d-0f0b-4958-b1e0-c06cc8d82125 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.516148 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a984d-0f0b-4958-b1e0-c06cc8d82125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.517620 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a984d-0f0b-4958-b1e0-c06cc8d82125 admin admin] PATH_INFO: `/v3/projects/5fce7f68606c4cb8b214910a6dd87fb8/users/73ef103ad38f498c8ea87525f554f438/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.526379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 776/1557] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:55 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:55.526379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ad665-37f5-4fcf-8b3a-b88d2f57bcb6 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.526379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ad665-37f5-4fcf-8b3a-b88d2f57bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.526379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ad665-37f5-4fcf-8b3a-b88d2f57bcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.536655 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a984d-0f0b-4958-b1e0-c06cc8d82125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fce7f68606c4cb8b214910a6dd87fb8, user_id=73ef103ad38f498c8ea87525f554f438, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:55.540090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a984d-0f0b-4958-b1e0-c06cc8d82125 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:55.558730 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-6b2ad665-37f5-4fcf-8b3a-b88d2f57bcb6 None None] MFA Rules not processed for user `435e41436b5749919eb106fe40355a25`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:55.559906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 782/1558] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:00:55 2021] PUT /identity/v3/projects/5fce7f68606c4cb8b214910a6dd87fb8/users/73ef103ad38f498c8ea87525f554f438/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:55.560666 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6b2ad665-37f5-4fcf-8b3a-b88d2f57bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:55.561765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f54e2-123f-4a4f-b97f-94501f555bca None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.562317 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f54e2-123f-4a4f-b97f-94501f555bca None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.562711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f54e2-123f-4a4f-b97f-94501f555bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.628244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-f06f54e2-123f-4a4f-b97f-94501f555bca None None] MFA Rules not processed for user `dc00c3d3cd5247bfb021074fcd46389c`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:55.629571 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f06f54e2-123f-4a4f-b97f-94501f555bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:55.679115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 777/1559] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:55 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:55.680653 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f532b03-42da-46cb-b55d-2a3fa7b3fccf None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.680944 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f532b03-42da-46cb-b55d-2a3fa7b3fccf None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.681219 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f532b03-42da-46cb-b55d-2a3fa7b3fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.705978 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8f532b03-42da-46cb-b55d-2a3fa7b3fccf None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:55.707348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8f532b03-42da-46cb-b55d-2a3fa7b3fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:55.789439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 783/1560] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:55 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:55.802426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cb0fe-1221-4e04-9e72-1c2b03d6e8e0 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.802426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cb0fe-1221-4e04-9e72-1c2b03d6e8e0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.803208 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cb0fe-1221-4e04-9e72-1c2b03d6e8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.841064 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-705cb0fe-1221-4e04-9e72-1c2b03d6e8e0 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:55.842354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-705cb0fe-1221-4e04-9e72-1c2b03d6e8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:55.851584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 784/1561] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:55.852530 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cb0fe-1221-4e04-9e72-1c2b03d6e8e0 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:55.857924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 778/1562] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:55.861074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f66ea-ec3e-4e47-8b8e-7076decae346 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.861884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f66ea-ec3e-4e47-8b8e-7076decae346 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.862380 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f66ea-ec3e-4e47-8b8e-7076decae346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.864584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cb0fe-1221-4e04-9e72-1c2b03d6e8e0 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:55.869796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b286f-7d7c-4e43-8ad6-5c7820c0f38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:55.870453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b286f-7d7c-4e43-8ad6-5c7820c0f38a admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.870738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b286f-7d7c-4e43-8ad6-5c7820c0f38a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.871011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b286f-7d7c-4e43-8ad6-5c7820c0f38a admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.872131 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b286f-7d7c-4e43-8ad6-5c7820c0f38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:55.874133 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b286f-7d7c-4e43-8ad6-5c7820c0f38a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:55.883078 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-011f66ea-ec3e-4e47-8b8e-7076decae346 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:55.884330 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-011f66ea-ec3e-4e47-8b8e-7076decae346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:55.895513 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 779/1563] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:55.896364 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f66ea-ec3e-4e47-8b8e-7076decae346 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:55.909460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 785/1564] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:00:55 2021] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:55.912373 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f66ea-ec3e-4e47-8b8e-7076decae346 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:55.913434 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b286f-7d7c-4e43-8ad6-5c7820c0f38a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:55.972150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc39684-ee7e-411b-89c5-fab5582a2276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:55.972828 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc39684-ee7e-411b-89c5-fab5582a2276 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.973102 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc39684-ee7e-411b-89c5-fab5582a2276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.973381 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc39684-ee7e-411b-89c5-fab5582a2276 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:55.974221 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc39684-ee7e-411b-89c5-fab5582a2276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:55.976129 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b286f-7d7c-4e43-8ad6-5c7820c0f38a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:55.976251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc39684-ee7e-411b-89c5-fab5582a2276 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:55.981922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf13427-d875-43a3-a83c-574332f6a2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:55.983157 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf13427-d875-43a3-a83c-574332f6a2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:55.983646 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf13427-d875-43a3-a83c-574332f6a2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:55.984145 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf13427-d875-43a3-a83c-574332f6a2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.006428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 780/1565] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:00:55 2021] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:56.007590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc39684-ee7e-411b-89c5-fab5582a2276 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.076534 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf13427-d875-43a3-a83c-574332f6a2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:56.076785 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc39684-ee7e-411b-89c5-fab5582a2276 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:56.078003 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf13427-d875-43a3-a83c-574332f6a2d9 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:56.080469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04026fe2-b1a6-4af5-8323-05310437712f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:56.081721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04026fe2-b1a6-4af5-8323-05310437712f service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:56.082011 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04026fe2-b1a6-4af5-8323-05310437712f service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:56.082497 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04026fe2-b1a6-4af5-8323-05310437712f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.090859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 786/1566] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:00:55 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:00:56.091943 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf13427-d875-43a3-a83c-574332f6a2d9 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.182823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04026fe2-b1a6-4af5-8323-05310437712f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:56.186563 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04026fe2-b1a6-4af5-8323-05310437712f service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:56.201537 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf13427-d875-43a3-a83c-574332f6a2d9 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:56.202657 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 781/1567] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:00:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:00:56.203816 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04026fe2-b1a6-4af5-8323-05310437712f service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.213676 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ec999-69ee-44c5-9960-5f73729521ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:56.214766 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ec999-69ee-44c5-9960-5f73729521ad service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:56.216887 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ec999-69ee-44c5-9960-5f73729521ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:56.217283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ec999-69ee-44c5-9960-5f73729521ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.222464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04026fe2-b1a6-4af5-8323-05310437712f service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:56.228199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b2584-2373-4292-8c1d-d4130a778d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:56.229030 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2584-2373-4292-8c1d-d4130a778d8f service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:56.229444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2584-2373-4292-8c1d-d4130a778d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:56.229729 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2584-2373-4292-8c1d-d4130a778d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.230090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ec999-69ee-44c5-9960-5f73729521ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:56.231933 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ec999-69ee-44c5-9960-5f73729521ad service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:56.240832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b2584-2373-4292-8c1d-d4130a778d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:56.246425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b2584-2373-4292-8c1d-d4130a778d8f service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:56.248216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 787/1568] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:00:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:00:56.249267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ec999-69ee-44c5-9960-5f73729521ad service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.264751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ec999-69ee-44c5-9960-5f73729521ad service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:56.267467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 782/1569] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:00:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:00:56.269491 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b2584-2373-4292-8c1d-d4130a778d8f service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.271539 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b9d05-89b2-4dc2-8b1c-93c9b7f676f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:56.272292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9d05-89b2-4dc2-8b1c-93c9b7f676f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:56.272683 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9d05-89b2-4dc2-8b1c-93c9b7f676f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:56.273044 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9d05-89b2-4dc2-8b1c-93c9b7f676f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.273816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b9d05-89b2-4dc2-8b1c-93c9b7f676f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:56.277349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b9d05-89b2-4dc2-8b1c-93c9b7f676f6 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:56.286299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b2584-2373-4292-8c1d-d4130a778d8f service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:56.293703 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38e141-8198-434b-b285-236a687f1036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:56.294956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38e141-8198-434b-b285-236a687f1036 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:56.295783 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38e141-8198-434b-b285-236a687f1036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:56.296906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38e141-8198-434b-b285-236a687f1036 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.298103 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38e141-8198-434b-b285-236a687f1036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:56.301215 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38e141-8198-434b-b285-236a687f1036 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:56.325812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 788/1570] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:00:56 2021] POST /identity/v3/users => generated 302 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:56.330431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b9d05-89b2-4dc2-8b1c-93c9b7f676f6 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.341449 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 783/1571] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:00:56 2021] POST /identity/v3/users => generated 289 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:00:56.346133 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b9d05-89b2-4dc2-8b1c-93c9b7f676f6 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:56.346569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38e141-8198-434b-b285-236a687f1036 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.360866 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38e141-8198-434b-b285-236a687f1036 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:56.361071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b00a0-fa5c-4772-8d19-817971db8419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:56.361637 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b00a0-fa5c-4772-8d19-817971db8419 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:56.362056 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b00a0-fa5c-4772-8d19-817971db8419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:56.362335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b00a0-fa5c-4772-8d19-817971db8419 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.363095 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b00a0-fa5c-4772-8d19-817971db8419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:56.364870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b00a0-fa5c-4772-8d19-817971db8419 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:56.367010 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d96332-b852-4997-996c-eef72381fe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:56.369157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d96332-b852-4997-996c-eef72381fe23 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:56.370103 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d96332-b852-4997-996c-eef72381fe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:56.370915 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d96332-b852-4997-996c-eef72381fe23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.374450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d96332-b852-4997-996c-eef72381fe23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:56.377769 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d96332-b852-4997-996c-eef72381fe23 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:56.389900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 789/1572] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:56 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:00:56.390707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b00a0-fa5c-4772-8d19-817971db8419 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.394622 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 784/1573] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:56 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:56.395807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d96332-b852-4997-996c-eef72381fe23 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.402387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b00a0-fa5c-4772-8d19-817971db8419 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:56.409080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e467689-d9cb-445b-a065-f2996fcf5d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:56.410081 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e467689-d9cb-445b-a065-f2996fcf5d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:56.410370 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e467689-d9cb-445b-a065-f2996fcf5d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:56.410680 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e467689-d9cb-445b-a065-f2996fcf5d9b admin admin] PATH_INFO: `/v3/users/b2abfda55d4843caa96c0225823fe529` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.412193 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e467689-d9cb-445b-a065-f2996fcf5d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2abfda55d4843caa96c0225823fe529)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:56.413409 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d96332-b852-4997-996c-eef72381fe23 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:56.414399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e467689-d9cb-445b-a065-f2996fcf5d9b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:56.421656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228d823-8fd4-4ab5-b0f8-18f267d66c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:56.424243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228d823-8fd4-4ab5-b0f8-18f267d66c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:56.424897 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228d823-8fd4-4ab5-b0f8-18f267d66c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:56.425454 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228d823-8fd4-4ab5-b0f8-18f267d66c78 admin admin] PATH_INFO: `/v3/projects/40a4d5e963134cbeade626408196487b/users/297a28bae4c641c499294f5314e97516/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.449533 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228d823-8fd4-4ab5-b0f8-18f267d66c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a4d5e963134cbeade626408196487b, user_id=297a28bae4c641c499294f5314e97516, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:56.454981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228d823-8fd4-4ab5-b0f8-18f267d66c78 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:56.488530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 785/1574] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:00:56 2021] PUT /identity/v3/projects/40a4d5e963134cbeade626408196487b/users/297a28bae4c641c499294f5314e97516/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:56.490133 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228d823-8fd4-4ab5-b0f8-18f267d66c78 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.497303 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7e467689-d9cb-445b-a065-f2996fcf5d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2abfda55d4843caa96c0225823fe529'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:56.498504 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7e467689-d9cb-445b-a065-f2996fcf5d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2abfda55d4843caa96c0225823fe529'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:56.514487 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7e467689-d9cb-445b-a065-f2996fcf5d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2abfda55d4843caa96c0225823fe529'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:56.516020 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7e467689-d9cb-445b-a065-f2996fcf5d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2abfda55d4843caa96c0225823fe529'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:56.534877 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7e467689-d9cb-445b-a065-f2996fcf5d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2abfda55d4843caa96c0225823fe529'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:56.557302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 790/1575] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:00:56 2021] DELETE /identity/v3/users/b2abfda55d4843caa96c0225823fe529 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:56.558745 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e467689-d9cb-445b-a065-f2996fcf5d9b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.561574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7e467689-d9cb-445b-a065-f2996fcf5d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:56.582687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228d823-8fd4-4ab5-b0f8-18f267d66c78 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:56.667193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc04ba-7e51-4cb3-9566-10c06d5b4789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:56.667675 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e467689-d9cb-445b-a065-f2996fcf5d9b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:56.669131 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc04ba-7e51-4cb3-9566-10c06d5b4789 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:56.669935 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc04ba-7e51-4cb3-9566-10c06d5b4789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:56.670456 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc04ba-7e51-4cb3-9566-10c06d5b4789 admin admin] PATH_INFO: `/v3/projects/77431efffc2f4a0592c6a553a8631808/users/e3752f7e2a2d478cb6259c1aca861e62/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.675060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd46f1-736d-45fc-8fa5-544319da93dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:56.676045 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd46f1-736d-45fc-8fa5-544319da93dd admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:56.676788 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd46f1-736d-45fc-8fa5-544319da93dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:56.677352 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd46f1-736d-45fc-8fa5-544319da93dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.678307 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd46f1-736d-45fc-8fa5-544319da93dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:56.680213 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd46f1-736d-45fc-8fa5-544319da93dd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:56.693601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 791/1576] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:56 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:56.694985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d7e7d-76f5-479a-871a-feb3654155e3 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:56.695369 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d7e7d-76f5-479a-871a-feb3654155e3 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:56.695718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d7e7d-76f5-479a-871a-feb3654155e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.698797 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc04ba-7e51-4cb3-9566-10c06d5b4789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77431efffc2f4a0592c6a553a8631808, user_id=e3752f7e2a2d478cb6259c1aca861e62, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:56.701877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc04ba-7e51-4cb3-9566-10c06d5b4789 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:56.719304 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-725d7e7d-76f5-479a-871a-feb3654155e3 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:56.721118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-725d7e7d-76f5-479a-871a-feb3654155e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:56.723564 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 786/1577] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:00:56 2021] PUT /identity/v3/projects/77431efffc2f4a0592c6a553a8631808/users/e3752f7e2a2d478cb6259c1aca861e62/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:56.727940 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc04ba-7e51-4cb3-9566-10c06d5b4789 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.808031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 792/1578] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:56.808031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d7e7d-76f5-479a-871a-feb3654155e3 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.808031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-725d7e7d-76f5-479a-871a-feb3654155e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:56.814390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc04ba-7e51-4cb3-9566-10c06d5b4789 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:56.820228 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d7e7d-76f5-479a-871a-feb3654155e3 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:56.821311 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2a86a-1a4e-4781-9b04-7437be55cccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:56.822178 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2a86a-1a4e-4781-9b04-7437be55cccd admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:56.822635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2a86a-1a4e-4781-9b04-7437be55cccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:56.823065 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2a86a-1a4e-4781-9b04-7437be55cccd admin admin] PATH_INFO: `/v3/projects/40a4d5e963134cbeade626408196487b/users/297a28bae4c641c499294f5314e97516/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.826998 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2a86a-1a4e-4781-9b04-7437be55cccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a4d5e963134cbeade626408196487b, user_id=297a28bae4c641c499294f5314e97516, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:56.827867 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20095aa-2e5b-41cc-b57b-afaf4611e15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:56.828739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20095aa-2e5b-41cc-b57b-afaf4611e15d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:56.829154 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20095aa-2e5b-41cc-b57b-afaf4611e15d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:56.829568 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20095aa-2e5b-41cc-b57b-afaf4611e15d admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:56.829946 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2a86a-1a4e-4781-9b04-7437be55cccd admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:56.830594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20095aa-2e5b-41cc-b57b-afaf4611e15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:56.833615 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20095aa-2e5b-41cc-b57b-afaf4611e15d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:56.847224 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 787/1579] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:00:56 2021] PUT /identity/v3/projects/40a4d5e963134cbeade626408196487b/users/297a28bae4c641c499294f5314e97516/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:56.849287 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2a86a-1a4e-4781-9b04-7437be55cccd admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.850987 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 793/1580] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:00:56 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:00:56.852119 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-33a2a86a-1a4e-4781-9b04-7437be55cccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:56.857483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20095aa-2e5b-41cc-b57b-afaf4611e15d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:56.882183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20095aa-2e5b-41cc-b57b-afaf4611e15d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:56.998424 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2a86a-1a4e-4781-9b04-7437be55cccd admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:57.004690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b388b5-2cf6-44a7-ac80-d79590f1ce9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:57.005466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b388b5-2cf6-44a7-ac80-d79590f1ce9c service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:57.005824 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b388b5-2cf6-44a7-ac80-d79590f1ce9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:57.006214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b388b5-2cf6-44a7-ac80-d79590f1ce9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:57.007211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479cead-2369-4c26-af73-d1bd4552d55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:57.008235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479cead-2369-4c26-af73-d1bd4552d55f admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:57.008575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479cead-2369-4c26-af73-d1bd4552d55f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:57.008968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479cead-2369-4c26-af73-d1bd4552d55f admin admin] PATH_INFO: `/v3/projects/77431efffc2f4a0592c6a553a8631808/users/e3752f7e2a2d478cb6259c1aca861e62/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:57.011743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479cead-2369-4c26-af73-d1bd4552d55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=77431efffc2f4a0592c6a553a8631808, user_id=e3752f7e2a2d478cb6259c1aca861e62, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:57.018110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479cead-2369-4c26-af73-d1bd4552d55f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:57.026758 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b388b5-2cf6-44a7-ac80-d79590f1ce9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:57.028827 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b388b5-2cf6-44a7-ac80-d79590f1ce9c service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:57.041871 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 788/1581] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:00:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:00:57.045136 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaad1d8-5ebb-433f-a6c9-ac92e74dd377 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:57.045574 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaad1d8-5ebb-433f-a6c9-ac92e74dd377 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:57.045968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaad1d8-5ebb-433f-a6c9-ac92e74dd377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:57.050749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 794/1582] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:00:56 2021] PUT /identity/v3/projects/77431efffc2f4a0592c6a553a8631808/users/e3752f7e2a2d478cb6259c1aca861e62/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:57.062954 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93818c-f9af-4e2b-9451-543868c685fa None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:57.063270 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93818c-f9af-4e2b-9451-543868c685fa None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:57.063633 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93818c-f9af-4e2b-9451-543868c685fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:57.117677 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-9aaad1d8-5ebb-433f-a6c9-ac92e74dd377 None None] MFA Rules not processed for user `297a28bae4c641c499294f5314e97516`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:57.120311 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9aaad1d8-5ebb-433f-a6c9-ac92e74dd377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:57.124369 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-1d93818c-f9af-4e2b-9451-543868c685fa None None] MFA Rules not processed for user `e3752f7e2a2d478cb6259c1aca861e62`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:57.125596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1d93818c-f9af-4e2b-9451-543868c685fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:57.316340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 789/1583] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:57 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:57.316340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaad1d8-5ebb-433f-a6c9-ac92e74dd377 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:57.316340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9aaad1d8-5ebb-433f-a6c9-ac92e74dd377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:57.324277 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 795/1584] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:00:57 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:00:57.348594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93818c-f9af-4e2b-9451-543868c685fa None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:57.351953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1d93818c-f9af-4e2b-9451-543868c685fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:57.401064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaad1d8-5ebb-433f-a6c9-ac92e74dd377 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:57.408251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d5f77-2f22-452c-a9ed-01e811b551bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:57.409013 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d5f77-2f22-452c-a9ed-01e811b551bf service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:57.409341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d5f77-2f22-452c-a9ed-01e811b551bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:57.409649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d5f77-2f22-452c-a9ed-01e811b551bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:57.422557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d5f77-2f22-452c-a9ed-01e811b551bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:57.424150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d5f77-2f22-452c-a9ed-01e811b551bf service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:57.448520 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 790/1585] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:00:57 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:00:57.453367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e758f-fa69-49a7-a323-262e2e95735a None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:57.453832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e758f-fa69-49a7-a323-262e2e95735a None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:57.454122 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e758f-fa69-49a7-a323-262e2e95735a None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:57.458792 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 791/1586] 10.222.0.20 () {54 vars in 960 bytes} [Mon Nov 8 11:00:57 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 11:00:57.463104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb06922-7178-4b4a-90c3-03956c85f842 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:57.464289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb06922-7178-4b4a-90c3-03956c85f842 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:57.464579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb06922-7178-4b4a-90c3-03956c85f842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:57.483836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93818c-f9af-4e2b-9451-543868c685fa None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:57.488965 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338f71e-75b7-40e9-b8a7-a1f963cd6cb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:57.489940 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338f71e-75b7-40e9-b8a7-a1f963cd6cb6 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:57.490559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338f71e-75b7-40e9-b8a7-a1f963cd6cb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:57.491208 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338f71e-75b7-40e9-b8a7-a1f963cd6cb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:57.503723 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338f71e-75b7-40e9-b8a7-a1f963cd6cb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:57.505896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338f71e-75b7-40e9-b8a7-a1f963cd6cb6 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:57.508554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-2eb06922-7178-4b4a-90c3-03956c85f842 None None] MFA Rules not processed for user `d3421cf1bbb24423a2f24c4667adfdda`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:57.512308 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2eb06922-7178-4b4a-90c3-03956c85f842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:57.523591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 796/1587] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:00:57 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:00:57.546244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338f71e-75b7-40e9-b8a7-a1f963cd6cb6 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:57.563020 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338f71e-75b7-40e9-b8a7-a1f963cd6cb6 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:57.572661 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258bc8e-17f3-4a84-a75c-077fffe7ddd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:57.576741 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258bc8e-17f3-4a84-a75c-077fffe7ddd7 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:57.577110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258bc8e-17f3-4a84-a75c-077fffe7ddd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:57.579019 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258bc8e-17f3-4a84-a75c-077fffe7ddd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:57.585684 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a258bc8e-17f3-4a84-a75c-077fffe7ddd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:57.639464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 792/1588] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Nov 8 11:00:57 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:57.640387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb06922-7178-4b4a-90c3-03956c85f842 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:57.645260 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2eb06922-7178-4b4a-90c3-03956c85f842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:57.757511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258bc8e-17f3-4a84-a75c-077fffe7ddd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:57.761046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258bc8e-17f3-4a84-a75c-077fffe7ddd7 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:57.773371 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 797/1589] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:00:57 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:00:57.775053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82616f3f-3002-4ba5-81e5-9cbd2dea4b41 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:57.775722 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82616f3f-3002-4ba5-81e5-9cbd2dea4b41 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:57.776000 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82616f3f-3002-4ba5-81e5-9cbd2dea4b41 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:57.780832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb06922-7178-4b4a-90c3-03956c85f842 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:57.783393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 798/1590] 10.222.0.20 () {54 vars in 912 bytes} [Mon Nov 8 11:00:57 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 11:00:57.784625 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82616f3f-3002-4ba5-81e5-9cbd2dea4b41 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:57.791288 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:57.792275 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:57.792538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:57.792816 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] PATH_INFO: `/v3/projects/52e8bc4892f249399fd5675c504095ad` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:57.794168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e8bc4892f249399fd5675c504095ad)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:57.796425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:57.798012 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82616f3f-3002-4ba5-81e5-9cbd2dea4b41 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:57.812004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291038c-1d28-483b-82b8-9f32881dc9ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:57.812670 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291038c-1d28-483b-82b8-9f32881dc9ad service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:57.813003 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291038c-1d28-483b-82b8-9f32881dc9ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:57.813411 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291038c-1d28-483b-82b8-9f32881dc9ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:57.821047 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7291038c-1d28-483b-82b8-9f32881dc9ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:57.901243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e8bc4892f249399fd5675c504095ad', 'request_id': 'req-0a965390-ad58-48b5-a6cf-453992ba5f4c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:57.931280 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e8bc4892f249399fd5675c504095ad', 'request_id': 'req-0a965390-ad58-48b5-a6cf-453992ba5f4c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:57.942074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e8bc4892f249399fd5675c504095ad', 'request_id': 'req-0a965390-ad58-48b5-a6cf-453992ba5f4c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:57.951364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291038c-1d28-483b-82b8-9f32881dc9ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:57.952947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291038c-1d28-483b-82b8-9f32881dc9ad service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:57.963881 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 799/1591] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:00:57 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:00:57.965472 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d31de3-f5de-4b65-9ba1-9609cfa33b4a None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:57.965908 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d31de3-f5de-4b65-9ba1-9609cfa33b4a None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:57.966435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] The token cache is being invalidate because project 52e8bc4892f249399fd5675c504095ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:00:57.966604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d31de3-f5de-4b65-9ba1-9609cfa33b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:57.966968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:57.968711 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:57.973547 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 793/1592] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:00:57 2021] DELETE /identity/v3/projects/52e8bc4892f249399fd5675c504095ad => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:57.982561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:57.984611 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:57.987101 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-38d31de3-f5de-4b65-9ba1-9609cfa33b4a None None] MFA Rules not processed for user `d3421cf1bbb24423a2f24c4667adfdda`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:00:57.988537 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-38d31de3-f5de-4b65-9ba1-9609cfa33b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:58.122457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 800/1593] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Nov 8 11:00:57 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:00:58.157482 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a965390-ad58-48b5-a6cf-453992ba5f4c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:58.172115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d49df-d526-420d-81ba-1f9dfd572e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:58.173030 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d49df-d526-420d-81ba-1f9dfd572e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:58.173316 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d49df-d526-420d-81ba-1f9dfd572e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:58.173595 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d49df-d526-420d-81ba-1f9dfd572e23 admin admin] PATH_INFO: `/v3/users/dc00c3d3cd5247bfb021074fcd46389c` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:58.180158 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d49df-d526-420d-81ba-1f9dfd572e23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc00c3d3cd5247bfb021074fcd46389c)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:58.181515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING py.warnings [None req-971d49df-d526-420d-81ba-1f9dfd572e23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 11:00:58.181515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: warnings.warn(msg) Nov 08 11:00:58.181515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: Nov 08 11:00:58.182844 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d49df-d526-420d-81ba-1f9dfd572e23 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:58.195412 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d31de3-f5de-4b65-9ba1-9609cfa33b4a None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:58.197718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-38d31de3-f5de-4b65-9ba1-9609cfa33b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:00:58.362671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d31de3-f5de-4b65-9ba1-9609cfa33b4a None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:58.371529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031296da-4571-46dc-9818-a7dfa78ca9fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:58.372422 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031296da-4571-46dc-9818-a7dfa78ca9fb service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:58.373301 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031296da-4571-46dc-9818-a7dfa78ca9fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:58.373533 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031296da-4571-46dc-9818-a7dfa78ca9fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:58.377121 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-971d49df-d526-420d-81ba-1f9dfd572e23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc00c3d3cd5247bfb021074fcd46389c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:58.378374 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-971d49df-d526-420d-81ba-1f9dfd572e23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc00c3d3cd5247bfb021074fcd46389c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:58.387032 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031296da-4571-46dc-9818-a7dfa78ca9fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:58.390716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031296da-4571-46dc-9818-a7dfa78ca9fb service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:58.400487 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-971d49df-d526-420d-81ba-1f9dfd572e23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc00c3d3cd5247bfb021074fcd46389c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:58.401251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-971d49df-d526-420d-81ba-1f9dfd572e23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc00c3d3cd5247bfb021074fcd46389c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:58.424057 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 801/1594] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:00:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:00:58.437293 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-971d49df-d526-420d-81ba-1f9dfd572e23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc00c3d3cd5247bfb021074fcd46389c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:58.548306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 794/1595] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:00:57 2021] DELETE /identity/v3/users/dc00c3d3cd5247bfb021074fcd46389c => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:00:59.632470 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031296da-4571-46dc-9818-a7dfa78ca9fb service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:00:59.653462 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031296da-4571-46dc-9818-a7dfa78ca9fb service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:00:59.831010 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b4e78-3613-4d45-b072-c98abddc2649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:00:59.832176 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b4e78-3613-4d45-b072-c98abddc2649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:00:59.832678 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b4e78-3613-4d45-b072-c98abddc2649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:00:59.833175 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b4e78-3613-4d45-b072-c98abddc2649 admin admin] PATH_INFO: `/v3/projects/9b003f9b99eb41f78d330cb823dc2e96` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:00:59.835292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b4e78-3613-4d45-b072-c98abddc2649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b003f9b99eb41f78d330cb823dc2e96)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:00:59.836826 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING py.warnings [None req-821b4e78-3613-4d45-b072-c98abddc2649 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 08 11:00:59.836826 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: warnings.warn(msg) Nov 08 11:00:59.836826 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: Nov 08 11:00:59.838484 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b4e78-3613-4d45-b072-c98abddc2649 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:00:59.966313 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-821b4e78-3613-4d45-b072-c98abddc2649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b003f9b99eb41f78d330cb823dc2e96', 'request_id': 'req-821b4e78-3613-4d45-b072-c98abddc2649'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:00:59.982480 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-821b4e78-3613-4d45-b072-c98abddc2649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b003f9b99eb41f78d330cb823dc2e96', 'request_id': 'req-821b4e78-3613-4d45-b072-c98abddc2649'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:00.000297 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-821b4e78-3613-4d45-b072-c98abddc2649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b003f9b99eb41f78d330cb823dc2e96', 'request_id': 'req-821b4e78-3613-4d45-b072-c98abddc2649'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:00.023818 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-821b4e78-3613-4d45-b072-c98abddc2649 admin admin] The token cache is being invalidate because project 9b003f9b99eb41f78d330cb823dc2e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:00.024107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-821b4e78-3613-4d45-b072-c98abddc2649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:00.026851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-821b4e78-3613-4d45-b072-c98abddc2649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:00.028698 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 802/1596] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:00:59 2021] DELETE /identity/v3/projects/9b003f9b99eb41f78d330cb823dc2e96 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:00.034628 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27d79-5e30-43cc-b920-7d75e106d6fa None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:00.035234 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27d79-5e30-43cc-b920-7d75e106d6fa None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:00.035465 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27d79-5e30-43cc-b920-7d75e106d6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:00.056320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-30a27d79-5e30-43cc-b920-7d75e106d6fa None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:00.057609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-30a27d79-5e30-43cc-b920-7d75e106d6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:00.133355 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 795/1597] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:00.141764 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c61a43-12a3-47ad-a66c-b5dd354f0446 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:00.142183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c61a43-12a3-47ad-a66c-b5dd354f0446 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:00.143038 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c61a43-12a3-47ad-a66c-b5dd354f0446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:00.195249 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-b7c61a43-12a3-47ad-a66c-b5dd354f0446 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:00.198229 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b7c61a43-12a3-47ad-a66c-b5dd354f0446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:00.220045 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 803/1598] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:00.224309 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a27d79-5e30-43cc-b920-7d75e106d6fa None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:00.238024 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a27d79-5e30-43cc-b920-7d75e106d6fa None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:00.246286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c6b07-237d-4dad-a71b-4160865209c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:00.247090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c6b07-237d-4dad-a71b-4160865209c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:00.247406 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c6b07-237d-4dad-a71b-4160865209c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:00.250254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c6b07-237d-4dad-a71b-4160865209c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:00.252017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c6b07-237d-4dad-a71b-4160865209c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:00.252338 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c6b07-237d-4dad-a71b-4160865209c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:00.257199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c6b07-237d-4dad-a71b-4160865209c0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:00.294201 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 796/1599] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:00.298804 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c61a43-12a3-47ad-a66c-b5dd354f0446 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:00.318845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c61a43-12a3-47ad-a66c-b5dd354f0446 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:00.336386 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3388a-4629-40f2-8ab9-38207bf4ba74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:00.338307 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3388a-4629-40f2-8ab9-38207bf4ba74 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:00.340271 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3388a-4629-40f2-8ab9-38207bf4ba74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:00.343028 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3388a-4629-40f2-8ab9-38207bf4ba74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:00.343584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3388a-4629-40f2-8ab9-38207bf4ba74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:00.345581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3388a-4629-40f2-8ab9-38207bf4ba74 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:00.400433 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 804/1600] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:00 2021] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:00.404266 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c6b07-237d-4dad-a71b-4160865209c0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:00.419922 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c6b07-237d-4dad-a71b-4160865209c0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:00.539374 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b604d29-fbb3-44e5-ab2c-a59f48e72404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:00.540199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604d29-fbb3-44e5-ab2c-a59f48e72404 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:00.540493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604d29-fbb3-44e5-ab2c-a59f48e72404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:00.540762 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604d29-fbb3-44e5-ab2c-a59f48e72404 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:00.541486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b604d29-fbb3-44e5-ab2c-a59f48e72404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:00.543443 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b604d29-fbb3-44e5-ab2c-a59f48e72404 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:00.599964 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 797/1601] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:00 2021] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:00.601212 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3388a-4629-40f2-8ab9-38207bf4ba74 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:00.621047 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3388a-4629-40f2-8ab9-38207bf4ba74 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:00.631756 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef2f58-dae0-4265-8b99-b55fa18766aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:00.646277 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2f58-dae0-4265-8b99-b55fa18766aa admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:00.652796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2f58-dae0-4265-8b99-b55fa18766aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:00.662445 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2f58-dae0-4265-8b99-b55fa18766aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:00.665433 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef2f58-dae0-4265-8b99-b55fa18766aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:00.689190 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef2f58-dae0-4265-8b99-b55fa18766aa admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:00.727425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 805/1602] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:00 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:00.728739 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b604d29-fbb3-44e5-ab2c-a59f48e72404 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:00.742742 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b604d29-fbb3-44e5-ab2c-a59f48e72404 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:00.759874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bf476-cdd1-455d-85f7-3894225bce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:00.759874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bf476-cdd1-455d-85f7-3894225bce0c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:00.759874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bf476-cdd1-455d-85f7-3894225bce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:00.759874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bf476-cdd1-455d-85f7-3894225bce0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:00.760301 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bf476-cdd1-455d-85f7-3894225bce0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:00.760414 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bf476-cdd1-455d-85f7-3894225bce0c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:00.790714 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff2cfc-e74d-4553-bea0-a849f96c1821 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:00.791013 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff2cfc-e74d-4553-bea0-a849f96c1821 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:00.791334 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff2cfc-e74d-4553-bea0-a849f96c1821 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:00.793467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 806/1603] 10.222.0.20 () {54 vars in 960 bytes} [Mon Nov 8 11:01:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 11:01:00.801757 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ef32f-11d5-4aa8-a598-889f84a4507b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:00.802310 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ef32f-11d5-4aa8-a598-889f84a4507b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:00.802765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ef32f-11d5-4aa8-a598-889f84a4507b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:00.809180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 798/1604] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:00 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:00.830069 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bf476-cdd1-455d-85f7-3894225bce0c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:00.845422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bf476-cdd1-455d-85f7-3894225bce0c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:00.854931 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ae58d-5773-4044-8f5b-a568aeed2c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:00.857378 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ae58d-5773-4044-8f5b-a568aeed2c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:00.857655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ae58d-5773-4044-8f5b-a568aeed2c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:00.857931 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ae58d-5773-4044-8f5b-a568aeed2c7b admin admin] PATH_INFO: `/v3/projects/aac8ef5b866d4fb0940bde3f28b69e5d/users/7fe3ca5065164b3d9ad0c4f710e357c2/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:00.861357 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-a28ef32f-11d5-4aa8-a598-889f84a4507b None None] MFA Rules not processed for user `d3421cf1bbb24423a2f24c4667adfdda`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:00.870081 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a28ef32f-11d5-4aa8-a598-889f84a4507b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:00.891525 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ae58d-5773-4044-8f5b-a568aeed2c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac8ef5b866d4fb0940bde3f28b69e5d, user_id=7fe3ca5065164b3d9ad0c4f710e357c2, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:00.894944 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ae58d-5773-4044-8f5b-a568aeed2c7b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:00.942895 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 799/1605] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:00 2021] PUT /identity/v3/projects/aac8ef5b866d4fb0940bde3f28b69e5d/users/7fe3ca5065164b3d9ad0c4f710e357c2/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:00.945507 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93733d-c81c-43ae-82a3-3621189b657d None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:00.947731 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93733d-c81c-43ae-82a3-3621189b657d None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:00.948172 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93733d-c81c-43ae-82a3-3621189b657d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:01.028053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-de93733d-c81c-43ae-82a3-3621189b657d None None] MFA Rules not processed for user `4f95dd5d1b47415e830d6fa518d56766`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:01.030732 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-de93733d-c81c-43ae-82a3-3621189b657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:01.084177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 807/1606] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Nov 8 11:01:00 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:01.085821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006e8f2-7fc3-41bf-b388-f87cb3266d4d None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:01.086848 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006e8f2-7fc3-41bf-b388-f87cb3266d4d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:01.087945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006e8f2-7fc3-41bf-b388-f87cb3266d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:01.136722 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-4006e8f2-7fc3-41bf-b388-f87cb3266d4d None None] MFA Rules not processed for user `7fe3ca5065164b3d9ad0c4f710e357c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:01.138698 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4006e8f2-7fc3-41bf-b388-f87cb3266d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:01.198459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 800/1607] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:00 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:01.198459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93733d-c81c-43ae-82a3-3621189b657d None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:01.198459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-de93733d-c81c-43ae-82a3-3621189b657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:01.267628 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 808/1608] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:01 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:01.270947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18feecc-ce8b-4a31-88c9-b25d10cf3a15 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:01.273362 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18feecc-ce8b-4a31-88c9-b25d10cf3a15 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:01.273655 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18feecc-ce8b-4a31-88c9-b25d10cf3a15 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:01.275941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 809/1609] 10.222.0.20 () {54 vars in 912 bytes} [Mon Nov 8 11:01:01 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 11:01:01.288520 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aeb9a2-4da9-4a43-adb1-c18278337370 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:01.289452 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aeb9a2-4da9-4a43-adb1-c18278337370 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:01.290233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aeb9a2-4da9-4a43-adb1-c18278337370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:01.312853 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93733d-c81c-43ae-82a3-3621189b657d None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:01.315252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-49aeb9a2-4da9-4a43-adb1-c18278337370 None None] MFA Rules not processed for user `4f95dd5d1b47415e830d6fa518d56766`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:01.317938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-49aeb9a2-4da9-4a43-adb1-c18278337370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:01.326602 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56270170-41d1-48a9-a306-6f84c9e12731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:01.329840 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56270170-41d1-48a9-a306-6f84c9e12731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:01.331485 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56270170-41d1-48a9-a306-6f84c9e12731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:01.332047 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56270170-41d1-48a9-a306-6f84c9e12731 admin admin] PATH_INFO: `/v3/users/435e41436b5749919eb106fe40355a25` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:01.336086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56270170-41d1-48a9-a306-6f84c9e12731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435e41436b5749919eb106fe40355a25)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:01.338816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 810/1610] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:01 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:01.339703 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56270170-41d1-48a9-a306-6f84c9e12731 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:01.339968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aeb9a2-4da9-4a43-adb1-c18278337370 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:01.372352 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aeb9a2-4da9-4a43-adb1-c18278337370 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:01.384702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d2c95-d0f2-40fa-a07e-aa8b515b0aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:01.385452 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d2c95-d0f2-40fa-a07e-aa8b515b0aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:01.385648 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d2c95-d0f2-40fa-a07e-aa8b515b0aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:01.385922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d2c95-d0f2-40fa-a07e-aa8b515b0aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:01.386795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d2c95-d0f2-40fa-a07e-aa8b515b0aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:01.398197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d2c95-d0f2-40fa-a07e-aa8b515b0aa9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:01.435631 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-56270170-41d1-48a9-a306-6f84c9e12731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435e41436b5749919eb106fe40355a25'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:01.437398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-56270170-41d1-48a9-a306-6f84c9e12731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435e41436b5749919eb106fe40355a25'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:01.462847 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-56270170-41d1-48a9-a306-6f84c9e12731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435e41436b5749919eb106fe40355a25'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:01.464670 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-56270170-41d1-48a9-a306-6f84c9e12731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435e41436b5749919eb106fe40355a25'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:01.478894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 811/1611] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:01 2021] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:01.478894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c42533-e0eb-4253-b68c-88f847bcd959 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:01.478894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c42533-e0eb-4253-b68c-88f847bcd959 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:01.479333 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c42533-e0eb-4253-b68c-88f847bcd959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:01.480790 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-56270170-41d1-48a9-a306-6f84c9e12731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435e41436b5749919eb106fe40355a25'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:01.506766 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-83c42533-e0eb-4253-b68c-88f847bcd959 None None] MFA Rules not processed for user `d3421cf1bbb24423a2f24c4667adfdda`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:01.509015 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-83c42533-e0eb-4253-b68c-88f847bcd959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:01.533412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 801/1612] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:01 2021] DELETE /identity/v3/users/435e41436b5749919eb106fe40355a25 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:01.534497 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56270170-41d1-48a9-a306-6f84c9e12731 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:01.540547 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-56270170-41d1-48a9-a306-6f84c9e12731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:01.708942 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 812/1613] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Nov 8 11:01:01 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:01.716953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c42533-e0eb-4253-b68c-88f847bcd959 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:01.721524 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56270170-41d1-48a9-a306-6f84c9e12731 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:01.721999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-83c42533-e0eb-4253-b68c-88f847bcd959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:01.730519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1e70c-67d7-4ef6-a197-24a17fa0e8b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:01.731621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1e70c-67d7-4ef6-a197-24a17fa0e8b7 service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:01.732096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1e70c-67d7-4ef6-a197-24a17fa0e8b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:01.732583 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1e70c-67d7-4ef6-a197-24a17fa0e8b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:01.734693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9ed1e70c-67d7-4ef6-a197-24a17fa0e8b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:01.883614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1e70c-67d7-4ef6-a197-24a17fa0e8b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:01.885835 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1e70c-67d7-4ef6-a197-24a17fa0e8b7 service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:01.916668 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 802/1614] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:01 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:01.918561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0f6e2-3900-4380-99c0-756504d271b8 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:01.921384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0f6e2-3900-4380-99c0-756504d271b8 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:01.921854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0f6e2-3900-4380-99c0-756504d271b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:01.941497 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c42533-e0eb-4253-b68c-88f847bcd959 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:01.972064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-83c0f6e2-3900-4380-99c0-756504d271b8 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:01.975165 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-83c0f6e2-3900-4380-99c0-756504d271b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:02.158920 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da0d4d-4d97-4123-ba79-033afdf28175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:02.159659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da0d4d-4d97-4123-ba79-033afdf28175 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:02.159933 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da0d4d-4d97-4123-ba79-033afdf28175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:02.160216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da0d4d-4d97-4123-ba79-033afdf28175 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:02.163217 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 803/1615] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:02.163392 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da0d4d-4d97-4123-ba79-033afdf28175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:02.163496 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0f6e2-3900-4380-99c0-756504d271b8 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:02.166498 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da0d4d-4d97-4123-ba79-033afdf28175 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:02.166658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-83c0f6e2-3900-4380-99c0-756504d271b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:02.250412 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 813/1616] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:01 2021] POST /identity/v3/users => generated 294 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:02.264656 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da0d4d-4d97-4123-ba79-033afdf28175 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:02.300859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da0d4d-4d97-4123-ba79-033afdf28175 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:02.335157 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f48dc6-46f2-432a-8c45-e8fd4c3133aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:02.336008 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48dc6-46f2-432a-8c45-e8fd4c3133aa admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:02.336289 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48dc6-46f2-432a-8c45-e8fd4c3133aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:02.336560 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48dc6-46f2-432a-8c45-e8fd4c3133aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:02.337330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f48dc6-46f2-432a-8c45-e8fd4c3133aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:02.339078 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f48dc6-46f2-432a-8c45-e8fd4c3133aa admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:02.386644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 814/1617] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:02 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:02.388177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f48dc6-46f2-432a-8c45-e8fd4c3133aa admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:02.396242 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-60f48dc6-46f2-432a-8c45-e8fd4c3133aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:02.397449 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0f6e2-3900-4380-99c0-756504d271b8 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:02.411987 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4a347-ae5c-4477-b1f2-bc6f5754fbed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:02.412834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4a347-ae5c-4477-b1f2-bc6f5754fbed service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:02.413268 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4a347-ae5c-4477-b1f2-bc6f5754fbed service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:02.413553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4a347-ae5c-4477-b1f2-bc6f5754fbed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:02.437480 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4a347-ae5c-4477-b1f2-bc6f5754fbed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:02.442904 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4a347-ae5c-4477-b1f2-bc6f5754fbed service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:02.476656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 804/1618] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:02 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:02.477959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4a347-ae5c-4477-b1f2-bc6f5754fbed service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:02.492423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4a347-ae5c-4477-b1f2-bc6f5754fbed service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:02.500132 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743bda1-231c-4bd3-878f-d8dc736e33b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:02.501192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743bda1-231c-4bd3-878f-d8dc736e33b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:02.502297 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743bda1-231c-4bd3-878f-d8dc736e33b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:02.502582 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743bda1-231c-4bd3-878f-d8dc736e33b6 admin admin] PATH_INFO: `/v3/projects/90cd161081f24b6eb1b75829badda48f/users/1e3f3467248845ff96e964cee25284f3/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:02.524694 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f48dc6-46f2-432a-8c45-e8fd4c3133aa admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:02.530565 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743bda1-231c-4bd3-878f-d8dc736e33b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90cd161081f24b6eb1b75829badda48f, user_id=1e3f3467248845ff96e964cee25284f3, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:02.536254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743bda1-231c-4bd3-878f-d8dc736e33b6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:02.540035 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b57fbc-9d4b-4b01-9a5a-add3b2da4f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:02.541407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b57fbc-9d4b-4b01-9a5a-add3b2da4f0b service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:02.542920 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b57fbc-9d4b-4b01-9a5a-add3b2da4f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:02.546708 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b57fbc-9d4b-4b01-9a5a-add3b2da4f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:02.559031 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 805/1619] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:02 2021] PUT /identity/v3/projects/90cd161081f24b6eb1b75829badda48f/users/1e3f3467248845ff96e964cee25284f3/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:02.575593 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743bda1-231c-4bd3-878f-d8dc736e33b6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:02.588831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b57fbc-9d4b-4b01-9a5a-add3b2da4f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:02.595697 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b57fbc-9d4b-4b01-9a5a-add3b2da4f0b service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:02.628841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 815/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:02.663662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b57fbc-9d4b-4b01-9a5a-add3b2da4f0b service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:02.665294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a7b57fbc-9d4b-4b01-9a5a-add3b2da4f0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:02.690677 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b57fbc-9d4b-4b01-9a5a-add3b2da4f0b service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:02.705707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743bda1-231c-4bd3-878f-d8dc736e33b6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:02.714141 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b78ebb-0b80-4e27-8e45-ea3493845aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:02.714930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b78ebb-0b80-4e27-8e45-ea3493845aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:02.715853 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b78ebb-0b80-4e27-8e45-ea3493845aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:02.716138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b78ebb-0b80-4e27-8e45-ea3493845aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:02.716908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b78ebb-0b80-4e27-8e45-ea3493845aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:02.721124 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b78ebb-0b80-4e27-8e45-ea3493845aa0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:02.736562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 806/1621] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:02 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:02.741837 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b78ebb-0b80-4e27-8e45-ea3493845aa0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:02.773325 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b78ebb-0b80-4e27-8e45-ea3493845aa0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:02.788255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675cdd7-5aba-471a-904d-9f98aacf6138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:02.790765 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675cdd7-5aba-471a-904d-9f98aacf6138 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:02.791825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675cdd7-5aba-471a-904d-9f98aacf6138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:02.792536 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675cdd7-5aba-471a-904d-9f98aacf6138 admin admin] PATH_INFO: `/v3/projects/90cd161081f24b6eb1b75829badda48f/users/1e3f3467248845ff96e964cee25284f3/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:02.811732 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675cdd7-5aba-471a-904d-9f98aacf6138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90cd161081f24b6eb1b75829badda48f, user_id=1e3f3467248845ff96e964cee25284f3, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:02.813872 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6044c-e07a-40e7-87e8-91921328e77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:02.817141 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675cdd7-5aba-471a-904d-9f98aacf6138 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:02.817769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6044c-e07a-40e7-87e8-91921328e77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:02.818153 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6044c-e07a-40e7-87e8-91921328e77c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:02.818525 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6044c-e07a-40e7-87e8-91921328e77c admin admin] PATH_INFO: `/v3/users/42ceeb5939b34fe8bb7457ff67a4fbc4` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:02.821609 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6044c-e07a-40e7-87e8-91921328e77c admin admin] RBAC: Authorizing `identity:delete_user(user_id=42ceeb5939b34fe8bb7457ff67a4fbc4)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:02.826272 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6044c-e07a-40e7-87e8-91921328e77c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:02.864280 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 807/1622] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:02 2021] PUT /identity/v3/projects/90cd161081f24b6eb1b75829badda48f/users/1e3f3467248845ff96e964cee25284f3/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:02.915787 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73380b90-5c0e-4d96-8d23-fda3a8905198 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:02.917586 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73380b90-5c0e-4d96-8d23-fda3a8905198 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:02.917969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73380b90-5c0e-4d96-8d23-fda3a8905198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:02.980557 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-90c6044c-e07a-40e7-87e8-91921328e77c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42ceeb5939b34fe8bb7457ff67a4fbc4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:02.982082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-90c6044c-e07a-40e7-87e8-91921328e77c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42ceeb5939b34fe8bb7457ff67a4fbc4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:02.989537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-73380b90-5c0e-4d96-8d23-fda3a8905198 None None] MFA Rules not processed for user `1e3f3467248845ff96e964cee25284f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:02.992890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-73380b90-5c0e-4d96-8d23-fda3a8905198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:03.004964 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-90c6044c-e07a-40e7-87e8-91921328e77c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42ceeb5939b34fe8bb7457ff67a4fbc4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:03.005797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-90c6044c-e07a-40e7-87e8-91921328e77c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42ceeb5939b34fe8bb7457ff67a4fbc4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:03.045349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-90c6044c-e07a-40e7-87e8-91921328e77c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42ceeb5939b34fe8bb7457ff67a4fbc4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:03.110688 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 816/1623] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:02 2021] DELETE /identity/v3/users/42ceeb5939b34fe8bb7457ff67a4fbc4 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:03.113782 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a91ea-cf02-4740-9f0a-87b83a9cc152 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:03.114130 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a91ea-cf02-4740-9f0a-87b83a9cc152 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:03.114837 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a91ea-cf02-4740-9f0a-87b83a9cc152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:03.167291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-811a91ea-cf02-4740-9f0a-87b83a9cc152 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:03.171864 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-811a91ea-cf02-4740-9f0a-87b83a9cc152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:03.256502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 808/1624] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:02 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:03.272678 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73380b90-5c0e-4d96-8d23-fda3a8905198 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:03.274954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-73380b90-5c0e-4d96-8d23-fda3a8905198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:03.365977 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 817/1625] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:03.377845 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73380b90-5c0e-4d96-8d23-fda3a8905198 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:03.386639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a91ea-cf02-4740-9f0a-87b83a9cc152 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:03.389312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-811a91ea-cf02-4740-9f0a-87b83a9cc152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:03.473610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9a6df-be3e-46e2-a77b-94562366b45f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:03.473610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9a6df-be3e-46e2-a77b-94562366b45f service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:03.473610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9a6df-be3e-46e2-a77b-94562366b45f service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:03.473610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9a6df-be3e-46e2-a77b-94562366b45f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:03.476504 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5da9a6df-be3e-46e2-a77b-94562366b45f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:03.511355 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a91ea-cf02-4740-9f0a-87b83a9cc152 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:03.521444 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4a202-9da6-4315-a8e5-a2aea050e019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:03.522129 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4a202-9da6-4315-a8e5-a2aea050e019 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:03.522420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4a202-9da6-4315-a8e5-a2aea050e019 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:03.522872 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4a202-9da6-4315-a8e5-a2aea050e019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:03.559072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4a202-9da6-4315-a8e5-a2aea050e019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:03.560712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4a202-9da6-4315-a8e5-a2aea050e019 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:03.579611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 818/1626] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:01:03.583761 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9a6df-be3e-46e2-a77b-94562366b45f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:03.586167 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9a6df-be3e-46e2-a77b-94562366b45f service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:03.602299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 809/1627] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:03 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:01:03.639842 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b3454-f5ab-4f4e-bc45-5e21c15f750a None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:03.640120 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b3454-f5ab-4f4e-bc45-5e21c15f750a None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:03.640397 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b3454-f5ab-4f4e-bc45-5e21c15f750a None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:03.642596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 819/1628] 10.222.0.20 () {54 vars in 912 bytes} [Mon Nov 8 11:01:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 11:01:03.654302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ab56b-47bd-4288-882a-59a287c96a94 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:03.654949 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ab56b-47bd-4288-882a-59a287c96a94 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:03.655272 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ab56b-47bd-4288-882a-59a287c96a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:03.764898 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-d17ab56b-47bd-4288-882a-59a287c96a94 None None] MFA Rules not processed for user `0e134083351e4493b2a05bea95233f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:03.771317 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d17ab56b-47bd-4288-882a-59a287c96a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:03.799428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 810/1629] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Nov 8 11:01:03 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:03.813243 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b3454-f5ab-4f4e-bc45-5e21c15f750a None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:03.815320 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ea9b3454-f5ab-4f4e-bc45-5e21c15f750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:03.840137 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b3454-f5ab-4f4e-bc45-5e21c15f750a None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:03.853583 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790cac4-493e-41fa-9107-72c7db4623be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:03.854258 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790cac4-493e-41fa-9107-72c7db4623be service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:03.854545 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790cac4-493e-41fa-9107-72c7db4623be service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:03.854831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790cac4-493e-41fa-9107-72c7db4623be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:03.872538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790cac4-493e-41fa-9107-72c7db4623be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:03.874018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790cac4-493e-41fa-9107-72c7db4623be service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:03.883083 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 820/1630] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:03 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:04.631018 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ab56b-47bd-4288-882a-59a287c96a94 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:04.633157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d17ab56b-47bd-4288-882a-59a287c96a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:04.660282 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ab56b-47bd-4288-882a-59a287c96a94 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:04.671214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:04.672233 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:04.672769 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:04.673137 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] PATH_INFO: `/v3/projects/8104285dcc5e40e38b326bce5751bfb0` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:04.677778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8104285dcc5e40e38b326bce5751bfb0)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:04.680209 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:04.850414 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8104285dcc5e40e38b326bce5751bfb0', 'request_id': 'req-c4ca6e00-0e21-47ca-a994-94af56106ca2'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:04.874969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8104285dcc5e40e38b326bce5751bfb0', 'request_id': 'req-c4ca6e00-0e21-47ca-a994-94af56106ca2'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:04.910780 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790cac4-493e-41fa-9107-72c7db4623be service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:04.913720 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8104285dcc5e40e38b326bce5751bfb0', 'request_id': 'req-c4ca6e00-0e21-47ca-a994-94af56106ca2'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:04.914694 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-2790cac4-493e-41fa-9107-72c7db4623be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:04.940003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] The token cache is being invalidate because project 8104285dcc5e40e38b326bce5751bfb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:04.940254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:04.941972 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:04.944100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 811/1631] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:04 2021] DELETE /identity/v3/projects/8104285dcc5e40e38b326bce5751bfb0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:04.947700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:04.952223 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:04.953617 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790cac4-493e-41fa-9107-72c7db4623be service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:05.079363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca6e00-0e21-47ca-a994-94af56106ca2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:05.089047 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607a01c-78e1-443a-9269-2276119a1a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:05.091230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607a01c-78e1-443a-9269-2276119a1a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:05.091545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607a01c-78e1-443a-9269-2276119a1a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:05.091823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607a01c-78e1-443a-9269-2276119a1a26 admin admin] PATH_INFO: `/v3/users/e3752f7e2a2d478cb6259c1aca861e62` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:05.094288 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607a01c-78e1-443a-9269-2276119a1a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3752f7e2a2d478cb6259c1aca861e62)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:05.101332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607a01c-78e1-443a-9269-2276119a1a26 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:05.110298 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3dc32-0512-4f2c-8e96-290389faffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:05.111523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3dc32-0512-4f2c-8e96-290389faffb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:05.113552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3dc32-0512-4f2c-8e96-290389faffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:05.115817 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3dc32-0512-4f2c-8e96-290389faffb3 admin admin] PATH_INFO: `/v3/projects/236b45bfe3d24be58e0702d292294977` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:05.120089 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3dc32-0512-4f2c-8e96-290389faffb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=236b45bfe3d24be58e0702d292294977)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:05.124781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3dc32-0512-4f2c-8e96-290389faffb3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:05.205731 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6607a01c-78e1-443a-9269-2276119a1a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3752f7e2a2d478cb6259c1aca861e62'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.206973 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6607a01c-78e1-443a-9269-2276119a1a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3752f7e2a2d478cb6259c1aca861e62'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.230556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6607a01c-78e1-443a-9269-2276119a1a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3752f7e2a2d478cb6259c1aca861e62'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.231521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6607a01c-78e1-443a-9269-2276119a1a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3752f7e2a2d478cb6259c1aca861e62'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.248888 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6607a01c-78e1-443a-9269-2276119a1a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3752f7e2a2d478cb6259c1aca861e62'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.256203 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-3fd3dc32-0512-4f2c-8e96-290389faffb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236b45bfe3d24be58e0702d292294977', 'request_id': 'req-3fd3dc32-0512-4f2c-8e96-290389faffb3'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.278156 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-3fd3dc32-0512-4f2c-8e96-290389faffb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236b45bfe3d24be58e0702d292294977', 'request_id': 'req-3fd3dc32-0512-4f2c-8e96-290389faffb3'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.310816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-3fd3dc32-0512-4f2c-8e96-290389faffb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236b45bfe3d24be58e0702d292294977', 'request_id': 'req-3fd3dc32-0512-4f2c-8e96-290389faffb3'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.315117 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 812/1632] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:04 2021] DELETE /identity/v3/users/e3752f7e2a2d478cb6259c1aca861e62 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:05.335536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-3fd3dc32-0512-4f2c-8e96-290389faffb3 admin admin] The token cache is being invalidate because project 236b45bfe3d24be58e0702d292294977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:05.336079 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-3fd3dc32-0512-4f2c-8e96-290389faffb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.347698 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-3fd3dc32-0512-4f2c-8e96-290389faffb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.350421 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 821/1633] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:04 2021] DELETE /identity/v3/projects/236b45bfe3d24be58e0702d292294977 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:05.354956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607a01c-78e1-443a-9269-2276119a1a26 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:05.356751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6607a01c-78e1-443a-9269-2276119a1a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:05.501577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607a01c-78e1-443a-9269-2276119a1a26 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:05.520498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3c5f6-a968-4fb1-91b3-588f42131973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:05.521414 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3c5f6-a968-4fb1-91b3-588f42131973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:05.521699 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3c5f6-a968-4fb1-91b3-588f42131973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:05.521979 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3c5f6-a968-4fb1-91b3-588f42131973 admin admin] PATH_INFO: `/v3/users/297a28bae4c641c499294f5314e97516` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:05.526095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3c5f6-a968-4fb1-91b3-588f42131973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=297a28bae4c641c499294f5314e97516)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:05.528196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3c5f6-a968-4fb1-91b3-588f42131973 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:05.668162 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-60e3c5f6-a968-4fb1-91b3-588f42131973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297a28bae4c641c499294f5314e97516'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.673649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-60e3c5f6-a968-4fb1-91b3-588f42131973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297a28bae4c641c499294f5314e97516'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.693783 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-60e3c5f6-a968-4fb1-91b3-588f42131973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297a28bae4c641c499294f5314e97516'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.703431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-60e3c5f6-a968-4fb1-91b3-588f42131973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297a28bae4c641c499294f5314e97516'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.716247 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-60e3c5f6-a968-4fb1-91b3-588f42131973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297a28bae4c641c499294f5314e97516'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:05.750159 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 813/1634] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:05 2021] DELETE /identity/v3/users/297a28bae4c641c499294f5314e97516 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:06.000062 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bb1b7-3b6d-4cd4-8450-b308eb581054 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:06.000555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bb1b7-3b6d-4cd4-8450-b308eb581054 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:06.000770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bb1b7-3b6d-4cd4-8450-b308eb581054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:06.045574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-0c8bb1b7-3b6d-4cd4-8450-b308eb581054 None None] MFA Rules not processed for user `fd75fa7d42a5418e87ebc4176e5a2790`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:06.047704 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0c8bb1b7-3b6d-4cd4-8450-b308eb581054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:06.144774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e3167-4059-476c-9375-6ea2433ad55f None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:06.145063 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e3167-4059-476c-9375-6ea2433ad55f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:06.145341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e3167-4059-476c-9375-6ea2433ad55f None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:06.147391 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 814/1635] 10.222.0.20 () {54 vars in 960 bytes} [Mon Nov 8 11:01:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 11:01:06.163639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4e2bb-2f1b-414a-a3aa-c433654176d8 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:06.163930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4e2bb-2f1b-414a-a3aa-c433654176d8 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:06.164214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4e2bb-2f1b-414a-a3aa-c433654176d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:06.212273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-cfc4e2bb-2f1b-414a-a3aa-c433654176d8 None None] MFA Rules not processed for user `642c2b97ece34d69bacd821b108bd210`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:06.219948 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-cfc4e2bb-2f1b-414a-a3aa-c433654176d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:06.292408 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 822/1636] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:05 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:06.307808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bb1b7-3b6d-4cd4-8450-b308eb581054 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:06.307808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0c8bb1b7-3b6d-4cd4-8450-b308eb581054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:06.449654 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 815/1637] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Nov 8 11:01:06 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Nov 08 11:01:06.472889 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4e2bb-2f1b-414a-a3aa-c433654176d8 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:06.474707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-cfc4e2bb-2f1b-414a-a3aa-c433654176d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:06.514904 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bb1b7-3b6d-4cd4-8450-b308eb581054 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:06.521992 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a23ef-b78f-4511-911e-f44ade5ba2b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:06.523094 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a23ef-b78f-4511-911e-f44ade5ba2b0 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:06.523741 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a23ef-b78f-4511-911e-f44ade5ba2b0 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:06.524201 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a23ef-b78f-4511-911e-f44ade5ba2b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:06.535592 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a23ef-b78f-4511-911e-f44ade5ba2b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:06.538186 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a23ef-b78f-4511-911e-f44ade5ba2b0 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:06.552447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 823/1638] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:06 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:06.553643 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a23ef-b78f-4511-911e-f44ade5ba2b0 service nova] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:06.570354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a23ef-b78f-4511-911e-f44ade5ba2b0 service nova] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:06.577312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d880476-20d5-4d94-a96e-9fa33d9cc599 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '642c2b97ece34d69bacd821b108bd210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:06.578689 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d880476-20d5-4d94-a96e-9fa33d9cc599 service placement] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:06.579274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d880476-20d5-4d94-a96e-9fa33d9cc599 service placement] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:06.579710 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d880476-20d5-4d94-a96e-9fa33d9cc599 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:06.582363 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4d880476-20d5-4d94-a96e-9fa33d9cc599 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:06.598032 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d880476-20d5-4d94-a96e-9fa33d9cc599 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:06.600288 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d880476-20d5-4d94-a96e-9fa33d9cc599 service placement] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:06.628156 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 824/1639] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:06 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:06.642010 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4e2bb-2f1b-414a-a3aa-c433654176d8 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:06.658965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:06.660073 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:06.660522 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:06.660848 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672 admin admin] PATH_INFO: `/v3/projects/77431efffc2f4a0592c6a553a8631808` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:06.663761 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77431efffc2f4a0592c6a553a8631808)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:06.668348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:06.776352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77431efffc2f4a0592c6a553a8631808', 'request_id': 'req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:06.789828 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77431efffc2f4a0592c6a553a8631808', 'request_id': 'req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:06.800737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77431efffc2f4a0592c6a553a8631808', 'request_id': 'req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:06.821181 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672 admin admin] The token cache is being invalidate because project 77431efffc2f4a0592c6a553a8631808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:06.821575 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:06.822420 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1544b3c2-6c9a-46a2-99a3-bc5c6f443672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:06.826728 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 816/1640] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:06 2021] DELETE /identity/v3/projects/77431efffc2f4a0592c6a553a8631808 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:06.832205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e712459-183c-48c3-bc4e-11ad7d08e88b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:06.832826 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e712459-183c-48c3-bc4e-11ad7d08e88b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:06.833273 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e712459-183c-48c3-bc4e-11ad7d08e88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:06.888362 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-5e712459-183c-48c3-bc4e-11ad7d08e88b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:06.897252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-5e712459-183c-48c3-bc4e-11ad7d08e88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:07.089709 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 825/1641] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:07.097882 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa07d7a-406f-490e-9025-f4b0f3246218 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:07.098586 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa07d7a-406f-490e-9025-f4b0f3246218 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:07.099076 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa07d7a-406f-490e-9025-f4b0f3246218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:07.126561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8fa07d7a-406f-490e-9025-f4b0f3246218 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:07.128817 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8fa07d7a-406f-490e-9025-f4b0f3246218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:07.142417 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 817/1642] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:07.146747 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e712459-183c-48c3-bc4e-11ad7d08e88b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:07.162686 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e712459-183c-48c3-bc4e-11ad7d08e88b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:07.169285 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3e13a-2cd8-4da8-8bb5-b55602cd1091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:07.169985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3e13a-2cd8-4da8-8bb5-b55602cd1091 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:07.170265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3e13a-2cd8-4da8-8bb5-b55602cd1091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:07.170539 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3e13a-2cd8-4da8-8bb5-b55602cd1091 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:07.171600 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3e13a-2cd8-4da8-8bb5-b55602cd1091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:07.172087 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3e13a-2cd8-4da8-8bb5-b55602cd1091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:07.174973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3e13a-2cd8-4da8-8bb5-b55602cd1091 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:07.192407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 826/1643] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:07.199166 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa07d7a-406f-490e-9025-f4b0f3246218 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:07.210451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa07d7a-406f-490e-9025-f4b0f3246218 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:07.241238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e4420-c042-42ec-86fe-a65c143af99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:07.243302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4420-c042-42ec-86fe-a65c143af99f admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:07.243826 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4420-c042-42ec-86fe-a65c143af99f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:07.244268 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4420-c042-42ec-86fe-a65c143af99f admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:07.246633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e4420-c042-42ec-86fe-a65c143af99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:07.248720 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e4420-c042-42ec-86fe-a65c143af99f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:07.296209 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 818/1644] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:07 2021] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:07.300810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3e13a-2cd8-4da8-8bb5-b55602cd1091 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:07.321736 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3e13a-2cd8-4da8-8bb5-b55602cd1091 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:07.552945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420eef77-3f35-43ff-8095-c5c01d5e11c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:07.553755 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eef77-3f35-43ff-8095-c5c01d5e11c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:07.554042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eef77-3f35-43ff-8095-c5c01d5e11c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:07.554316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eef77-3f35-43ff-8095-c5c01d5e11c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:07.555109 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420eef77-3f35-43ff-8095-c5c01d5e11c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:07.566504 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420eef77-3f35-43ff-8095-c5c01d5e11c1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:07.622307 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 827/1645] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:07 2021] POST /identity/v3/users => generated 291 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:07.627003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e4420-c042-42ec-86fe-a65c143af99f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:07.651034 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e4420-c042-42ec-86fe-a65c143af99f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:07.673829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a04f2d-1364-4086-a820-571f90d27d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:07.677641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a04f2d-1364-4086-a820-571f90d27d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:07.677954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a04f2d-1364-4086-a820-571f90d27d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:07.679377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a04f2d-1364-4086-a820-571f90d27d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:07.681368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a04f2d-1364-4086-a820-571f90d27d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:07.683883 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420eef77-3f35-43ff-8095-c5c01d5e11c1 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:07.686542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-420eef77-3f35-43ff-8095-c5c01d5e11c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:07.687365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a04f2d-1364-4086-a820-571f90d27d48 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:07.710938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420eef77-3f35-43ff-8095-c5c01d5e11c1 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:07.721696 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:07.722929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:07.723443 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:07.723874 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4 admin admin] PATH_INFO: `/v3/projects/40a4d5e963134cbeade626408196487b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:07.728969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a4d5e963134cbeade626408196487b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:07.729541 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 819/1646] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:07 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:07.732148 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:07.732409 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a04f2d-1364-4086-a820-571f90d27d48 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:07.766030 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a04f2d-1364-4086-a820-571f90d27d48 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:07.781466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb5afb-9953-4f74-bc34-38f4217d5711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:07.784275 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb5afb-9953-4f74-bc34-38f4217d5711 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:07.785537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb5afb-9953-4f74-bc34-38f4217d5711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:07.787015 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb5afb-9953-4f74-bc34-38f4217d5711 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:07.790053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb5afb-9953-4f74-bc34-38f4217d5711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:07.797920 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb5afb-9953-4f74-bc34-38f4217d5711 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:07.845917 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 820/1647] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:07 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:07.854427 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb5afb-9953-4f74-bc34-38f4217d5711 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:07.874143 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a4d5e963134cbeade626408196487b', 'request_id': 'req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:07.887730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a4d5e963134cbeade626408196487b', 'request_id': 'req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:07.899452 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb5afb-9953-4f74-bc34-38f4217d5711 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:07.915466 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a4d5e963134cbeade626408196487b', 'request_id': 'req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:07.936067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4 admin admin] The token cache is being invalidate because project 40a4d5e963134cbeade626408196487b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:07.936699 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:07.938118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f66bf7de-eb36-4dd8-a6d7-b597b5ccd5c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:07.947941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 828/1648] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:07 2021] DELETE /identity/v3/projects/40a4d5e963134cbeade626408196487b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:07.949895 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200946b2-3341-4249-a52f-44e4d4c1900a None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:07.950191 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200946b2-3341-4249-a52f-44e4d4c1900a None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:07.951098 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200946b2-3341-4249-a52f-44e4d4c1900a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:07.982859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-200946b2-3341-4249-a52f-44e4d4c1900a None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:07.984667 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-200946b2-3341-4249-a52f-44e4d4c1900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:08.080098 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 829/1649] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:08.090026 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8b656-4fc9-4fbe-ac99-f6307156983d None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:08.090795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8b656-4fc9-4fbe-ac99-f6307156983d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:08.090795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8b656-4fc9-4fbe-ac99-f6307156983d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:08.101141 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8dd9f-b7f9-4fbd-b111-a22d4146d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:08.102276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8dd9f-b7f9-4fbd-b111-a22d4146d342 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:08.102888 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8dd9f-b7f9-4fbd-b111-a22d4146d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:08.103541 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8dd9f-b7f9-4fbd-b111-a22d4146d342 admin admin] PATH_INFO: `/v3/projects/ae6c52ff6e114228b8ceec6bd9b9d7d1/users/a52c5d421a9d4d368c416f4503663a36/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:08.142207 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8dd9f-b7f9-4fbd-b111-a22d4146d342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6c52ff6e114228b8ceec6bd9b9d7d1, user_id=a52c5d421a9d4d368c416f4503663a36, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:08.146692 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8dd9f-b7f9-4fbd-b111-a22d4146d342 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:08.162850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-39e8b656-4fc9-4fbe-ac99-f6307156983d None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:08.179589 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-39e8b656-4fc9-4fbe-ac99-f6307156983d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:08.192408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 821/1650] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:07 2021] PUT /identity/v3/projects/ae6c52ff6e114228b8ceec6bd9b9d7d1/users/a52c5d421a9d4d368c416f4503663a36/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:08.245875 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08998de5-672a-4d75-8fed-c2edf368b512 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:08.246196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08998de5-672a-4d75-8fed-c2edf368b512 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:08.246477 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08998de5-672a-4d75-8fed-c2edf368b512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:08.281710 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-08998de5-672a-4d75-8fed-c2edf368b512 None None] MFA Rules not processed for user `a52c5d421a9d4d368c416f4503663a36`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:08.282947 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-08998de5-672a-4d75-8fed-c2edf368b512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:08.368764 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 822/1651] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:08 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:08.369793 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08998de5-672a-4d75-8fed-c2edf368b512 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:08.371907 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-08998de5-672a-4d75-8fed-c2edf368b512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:08.398058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 830/1652] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:08.399383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8b656-4fc9-4fbe-ac99-f6307156983d None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:08.414338 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8b656-4fc9-4fbe-ac99-f6307156983d None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:08.435952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19687157-fb7c-4631-9bf5-01d455aa421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:08.436908 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19687157-fb7c-4631-9bf5-01d455aa421f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:08.437603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19687157-fb7c-4631-9bf5-01d455aa421f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:08.438054 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19687157-fb7c-4631-9bf5-01d455aa421f admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:08.439555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19687157-fb7c-4631-9bf5-01d455aa421f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:08.441491 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19687157-fb7c-4631-9bf5-01d455aa421f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:08.443398 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19687157-fb7c-4631-9bf5-01d455aa421f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:08.461022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08998de5-672a-4d75-8fed-c2edf368b512 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:08.470867 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 831/1653] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:08.472114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19687157-fb7c-4631-9bf5-01d455aa421f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:08.482370 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653d15e-f854-457c-8585-da50dd40ab22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:08.483490 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653d15e-f854-457c-8585-da50dd40ab22 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:08.483490 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653d15e-f854-457c-8585-da50dd40ab22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:08.486633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653d15e-f854-457c-8585-da50dd40ab22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:08.487574 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653d15e-f854-457c-8585-da50dd40ab22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:08.490188 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653d15e-f854-457c-8585-da50dd40ab22 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:08.506193 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19687157-fb7c-4631-9bf5-01d455aa421f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:08.516135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c8b51-b65a-4f45-9653-561e8bd094e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:08.517703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c8b51-b65a-4f45-9653-561e8bd094e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:08.518618 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c8b51-b65a-4f45-9653-561e8bd094e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:08.519308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c8b51-b65a-4f45-9653-561e8bd094e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:08.520883 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c8b51-b65a-4f45-9653-561e8bd094e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:08.524221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c8b51-b65a-4f45-9653-561e8bd094e3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:08.550219 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 823/1654] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:08 2021] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:08.556125 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653d15e-f854-457c-8585-da50dd40ab22 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:08.595581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 832/1655] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:08 2021] POST /identity/v3/projects => generated 401 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:08.599188 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c8b51-b65a-4f45-9653-561e8bd094e3 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:08.694220 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653d15e-f854-457c-8585-da50dd40ab22 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:08.765317 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843bbfe-efb9-46dc-83d9-9fabbf8f4683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:08.766477 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843bbfe-efb9-46dc-83d9-9fabbf8f4683 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:08.766924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843bbfe-efb9-46dc-83d9-9fabbf8f4683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:08.767386 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843bbfe-efb9-46dc-83d9-9fabbf8f4683 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:08.768395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843bbfe-efb9-46dc-83d9-9fabbf8f4683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:08.770510 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843bbfe-efb9-46dc-83d9-9fabbf8f4683 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:08.775105 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c8b51-b65a-4f45-9653-561e8bd094e3 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:08.796867 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf966f-400d-4288-bdee-818839142a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:08.797468 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf966f-400d-4288-bdee-818839142a8d admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:08.797778 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf966f-400d-4288-bdee-818839142a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:08.798232 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf966f-400d-4288-bdee-818839142a8d admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:08.798853 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf966f-400d-4288-bdee-818839142a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:08.800901 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf966f-400d-4288-bdee-818839142a8d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:08.801416 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 824/1656] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:08 2021] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:08.807734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843bbfe-efb9-46dc-83d9-9fabbf8f4683 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:08.820151 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843bbfe-efb9-46dc-83d9-9fabbf8f4683 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:08.825367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00ded-4660-46a9-b811-23d61c72b59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:08.826642 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00ded-4660-46a9-b811-23d61c72b59d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:08.827223 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00ded-4660-46a9-b811-23d61c72b59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:08.829082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00ded-4660-46a9-b811-23d61c72b59d admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:08.830613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00ded-4660-46a9-b811-23d61c72b59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:08.869926 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00ded-4660-46a9-b811-23d61c72b59d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:08.869926 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 825/1657] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:08 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:08.869926 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00ded-4660-46a9-b811-23d61c72b59d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:08.872365 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 833/1658] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:08 2021] POST /identity/v3/users => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:08.875024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf966f-400d-4288-bdee-818839142a8d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:08.886610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00ded-4660-46a9-b811-23d61c72b59d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:08.893869 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf966f-400d-4288-bdee-818839142a8d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:08.901395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21176c6-45ff-4deb-8619-dbc25c700747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:08.902419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21176c6-45ff-4deb-8619-dbc25c700747 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:08.902781 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21176c6-45ff-4deb-8619-dbc25c700747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:08.903218 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21176c6-45ff-4deb-8619-dbc25c700747 admin admin] PATH_INFO: `/v3/projects/7542da27f0594b9cabb4ec1bbd5ca673/users/78a3ceb2a4374dd4933774107f5fa3c1/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:08.910996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf5536-467d-44c9-9d09-b0d199364534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:08.912015 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf5536-467d-44c9-9d09-b0d199364534 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:08.912652 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf5536-467d-44c9-9d09-b0d199364534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:08.913129 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf5536-467d-44c9-9d09-b0d199364534 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:08.914088 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf5536-467d-44c9-9d09-b0d199364534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:08.916004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf5536-467d-44c9-9d09-b0d199364534 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:08.942792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 834/1659] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:08 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:08.944363 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf5536-467d-44c9-9d09-b0d199364534 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:08.944589 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21176c6-45ff-4deb-8619-dbc25c700747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7542da27f0594b9cabb4ec1bbd5ca673, user_id=78a3ceb2a4374dd4933774107f5fa3c1, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:08.947713 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21176c6-45ff-4deb-8619-dbc25c700747 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:08.966740 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf5536-467d-44c9-9d09-b0d199364534 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:08.994013 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 826/1660] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:08 2021] PUT /identity/v3/projects/7542da27f0594b9cabb4ec1bbd5ca673/users/78a3ceb2a4374dd4933774107f5fa3c1/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:08.998033 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21176c6-45ff-4deb-8619-dbc25c700747 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:09.007822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9133c-e191-4ce1-9da4-94df8857ad9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:09.008688 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9133c-e191-4ce1-9da4-94df8857ad9f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:09.009085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9133c-e191-4ce1-9da4-94df8857ad9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:09.009464 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9133c-e191-4ce1-9da4-94df8857ad9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:09.010347 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9133c-e191-4ce1-9da4-94df8857ad9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:09.015055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9133c-e191-4ce1-9da4-94df8857ad9f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:09.060383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 835/1661] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:08 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:09.064640 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9133c-e191-4ce1-9da4-94df8857ad9f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:09.076129 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9133c-e191-4ce1-9da4-94df8857ad9f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:09.182309 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faf23c-bbfb-4781-9cc5-e27ba25f484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:09.184788 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faf23c-bbfb-4781-9cc5-e27ba25f484d admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:09.185335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faf23c-bbfb-4781-9cc5-e27ba25f484d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:09.186762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faf23c-bbfb-4781-9cc5-e27ba25f484d admin admin] PATH_INFO: `/v3/projects/77fdc6c2d9d84f99a7dfa0d697a32961/users/ef2364565b5f4dffac08a7e9033e4f1f/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:09.211422 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faf23c-bbfb-4781-9cc5-e27ba25f484d admin admin] RBAC: Authorizing `identity:create_grant(project_id=77fdc6c2d9d84f99a7dfa0d697a32961, user_id=ef2364565b5f4dffac08a7e9033e4f1f, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:09.226367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faf23c-bbfb-4781-9cc5-e27ba25f484d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:09.227959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21176c6-45ff-4deb-8619-dbc25c700747 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:09.254972 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57005811-dbff-4b25-9c71-39538ce96cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:09.259693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57005811-dbff-4b25-9c71-39538ce96cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:09.261313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57005811-dbff-4b25-9c71-39538ce96cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:09.264304 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57005811-dbff-4b25-9c71-39538ce96cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:09.267538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 836/1662] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:09 2021] PUT /identity/v3/projects/77fdc6c2d9d84f99a7dfa0d697a32961/users/ef2364565b5f4dffac08a7e9033e4f1f/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:09.271873 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57005811-dbff-4b25-9c71-39538ce96cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:09.274289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57005811-dbff-4b25-9c71-39538ce96cd6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:09.309159 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 827/1663] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:08 2021] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:09.326915 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faf23c-bbfb-4781-9cc5-e27ba25f484d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:09.328912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f5720-ac7f-438c-8683-8d9d6a94714b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:09.329202 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f5720-ac7f-438c-8683-8d9d6a94714b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:09.329476 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f5720-ac7f-438c-8683-8d9d6a94714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:09.389045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-466f5720-ac7f-438c-8683-8d9d6a94714b None None] MFA Rules not processed for user `ef2364565b5f4dffac08a7e9033e4f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:09.390615 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-466f5720-ac7f-438c-8683-8d9d6a94714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:09.456339 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faf23c-bbfb-4781-9cc5-e27ba25f484d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:09.470176 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402dd65-57da-4f79-bf32-a9fded6a62d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:09.471366 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402dd65-57da-4f79-bf32-a9fded6a62d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:09.471790 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402dd65-57da-4f79-bf32-a9fded6a62d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:09.472233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402dd65-57da-4f79-bf32-a9fded6a62d6 admin admin] PATH_INFO: `/v3/projects/7542da27f0594b9cabb4ec1bbd5ca673/users/78a3ceb2a4374dd4933774107f5fa3c1/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:09.480066 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402dd65-57da-4f79-bf32-a9fded6a62d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7542da27f0594b9cabb4ec1bbd5ca673, user_id=78a3ceb2a4374dd4933774107f5fa3c1, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:09.488974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402dd65-57da-4f79-bf32-a9fded6a62d6 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:09.540010 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 828/1664] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:09 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:09.545283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f5720-ac7f-438c-8683-8d9d6a94714b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:09.555436 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 837/1665] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:09 2021] PUT /identity/v3/projects/7542da27f0594b9cabb4ec1bbd5ca673/users/78a3ceb2a4374dd4933774107f5fa3c1/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:09.566248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d72b91-03ab-4a1f-8562-34b5ff3e1fd0 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:09.566716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d72b91-03ab-4a1f-8562-34b5ff3e1fd0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:09.566998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d72b91-03ab-4a1f-8562-34b5ff3e1fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:09.575192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f5720-ac7f-438c-8683-8d9d6a94714b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:09.639677 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-07d72b91-03ab-4a1f-8562-34b5ff3e1fd0 None None] MFA Rules not processed for user `78a3ceb2a4374dd4933774107f5fa3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:09.641067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-07d72b91-03ab-4a1f-8562-34b5ff3e1fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:09.809626 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 838/1666] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:09 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:09.822257 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f8c75-11f2-4723-8d10-8ef393595759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:09.824858 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d72b91-03ab-4a1f-8562-34b5ff3e1fd0 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:09.825982 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f8c75-11f2-4723-8d10-8ef393595759 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:09.826425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f8c75-11f2-4723-8d10-8ef393595759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:09.826852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f8c75-11f2-4723-8d10-8ef393595759 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:09.827887 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-07d72b91-03ab-4a1f-8562-34b5ff3e1fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:09.828598 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f8c75-11f2-4723-8d10-8ef393595759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:09.831448 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f8c75-11f2-4723-8d10-8ef393595759 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:09.907340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 829/1667] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:09 2021] POST /identity/v3/projects => generated 399 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:01:09.910417 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f8c75-11f2-4723-8d10-8ef393595759 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:09.998174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d72b91-03ab-4a1f-8562-34b5ff3e1fd0 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:10.083518 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f8c75-11f2-4723-8d10-8ef393595759 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:10.099676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad0b06-17fb-4a9e-94ce-d763a631be32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:10.100722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0b06-17fb-4a9e-94ce-d763a631be32 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:10.101134 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0b06-17fb-4a9e-94ce-d763a631be32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:10.101675 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0b06-17fb-4a9e-94ce-d763a631be32 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:10.103169 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad0b06-17fb-4a9e-94ce-d763a631be32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:10.108285 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad0b06-17fb-4a9e-94ce-d763a631be32 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:10.122892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584eeed0-c9f7-4c29-abdf-36e04e59b3ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:10.123866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584eeed0-c9f7-4c29-abdf-36e04e59b3ac service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:10.124305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584eeed0-c9f7-4c29-abdf-36e04e59b3ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:10.124730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584eeed0-c9f7-4c29-abdf-36e04e59b3ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:10.165446 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 830/1668] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:09 2021] POST /identity/v3/users => generated 306 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:10.167758 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad0b06-17fb-4a9e-94ce-d763a631be32 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:10.170479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-08ad0b06-17fb-4a9e-94ce-d763a631be32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:10.203561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad0b06-17fb-4a9e-94ce-d763a631be32 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:10.222273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80162ef2-7e87-4fae-b71b-e41c206b76e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:10.223222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80162ef2-7e87-4fae-b71b-e41c206b76e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:10.223828 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80162ef2-7e87-4fae-b71b-e41c206b76e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:10.224483 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80162ef2-7e87-4fae-b71b-e41c206b76e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:10.227066 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-80162ef2-7e87-4fae-b71b-e41c206b76e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:10.253349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584eeed0-c9f7-4c29-abdf-36e04e59b3ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:10.254900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584eeed0-c9f7-4c29-abdf-36e04e59b3ac service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:10.283002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 839/1669] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:09 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:10.284594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584eeed0-c9f7-4c29-abdf-36e04e59b3ac service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:10.310164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584eeed0-c9f7-4c29-abdf-36e04e59b3ac service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:10.325281 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a30b5-4906-4d4c-b5a8-76fbfccd8eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:10.325978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a30b5-4906-4d4c-b5a8-76fbfccd8eef admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:10.326264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a30b5-4906-4d4c-b5a8-76fbfccd8eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:10.326535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a30b5-4906-4d4c-b5a8-76fbfccd8eef admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:10.327326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a30b5-4906-4d4c-b5a8-76fbfccd8eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:10.335820 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a30b5-4906-4d4c-b5a8-76fbfccd8eef admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:10.364810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 840/1670] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:10 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:10.364810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a30b5-4906-4d4c-b5a8-76fbfccd8eef admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:10.386711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a30b5-4906-4d4c-b5a8-76fbfccd8eef admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:10.397397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80162ef2-7e87-4fae-b71b-e41c206b76e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:10.397694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80162ef2-7e87-4fae-b71b-e41c206b76e5 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:10.410458 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dabb5a-045f-48a3-814d-9395d4f07cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:10.411662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dabb5a-045f-48a3-814d-9395d4f07cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:10.412848 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dabb5a-045f-48a3-814d-9395d4f07cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:10.415040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dabb5a-045f-48a3-814d-9395d4f07cdb admin admin] PATH_INFO: `/v3/projects/1afe8bcdc210478595d5e0735ab6fef2/users/df212e27c76e47b6b4cd4a1e89b57755/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:10.454181 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 831/1671] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:10 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:10.471275 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dabb5a-045f-48a3-814d-9395d4f07cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1afe8bcdc210478595d5e0735ab6fef2, user_id=df212e27c76e47b6b4cd4a1e89b57755, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:10.482402 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dabb5a-045f-48a3-814d-9395d4f07cdb admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:10.504476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 841/1672] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:10 2021] PUT /identity/v3/projects/1afe8bcdc210478595d5e0735ab6fef2/users/df212e27c76e47b6b4cd4a1e89b57755/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:10.508766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80162ef2-7e87-4fae-b71b-e41c206b76e5 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:10.526390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80162ef2-7e87-4fae-b71b-e41c206b76e5 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:10.532071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dabb5a-045f-48a3-814d-9395d4f07cdb admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:10.749698 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dabb5a-045f-48a3-814d-9395d4f07cdb admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:10.753234 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae189c9-6e5b-4a15-9f14-fee99baaac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:10.754252 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae189c9-6e5b-4a15-9f14-fee99baaac1f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:10.754696 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae189c9-6e5b-4a15-9f14-fee99baaac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:10.755113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae189c9-6e5b-4a15-9f14-fee99baaac1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:10.756107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90ea69-b187-41f1-b228-3da82869e30e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:10.757020 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae189c9-6e5b-4a15-9f14-fee99baaac1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:10.757876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90ea69-b187-41f1-b228-3da82869e30e service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:10.759310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae189c9-6e5b-4a15-9f14-fee99baaac1f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:10.759659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90ea69-b187-41f1-b228-3da82869e30e service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:10.760081 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90ea69-b187-41f1-b228-3da82869e30e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:10.785456 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 832/1673] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:10 2021] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:10.786592 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae189c9-6e5b-4a15-9f14-fee99baaac1f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:10.818524 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae189c9-6e5b-4a15-9f14-fee99baaac1f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:10.840345 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66845ae-858a-4164-a8ba-4b5913a6950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:10.841974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66845ae-858a-4164-a8ba-4b5913a6950a admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:10.842408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66845ae-858a-4164-a8ba-4b5913a6950a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:10.842832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66845ae-858a-4164-a8ba-4b5913a6950a admin admin] PATH_INFO: `/v3/projects/1afe8bcdc210478595d5e0735ab6fef2/users/df212e27c76e47b6b4cd4a1e89b57755/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:10.845164 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66845ae-858a-4164-a8ba-4b5913a6950a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1afe8bcdc210478595d5e0735ab6fef2, user_id=df212e27c76e47b6b4cd4a1e89b57755, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:10.848556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66845ae-858a-4164-a8ba-4b5913a6950a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:10.872371 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 833/1674] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:10 2021] PUT /identity/v3/projects/1afe8bcdc210478595d5e0735ab6fef2/users/df212e27c76e47b6b4cd4a1e89b57755/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:10.874171 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60af34a-c683-498f-9f51-0057b4360a23 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:10.875173 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60af34a-c683-498f-9f51-0057b4360a23 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:10.875620 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60af34a-c683-498f-9f51-0057b4360a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:10.918952 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-e60af34a-c683-498f-9f51-0057b4360a23 None None] MFA Rules not processed for user `fd75fa7d42a5418e87ebc4176e5a2790`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:10.921588 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e60af34a-c683-498f-9f51-0057b4360a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:10.941939 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90ea69-b187-41f1-b228-3da82869e30e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:10.946895 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90ea69-b187-41f1-b228-3da82869e30e service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:10.986861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 842/1675] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:10 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:10.990769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5c04e-5603-48db-b8ba-3619b1980cc0 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:10.991083 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5c04e-5603-48db-b8ba-3619b1980cc0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:10.991388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5c04e-5603-48db-b8ba-3619b1980cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:11.023437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 834/1676] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:10 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:11.064919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-61a5c04e-5603-48db-b8ba-3619b1980cc0 None None] MFA Rules not processed for user `df212e27c76e47b6b4cd4a1e89b57755`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:11.065989 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-61a5c04e-5603-48db-b8ba-3619b1980cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:11.274993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 843/1677] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:10 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:11.459785 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2cf07-9b0a-4260-b16f-14fc1111b890 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:11.460451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2cf07-9b0a-4260-b16f-14fc1111b890 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:11.461148 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2cf07-9b0a-4260-b16f-14fc1111b890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:11.498767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-3ea2cf07-9b0a-4260-b16f-14fc1111b890 None None] MFA Rules not processed for user `f9fc539f38364a648b9a4c25d3dbea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:11.501693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5c04e-5603-48db-b8ba-3619b1980cc0 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:11.516848 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3ea2cf07-9b0a-4260-b16f-14fc1111b890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:11.640894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5c04e-5603-48db-b8ba-3619b1980cc0 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:11.648615 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951038db-0177-46cf-b0ef-4b8be1b487e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:11.649669 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951038db-0177-46cf-b0ef-4b8be1b487e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:11.651308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951038db-0177-46cf-b0ef-4b8be1b487e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:11.651652 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951038db-0177-46cf-b0ef-4b8be1b487e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:11.675235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 835/1678] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Nov 8 11:01:11 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:11.677195 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951038db-0177-46cf-b0ef-4b8be1b487e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:11.678195 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951038db-0177-46cf-b0ef-4b8be1b487e7 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:11.690204 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 844/1679] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:11 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:11.809086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2cf07-9b0a-4260-b16f-14fc1111b890 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:11.819296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2cf07-9b0a-4260-b16f-14fc1111b890 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:11.825905 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368a9ad-0257-4d3e-b4a6-f3a206bc890a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:11.827156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368a9ad-0257-4d3e-b4a6-f3a206bc890a service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:11.827643 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368a9ad-0257-4d3e-b4a6-f3a206bc890a service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:11.828093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368a9ad-0257-4d3e-b4a6-f3a206bc890a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:11.885002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951038db-0177-46cf-b0ef-4b8be1b487e7 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:11.886392 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-951038db-0177-46cf-b0ef-4b8be1b487e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:11.917902 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368a9ad-0257-4d3e-b4a6-f3a206bc890a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:11.920380 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368a9ad-0257-4d3e-b4a6-f3a206bc890a service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:11.950157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 836/1680] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:11 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:12.014275 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951038db-0177-46cf-b0ef-4b8be1b487e7 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:12.023292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce92367-f483-40a0-8574-2fe676f0f799 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '029506cc966a44c9bbe83eb084ac6feb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:12.024249 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce92367-f483-40a0-8574-2fe676f0f799 service swift] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:12.024718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce92367-f483-40a0-8574-2fe676f0f799 service swift] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:12.025166 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce92367-f483-40a0-8574-2fe676f0f799 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:12.036639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce92367-f483-40a0-8574-2fe676f0f799 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:12.041076 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce92367-f483-40a0-8574-2fe676f0f799 service swift] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:12.078675 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 845/1681] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Nov 8 11:01:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 11:01:12.172022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef867-22b5-4fb0-8436-f3af294def99 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:12.172315 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef867-22b5-4fb0-8436-f3af294def99 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:12.172594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef867-22b5-4fb0-8436-f3af294def99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:12.242146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-2b0ef867-22b5-4fb0-8436-f3af294def99 None None] MFA Rules not processed for user `763c552499cc4f2ca8e7070f822f51b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:12.251924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2b0ef867-22b5-4fb0-8436-f3af294def99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:12.445812 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 837/1682] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:12 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:12.461017 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce92367-f483-40a0-8574-2fe676f0f799 service swift] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:12.465109 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-cce92367-f483-40a0-8574-2fe676f0f799 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:12.690990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce92367-f483-40a0-8574-2fe676f0f799 service swift] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:12.706565 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e547-3c5a-46cc-a43c-87c55354cf35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:12.707391 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e547-3c5a-46cc-a43c-87c55354cf35 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:12.708552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e547-3c5a-46cc-a43c-87c55354cf35 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:12.710861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e547-3c5a-46cc-a43c-87c55354cf35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:12.752647 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468e547-3c5a-46cc-a43c-87c55354cf35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:12.754276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468e547-3c5a-46cc-a43c-87c55354cf35 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:12.783921 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 846/1683] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:12 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:14.525069 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f7c88-c21b-4b78-bdde-0ed455f9e56c None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:14.525909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f7c88-c21b-4b78-bdde-0ed455f9e56c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:14.525909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f7c88-c21b-4b78-bdde-0ed455f9e56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:14.632047 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-851f7c88-c21b-4b78-bdde-0ed455f9e56c None None] MFA Rules not processed for user `73ef103ad38f498c8ea87525f554f438`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:14.636045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-851f7c88-c21b-4b78-bdde-0ed455f9e56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:14.837955 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 838/1684] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:14 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:14.851982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b55c5-42fe-4bf6-a905-13d7d40bb68f None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:14.852675 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b55c5-42fe-4bf6-a905-13d7d40bb68f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:14.852942 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b55c5-42fe-4bf6-a905-13d7d40bb68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:14.978285 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-194b55c5-42fe-4bf6-a905-13d7d40bb68f None None] MFA Rules not processed for user `73ef103ad38f498c8ea87525f554f438`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:14.988692 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-194b55c5-42fe-4bf6-a905-13d7d40bb68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:15.016726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 847/1685] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:14 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:15.031013 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f7c88-c21b-4b78-bdde-0ed455f9e56c None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:15.068143 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f7c88-c21b-4b78-bdde-0ed455f9e56c None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:15.096825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674df4a-977a-40f4-ae65-a60b291669d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:15.103444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674df4a-977a-40f4-ae65-a60b291669d7 service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:15.104280 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674df4a-977a-40f4-ae65-a60b291669d7 service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:15.107670 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674df4a-977a-40f4-ae65-a60b291669d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:15.155793 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674df4a-977a-40f4-ae65-a60b291669d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:15.179861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674df4a-977a-40f4-ae65-a60b291669d7 service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:15.194459 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b55c5-42fe-4bf6-a905-13d7d40bb68f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:15.196314 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-194b55c5-42fe-4bf6-a905-13d7d40bb68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:15.245364 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 839/1686] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:15 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:15.495985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b55c5-42fe-4bf6-a905-13d7d40bb68f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:15.525664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b50766-716b-4caf-9895-dab110527a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:15.527014 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b50766-716b-4caf-9895-dab110527a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:15.529866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b50766-716b-4caf-9895-dab110527a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:15.530313 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b50766-716b-4caf-9895-dab110527a6a admin admin] PATH_INFO: `/v3/users/575e913d0cd34dfb9eef961f7ec79652` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:15.538993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b50766-716b-4caf-9895-dab110527a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=575e913d0cd34dfb9eef961f7ec79652)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:15.546281 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b50766-716b-4caf-9895-dab110527a6a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:15.754276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d5b50766-716b-4caf-9895-dab110527a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575e913d0cd34dfb9eef961f7ec79652'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:15.755581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d5b50766-716b-4caf-9895-dab110527a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575e913d0cd34dfb9eef961f7ec79652'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:15.775831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d5b50766-716b-4caf-9895-dab110527a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575e913d0cd34dfb9eef961f7ec79652'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:15.779687 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d5b50766-716b-4caf-9895-dab110527a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575e913d0cd34dfb9eef961f7ec79652'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:15.848447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d5b50766-716b-4caf-9895-dab110527a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575e913d0cd34dfb9eef961f7ec79652'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:15.926244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 848/1687] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:15 2021] DELETE /identity/v3/users/575e913d0cd34dfb9eef961f7ec79652 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:15.930603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882feed4-a67e-497d-aff0-434ec42f172c None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:15.931635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882feed4-a67e-497d-aff0-434ec42f172c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:15.931635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882feed4-a67e-497d-aff0-434ec42f172c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:15.978750 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-882feed4-a67e-497d-aff0-434ec42f172c None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:15.980316 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-882feed4-a67e-497d-aff0-434ec42f172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:16.304451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 840/1688] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:16.487473 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b50766-716b-4caf-9895-dab110527a6a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:16.489898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d5b50766-716b-4caf-9895-dab110527a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:16.714473 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b50766-716b-4caf-9895-dab110527a6a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:16.730576 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ae66f-43c0-4cfe-968b-ebdf5792f6a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:16.731849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ae66f-43c0-4cfe-968b-ebdf5792f6a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:16.732190 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ae66f-43c0-4cfe-968b-ebdf5792f6a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:16.732596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ae66f-43c0-4cfe-968b-ebdf5792f6a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:16.759246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ae66f-43c0-4cfe-968b-ebdf5792f6a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:16.761058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ae66f-43c0-4cfe-968b-ebdf5792f6a2 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:16.786575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 849/1689] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:16.880441 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882feed4-a67e-497d-aff0-434ec42f172c None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:16.883237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-882feed4-a67e-497d-aff0-434ec42f172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:16.922050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882feed4-a67e-497d-aff0-434ec42f172c None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:16.958487 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4dea5-4852-4fe6-9eff-53ccbeafd509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:16.962202 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4dea5-4852-4fe6-9eff-53ccbeafd509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:16.962577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4dea5-4852-4fe6-9eff-53ccbeafd509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:16.962924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4dea5-4852-4fe6-9eff-53ccbeafd509 admin admin] PATH_INFO: `/v3/users/a52c5d421a9d4d368c416f4503663a36` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:16.967186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4dea5-4852-4fe6-9eff-53ccbeafd509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a52c5d421a9d4d368c416f4503663a36)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:16.975306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4dea5-4852-4fe6-9eff-53ccbeafd509 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:17.094701 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282e3ba-d701-4563-bf2a-26f610452cad None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:17.095230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282e3ba-d701-4563-bf2a-26f610452cad None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:17.095432 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6be4dea5-4852-4fe6-9eff-53ccbeafd509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a52c5d421a9d4d368c416f4503663a36'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:17.095543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282e3ba-d701-4563-bf2a-26f610452cad None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:17.098092 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6be4dea5-4852-4fe6-9eff-53ccbeafd509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a52c5d421a9d4d368c416f4503663a36'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:17.098920 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 850/1690] 10.222.0.20 () {54 vars in 912 bytes} [Mon Nov 8 11:01:17 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 11:01:17.120941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9181b31-c554-4100-85da-7c1f6e41e9d0 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:17.121232 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9181b31-c554-4100-85da-7c1f6e41e9d0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:17.121981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9181b31-c554-4100-85da-7c1f6e41e9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:17.128996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6be4dea5-4852-4fe6-9eff-53ccbeafd509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a52c5d421a9d4d368c416f4503663a36'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:17.129775 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6be4dea5-4852-4fe6-9eff-53ccbeafd509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a52c5d421a9d4d368c416f4503663a36'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:17.151162 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6be4dea5-4852-4fe6-9eff-53ccbeafd509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a52c5d421a9d4d368c416f4503663a36'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:17.174102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-a9181b31-c554-4100-85da-7c1f6e41e9d0 None None] MFA Rules not processed for user `0e134083351e4493b2a05bea95233f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:17.178946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a9181b31-c554-4100-85da-7c1f6e41e9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:17.193349 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 841/1691] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:16 2021] DELETE /identity/v3/users/a52c5d421a9d4d368c416f4503663a36 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:17.195429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7bac-a5a3-4627-b2da-ebd48c2a6160 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:17.195682 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7bac-a5a3-4627-b2da-ebd48c2a6160 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:17.196308 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7bac-a5a3-4627-b2da-ebd48c2a6160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:17.253456 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-d26e7bac-a5a3-4627-b2da-ebd48c2a6160 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:17.255831 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d26e7bac-a5a3-4627-b2da-ebd48c2a6160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:17.372040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 851/1692] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Nov 8 11:01:17 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:17.413217 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 842/1693] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:17.441318 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9181b31-c554-4100-85da-7c1f6e41e9d0 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:17.442897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a9181b31-c554-4100-85da-7c1f6e41e9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:17.459326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9181b31-c554-4100-85da-7c1f6e41e9d0 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:17.467378 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe2845-3ded-4c44-aade-58b70b0c85ab None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:17.468272 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe2845-3ded-4c44-aade-58b70b0c85ab None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:17.468948 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe2845-3ded-4c44-aade-58b70b0c85ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:17.472569 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309ea62-1d99-4e89-adab-402ca75f98bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:17.473511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309ea62-1d99-4e89-adab-402ca75f98bf service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:17.473974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309ea62-1d99-4e89-adab-402ca75f98bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:17.479977 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309ea62-1d99-4e89-adab-402ca75f98bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:17.516416 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309ea62-1d99-4e89-adab-402ca75f98bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:17.523063 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309ea62-1d99-4e89-adab-402ca75f98bf service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:17.542801 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-bdfe2845-3ded-4c44-aade-58b70b0c85ab None None] MFA Rules not processed for user `763c552499cc4f2ca8e7070f822f51b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:17.554061 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-bdfe2845-3ded-4c44-aade-58b70b0c85ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:17.579110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 852/1694] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:17.730930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 843/1695] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:17 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:18.403967 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309ea62-1d99-4e89-adab-402ca75f98bf service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:18.405708 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b309ea62-1d99-4e89-adab-402ca75f98bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:18.420294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe2845-3ded-4c44-aade-58b70b0c85ab None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:18.422717 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-bdfe2845-3ded-4c44-aade-58b70b0c85ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:18.465468 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309ea62-1d99-4e89-adab-402ca75f98bf service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:18.473554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe2845-3ded-4c44-aade-58b70b0c85ab None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:18.478638 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da0e5d-b95d-417b-ad56-dfdc56f039ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:18.479717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0e5d-b95d-417b-ad56-dfdc56f039ee service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:18.481080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0e5d-b95d-417b-ad56-dfdc56f039ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:18.481990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0e5d-b95d-417b-ad56-dfdc56f039ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:18.505283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:18.506934 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:18.507253 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:18.507531 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] PATH_INFO: `/v3/projects/ae6c52ff6e114228b8ceec6bd9b9d7d1` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:18.514647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6c52ff6e114228b8ceec6bd9b9d7d1)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:18.517262 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da0e5d-b95d-417b-ad56-dfdc56f039ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:18.532916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da0e5d-b95d-417b-ad56-dfdc56f039ee service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:18.538537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:18.568774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 853/1696] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:18 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:18.642108 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6c52ff6e114228b8ceec6bd9b9d7d1', 'request_id': 'req-14cd7689-adf5-4a8d-8076-4a280e691ee8'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:18.650876 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6c52ff6e114228b8ceec6bd9b9d7d1', 'request_id': 'req-14cd7689-adf5-4a8d-8076-4a280e691ee8'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:18.661319 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6c52ff6e114228b8ceec6bd9b9d7d1', 'request_id': 'req-14cd7689-adf5-4a8d-8076-4a280e691ee8'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:18.702488 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] The token cache is being invalidate because project ae6c52ff6e114228b8ceec6bd9b9d7d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:18.705756 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:18.706854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:18.711486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 844/1697] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:18 2021] DELETE /identity/v3/projects/ae6c52ff6e114228b8ceec6bd9b9d7d1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:18.716003 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da0e5d-b95d-417b-ad56-dfdc56f039ee service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:18.734223 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da0e5d-b95d-417b-ad56-dfdc56f039ee service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:18.824399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06f52a-b2ca-4903-8e41-c95f93fda749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:18.825332 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06f52a-b2ca-4903-8e41-c95f93fda749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:18.825612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06f52a-b2ca-4903-8e41-c95f93fda749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:18.825901 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06f52a-b2ca-4903-8e41-c95f93fda749 admin admin] PATH_INFO: `/v3/users/78a3ceb2a4374dd4933774107f5fa3c1` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:18.827662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06f52a-b2ca-4903-8e41-c95f93fda749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a3ceb2a4374dd4933774107f5fa3c1)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:18.830041 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06f52a-b2ca-4903-8e41-c95f93fda749 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:18.887521 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dd06f52a-b2ca-4903-8e41-c95f93fda749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a3ceb2a4374dd4933774107f5fa3c1'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:18.888721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dd06f52a-b2ca-4903-8e41-c95f93fda749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a3ceb2a4374dd4933774107f5fa3c1'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:18.898302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dd06f52a-b2ca-4903-8e41-c95f93fda749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a3ceb2a4374dd4933774107f5fa3c1'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:18.899402 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dd06f52a-b2ca-4903-8e41-c95f93fda749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a3ceb2a4374dd4933774107f5fa3c1'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:18.918815 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dd06f52a-b2ca-4903-8e41-c95f93fda749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a3ceb2a4374dd4933774107f5fa3c1'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:18.944377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 854/1698] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:18 2021] DELETE /identity/v3/users/78a3ceb2a4374dd4933774107f5fa3c1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:19.325232 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:19.326846 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:19.352769 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd7689-adf5-4a8d-8076-4a280e691ee8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:19.523643 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:19.527207 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:19.528263 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:19.530666 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] PATH_INFO: `/v3/projects/7542da27f0594b9cabb4ec1bbd5ca673` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:19.539623 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] RBAC: Authorizing `identity:delete_project(project_id=7542da27f0594b9cabb4ec1bbd5ca673)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:19.547408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:19.580770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06f52a-b2ca-4903-8e41-c95f93fda749 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:19.583445 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-dd06f52a-b2ca-4903-8e41-c95f93fda749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:19.610427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06f52a-b2ca-4903-8e41-c95f93fda749 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:19.626367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cb0de-edca-4e58-81f4-74195d54382b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:19.628220 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cb0de-edca-4e58-81f4-74195d54382b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:19.629080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cb0de-edca-4e58-81f4-74195d54382b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:19.633909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cb0de-edca-4e58-81f4-74195d54382b admin admin] PATH_INFO: `/v3/users/ef2364565b5f4dffac08a7e9033e4f1f` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:19.638378 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cb0de-edca-4e58-81f4-74195d54382b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef2364565b5f4dffac08a7e9033e4f1f)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:19.645951 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cb0de-edca-4e58-81f4-74195d54382b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:19.719742 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7542da27f0594b9cabb4ec1bbd5ca673', 'request_id': 'req-6db98958-e754-4aad-9432-01dcc32892da'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:19.744094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7542da27f0594b9cabb4ec1bbd5ca673', 'request_id': 'req-6db98958-e754-4aad-9432-01dcc32892da'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:19.756497 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7542da27f0594b9cabb4ec1bbd5ca673', 'request_id': 'req-6db98958-e754-4aad-9432-01dcc32892da'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:19.773955 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] The token cache is being invalidate because project 7542da27f0594b9cabb4ec1bbd5ca673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:19.774488 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:19.775832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:19.780577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 845/1699] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:19 2021] DELETE /identity/v3/projects/7542da27f0594b9cabb4ec1bbd5ca673 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:19.782382 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:19.789737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:19.800362 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-479cb0de-edca-4e58-81f4-74195d54382b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef2364565b5f4dffac08a7e9033e4f1f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:19.804025 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-479cb0de-edca-4e58-81f4-74195d54382b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef2364565b5f4dffac08a7e9033e4f1f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:19.843435 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-479cb0de-edca-4e58-81f4-74195d54382b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef2364565b5f4dffac08a7e9033e4f1f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:19.847153 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-479cb0de-edca-4e58-81f4-74195d54382b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef2364565b5f4dffac08a7e9033e4f1f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:19.897015 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-479cb0de-edca-4e58-81f4-74195d54382b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef2364565b5f4dffac08a7e9033e4f1f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:19.929828 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 855/1700] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:19 2021] DELETE /identity/v3/users/ef2364565b5f4dffac08a7e9033e4f1f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:19.932453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe6ef-ca14-4bb5-a0e9-4800ec0846a3 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:19.932952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe6ef-ca14-4bb5-a0e9-4800ec0846a3 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:19.933424 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe6ef-ca14-4bb5-a0e9-4800ec0846a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:19.946528 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db98958-e754-4aad-9432-01dcc32892da admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:20.014192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-01cbe6ef-ca14-4bb5-a0e9-4800ec0846a3 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:20.021762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-01cbe6ef-ca14-4bb5-a0e9-4800ec0846a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:20.056419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20aa571-37a5-4afb-829c-eb6661750a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:20.057461 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aa571-37a5-4afb-829c-eb6661750a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:20.057581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aa571-37a5-4afb-829c-eb6661750a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:20.057858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aa571-37a5-4afb-829c-eb6661750a4b admin admin] PATH_INFO: `/v3/projects/4c5faa9f2c4048bd9c40878bcb8a057c` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:20.059313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20aa571-37a5-4afb-829c-eb6661750a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5faa9f2c4048bd9c40878bcb8a057c)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:20.061275 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20aa571-37a5-4afb-829c-eb6661750a4b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:20.182967 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a20aa571-37a5-4afb-829c-eb6661750a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5faa9f2c4048bd9c40878bcb8a057c', 'request_id': 'req-a20aa571-37a5-4afb-829c-eb6661750a4b'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:20.219307 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a20aa571-37a5-4afb-829c-eb6661750a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5faa9f2c4048bd9c40878bcb8a057c', 'request_id': 'req-a20aa571-37a5-4afb-829c-eb6661750a4b'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:20.241391 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a20aa571-37a5-4afb-829c-eb6661750a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5faa9f2c4048bd9c40878bcb8a057c', 'request_id': 'req-a20aa571-37a5-4afb-829c-eb6661750a4b'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:20.265625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a20aa571-37a5-4afb-829c-eb6661750a4b admin admin] The token cache is being invalidate because project 4c5faa9f2c4048bd9c40878bcb8a057c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:20.265918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a20aa571-37a5-4afb-829c-eb6661750a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:20.271738 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a20aa571-37a5-4afb-829c-eb6661750a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:20.273769 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 846/1701] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:19 2021] DELETE /identity/v3/projects/4c5faa9f2c4048bd9c40878bcb8a057c => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:20.274894 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f131f2f-c988-4998-9cb0-680665e52097 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:20.276669 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f131f2f-c988-4998-9cb0-680665e52097 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:20.277031 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f131f2f-c988-4998-9cb0-680665e52097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:20.284724 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 856/1702] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:20.286474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7325a46-80ca-4d88-8647-df7fc047595d None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:20.287175 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7325a46-80ca-4d88-8647-df7fc047595d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:20.287175 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7325a46-80ca-4d88-8647-df7fc047595d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:20.308034 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-f7325a46-80ca-4d88-8647-df7fc047595d None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:20.309596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f7325a46-80ca-4d88-8647-df7fc047595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:20.318275 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-3f131f2f-c988-4998-9cb0-680665e52097 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:20.329674 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3f131f2f-c988-4998-9cb0-680665e52097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:20.439813 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 857/1703] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:20.447291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9a07b-7ead-4c22-ab01-acbf3136a9ea None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:20.447291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9a07b-7ead-4c22-ab01-acbf3136a9ea None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:20.447291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9a07b-7ead-4c22-ab01-acbf3136a9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:20.488522 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 847/1704] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:20.490428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e5c8-0542-4f20-b5eb-b78aaf308812 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:20.490861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e5c8-0542-4f20-b5eb-b78aaf308812 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:20.491313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e5c8-0542-4f20-b5eb-b78aaf308812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:20.511364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-d6c9a07b-7ead-4c22-ab01-acbf3136a9ea None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:20.518579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-7865e5c8-0542-4f20-b5eb-b78aaf308812 None None] MFA Rules not processed for user `73ef103ad38f498c8ea87525f554f438`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:20.520346 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-7865e5c8-0542-4f20-b5eb-b78aaf308812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:20.520671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d6c9a07b-7ead-4c22-ab01-acbf3136a9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:20.546084 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 858/1705] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:20.547501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2c57-d9d0-48dd-9406-9fe6574c2601 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:20.547793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2c57-d9d0-48dd-9406-9fe6574c2601 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:20.548070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2c57-d9d0-48dd-9406-9fe6574c2601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:20.593829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-e80d2c57-d9d0-48dd-9406-9fe6574c2601 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:20.595070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e80d2c57-d9d0-48dd-9406-9fe6574c2601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:20.629767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 859/1706] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:20.632326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d2c57-d9d0-48dd-9406-9fe6574c2601 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:20.635372 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e80d2c57-d9d0-48dd-9406-9fe6574c2601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:20.664553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 848/1707] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:20 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:20.671506 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e5c8-0542-4f20-b5eb-b78aaf308812 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:20.686925 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e5c8-0542-4f20-b5eb-b78aaf308812 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:20.693394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b185c-cd93-42d0-98b9-8a3bb0e4b265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:20.694503 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b185c-cd93-42d0-98b9-8a3bb0e4b265 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:20.694854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b185c-cd93-42d0-98b9-8a3bb0e4b265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:20.695250 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b185c-cd93-42d0-98b9-8a3bb0e4b265 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:20.696162 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b185c-cd93-42d0-98b9-8a3bb0e4b265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:20.696775 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b185c-cd93-42d0-98b9-8a3bb0e4b265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:20.699021 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b185c-cd93-42d0-98b9-8a3bb0e4b265 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:20.715523 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 849/1708] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:20.720789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b185c-cd93-42d0-98b9-8a3bb0e4b265 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:20.733579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b185c-cd93-42d0-98b9-8a3bb0e4b265 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:20.743008 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b37a8-784a-4421-a521-71f1f1fd26e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:20.744089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b37a8-784a-4421-a521-71f1f1fd26e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:20.744406 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b37a8-784a-4421-a521-71f1f1fd26e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:20.746244 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b37a8-784a-4421-a521-71f1f1fd26e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:20.746906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b37a8-784a-4421-a521-71f1f1fd26e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:20.747308 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b37a8-784a-4421-a521-71f1f1fd26e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:20.749110 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b37a8-784a-4421-a521-71f1f1fd26e7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:20.797239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 850/1709] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:20.803999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d2c57-d9d0-48dd-9406-9fe6574c2601 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:20.804507 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b37a8-784a-4421-a521-71f1f1fd26e7 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:20.816147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1e0ab-be7a-4113-9ef3-e8cabdaa1034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:20.816847 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1e0ab-be7a-4113-9ef3-e8cabdaa1034 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:20.817128 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1e0ab-be7a-4113-9ef3-e8cabdaa1034 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:20.817393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1e0ab-be7a-4113-9ef3-e8cabdaa1034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:20.829586 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b37a8-784a-4421-a521-71f1f1fd26e7 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:20.843752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1e0ab-be7a-4113-9ef3-e8cabdaa1034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:20.845210 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1e0ab-be7a-4113-9ef3-e8cabdaa1034 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:20.849276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c263e-3ebb-4875-a263-775626a1ffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:20.849960 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c263e-3ebb-4875-a263-775626a1ffe3 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:20.850302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c263e-3ebb-4875-a263-775626a1ffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:20.850774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c263e-3ebb-4875-a263-775626a1ffe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:20.851448 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c263e-3ebb-4875-a263-775626a1ffe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:20.853365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c263e-3ebb-4875-a263-775626a1ffe3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:20.873048 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 860/1710] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:20.873891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1e0ab-be7a-4113-9ef3-e8cabdaa1034 service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:20.897795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1e0ab-be7a-4113-9ef3-e8cabdaa1034 service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:20.914717 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 851/1711] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:20 2021] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:20.914922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7389-b508-4bf3-8f78-8f79a03143c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:20.915941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7389-b508-4bf3-8f78-8f79a03143c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:20.916751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c263e-3ebb-4875-a263-775626a1ffe3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:20.916997 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7389-b508-4bf3-8f78-8f79a03143c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:20.917848 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7389-b508-4bf3-8f78-8f79a03143c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:20.919572 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd7389-b508-4bf3-8f78-8f79a03143c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:20.925431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd7389-b508-4bf3-8f78-8f79a03143c3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:21.010703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 861/1712] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:20 2021] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:21.018998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7389-b508-4bf3-8f78-8f79a03143c3 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:21.050438 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c263e-3ebb-4875-a263-775626a1ffe3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:21.136078 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7389-b508-4bf3-8f78-8f79a03143c3 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:21.158582 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e36c2-bdd8-4b85-a317-1a2890bbfae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:21.162513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e36c2-bdd8-4b85-a317-1a2890bbfae5 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:21.163959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e36c2-bdd8-4b85-a317-1a2890bbfae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:21.166605 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e36c2-bdd8-4b85-a317-1a2890bbfae5 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:21.167706 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e36c2-bdd8-4b85-a317-1a2890bbfae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:21.174171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e36c2-bdd8-4b85-a317-1a2890bbfae5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:21.227730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 862/1713] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:21 2021] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:21.230698 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e36c2-bdd8-4b85-a317-1a2890bbfae5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:21.254396 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e36c2-bdd8-4b85-a317-1a2890bbfae5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:21.271651 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dce50d-abcd-412e-9d42-90ac74cfc0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:21.274097 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dce50d-abcd-412e-9d42-90ac74cfc0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:21.275835 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dce50d-abcd-412e-9d42-90ac74cfc0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:21.276256 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dce50d-abcd-412e-9d42-90ac74cfc0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:21.279429 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dce50d-abcd-412e-9d42-90ac74cfc0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:21.283785 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dce50d-abcd-412e-9d42-90ac74cfc0f5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:21.295418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be587-2cab-4d6f-87c7-a27341b40142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:21.296321 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be587-2cab-4d6f-87c7-a27341b40142 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:21.298151 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be587-2cab-4d6f-87c7-a27341b40142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:21.299177 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be587-2cab-4d6f-87c7-a27341b40142 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:21.300493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861be587-2cab-4d6f-87c7-a27341b40142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:21.329747 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 863/1714] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:21 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:21.329975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861be587-2cab-4d6f-87c7-a27341b40142 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:21.331808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dce50d-abcd-412e-9d42-90ac74cfc0f5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:21.374454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dce50d-abcd-412e-9d42-90ac74cfc0f5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:21.406248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc194e4d-afe2-4bfa-aea9-57e94541bf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:21.413959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc194e4d-afe2-4bfa-aea9-57e94541bf14 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:21.414240 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc194e4d-afe2-4bfa-aea9-57e94541bf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:21.415222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc194e4d-afe2-4bfa-aea9-57e94541bf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:21.419873 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc194e4d-afe2-4bfa-aea9-57e94541bf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:21.420021 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 852/1715] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:20 2021] POST /identity/v3/users => generated 294 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:01:21.422324 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be587-2cab-4d6f-87c7-a27341b40142 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:21.426919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc194e4d-afe2-4bfa-aea9-57e94541bf14 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:21.472601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be587-2cab-4d6f-87c7-a27341b40142 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:21.488409 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 864/1716] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:21 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:21.491646 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc194e4d-afe2-4bfa-aea9-57e94541bf14 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:21.494679 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37283b-b244-4520-8d7f-f929fad1ad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:21.496114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-bc194e4d-afe2-4bfa-aea9-57e94541bf14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:21.497838 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37283b-b244-4520-8d7f-f929fad1ad5f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:21.500171 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37283b-b244-4520-8d7f-f929fad1ad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:21.500469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37283b-b244-4520-8d7f-f929fad1ad5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:21.501265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37283b-b244-4520-8d7f-f929fad1ad5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:21.509145 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37283b-b244-4520-8d7f-f929fad1ad5f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:21.550924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc194e4d-afe2-4bfa-aea9-57e94541bf14 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:21.559101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 853/1717] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:21 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:21.559101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37283b-b244-4520-8d7f-f929fad1ad5f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:21.567139 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:21.573184 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:21.573502 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:21.577370 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d admin admin] PATH_INFO: `/v3/projects/77fdc6c2d9d84f99a7dfa0d697a32961` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:21.580745 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=77fdc6c2d9d84f99a7dfa0d697a32961)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:21.585729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:21.594023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37283b-b244-4520-8d7f-f929fad1ad5f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:21.618970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ef28e-88c5-48ea-9102-cc3cfca592b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:21.621834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ef28e-88c5-48ea-9102-cc3cfca592b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:21.622121 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ef28e-88c5-48ea-9102-cc3cfca592b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:21.622405 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ef28e-88c5-48ea-9102-cc3cfca592b3 admin admin] PATH_INFO: `/v3/projects/b452430f1fe141f6bb51d1d36198f222/users/6b6db48e16de4413b7b971269801a756/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:21.688469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ef28e-88c5-48ea-9102-cc3cfca592b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b452430f1fe141f6bb51d1d36198f222, user_id=6b6db48e16de4413b7b971269801a756, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:21.695773 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ef28e-88c5-48ea-9102-cc3cfca592b3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:21.724178 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 854/1718] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:21 2021] PUT /identity/v3/projects/b452430f1fe141f6bb51d1d36198f222/users/6b6db48e16de4413b7b971269801a756/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:21.725096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ef28e-88c5-48ea-9102-cc3cfca592b3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:21.750565 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77fdc6c2d9d84f99a7dfa0d697a32961', 'request_id': 'req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:21.764632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77fdc6c2d9d84f99a7dfa0d697a32961', 'request_id': 'req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:21.779777 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77fdc6c2d9d84f99a7dfa0d697a32961', 'request_id': 'req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:21.810556 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d admin admin] The token cache is being invalidate because project 77fdc6c2d9d84f99a7dfa0d697a32961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:21.810851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:21.812340 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d6e8aa08-af3f-4e37-ad40-9bbb0238fa0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:21.815431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 865/1719] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:21 2021] DELETE /identity/v3/projects/77fdc6c2d9d84f99a7dfa0d697a32961 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:21.817208 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069418c-226d-4e92-b0a0-e4f17ad37384 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:21.819482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069418c-226d-4e92-b0a0-e4f17ad37384 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:21.820260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069418c-226d-4e92-b0a0-e4f17ad37384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:21.885270 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ef28e-88c5-48ea-9102-cc3cfca592b3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:21.888937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-3069418c-226d-4e92-b0a0-e4f17ad37384 None None] MFA Rules not processed for user `6b6db48e16de4413b7b971269801a756`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:21.890807 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-3069418c-226d-4e92-b0a0-e4f17ad37384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:21.899692 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb91c0-e387-4219-94e1-c601dc4d67be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:21.903995 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb91c0-e387-4219-94e1-c601dc4d67be admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:21.904433 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb91c0-e387-4219-94e1-c601dc4d67be admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:21.904940 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb91c0-e387-4219-94e1-c601dc4d67be admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:21.909776 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb91c0-e387-4219-94e1-c601dc4d67be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:21.914079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb91c0-e387-4219-94e1-c601dc4d67be admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:21.960861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 855/1720] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:21 2021] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:21.962095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb91c0-e387-4219-94e1-c601dc4d67be admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:21.964635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-bbeb91c0-e387-4219-94e1-c601dc4d67be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:21.983381 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb91c0-e387-4219-94e1-c601dc4d67be admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:21.990450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1de409-941c-4a96-a73c-22ff8004d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:21.992839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1de409-941c-4a96-a73c-22ff8004d6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:21.993910 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1de409-941c-4a96-a73c-22ff8004d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:21.994317 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1de409-941c-4a96-a73c-22ff8004d6aa admin admin] PATH_INFO: `/v3/users/df212e27c76e47b6b4cd4a1e89b57755` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:21.995950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1de409-941c-4a96-a73c-22ff8004d6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=df212e27c76e47b6b4cd4a1e89b57755)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:21.999170 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1de409-941c-4a96-a73c-22ff8004d6aa admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:22.034211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 866/1721] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:21 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:22.035107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069418c-226d-4e92-b0a0-e4f17ad37384 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:22.040978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-3069418c-226d-4e92-b0a0-e4f17ad37384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:22.072189 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069418c-226d-4e92-b0a0-e4f17ad37384 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:22.091703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ae393-8915-45d8-b471-a549349f1f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:22.094660 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ae393-8915-45d8-b471-a549349f1f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:22.095721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ae393-8915-45d8-b471-a549349f1f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:22.096361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ae393-8915-45d8-b471-a549349f1f9d admin admin] PATH_INFO: `/v3/projects/21126171942c439ab1c1c9a541858c9b/users/a4cf6695016641baba742b8cf01d1648/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:22.104001 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-fe1de409-941c-4a96-a73c-22ff8004d6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df212e27c76e47b6b4cd4a1e89b57755'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:22.104957 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-fe1de409-941c-4a96-a73c-22ff8004d6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df212e27c76e47b6b4cd4a1e89b57755'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:22.118405 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-fe1de409-941c-4a96-a73c-22ff8004d6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df212e27c76e47b6b4cd4a1e89b57755'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:22.120014 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-fe1de409-941c-4a96-a73c-22ff8004d6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df212e27c76e47b6b4cd4a1e89b57755'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:22.138769 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-fe1de409-941c-4a96-a73c-22ff8004d6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df212e27c76e47b6b4cd4a1e89b57755'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:22.156322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ae393-8915-45d8-b471-a549349f1f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=21126171942c439ab1c1c9a541858c9b, user_id=a4cf6695016641baba742b8cf01d1648, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:22.167454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ae393-8915-45d8-b471-a549349f1f9d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:22.180411 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 856/1722] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:21 2021] DELETE /identity/v3/users/df212e27c76e47b6b4cd4a1e89b57755 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:22.250460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 867/1723] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:22 2021] PUT /identity/v3/projects/21126171942c439ab1c1c9a541858c9b/users/a4cf6695016641baba742b8cf01d1648/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:22.263603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399cfb3-8b64-429f-ae67-7fe78694ed0b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:22.264024 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399cfb3-8b64-429f-ae67-7fe78694ed0b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:22.264410 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399cfb3-8b64-429f-ae67-7fe78694ed0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:22.325387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-c399cfb3-8b64-429f-ae67-7fe78694ed0b None None] MFA Rules not processed for user `a4cf6695016641baba742b8cf01d1648`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:22.332511 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c399cfb3-8b64-429f-ae67-7fe78694ed0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:22.470567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0a1d5-6368-41ef-ac1a-db9bfbaefd8b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:22.470934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0a1d5-6368-41ef-ac1a-db9bfbaefd8b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:22.471444 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0a1d5-6368-41ef-ac1a-db9bfbaefd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:22.577937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-7de0a1d5-6368-41ef-ac1a-db9bfbaefd8b None None] MFA Rules not processed for user `0e134083351e4493b2a05bea95233f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:22.580209 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7de0a1d5-6368-41ef-ac1a-db9bfbaefd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:22.696354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 857/1724] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:22 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:22.698066 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399cfb3-8b64-429f-ae67-7fe78694ed0b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:22.704953 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c399cfb3-8b64-429f-ae67-7fe78694ed0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:22.852884 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 868/1725] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Nov 8 11:01:22 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:23.021812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0a1d5-6368-41ef-ac1a-db9bfbaefd8b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:23.024260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7de0a1d5-6368-41ef-ac1a-db9bfbaefd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:23.183683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399cfb3-8b64-429f-ae67-7fe78694ed0b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:23.195326 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c1095-b57d-4ff1-87a8-83a3d8f56416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:23.197015 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c1095-b57d-4ff1-87a8-83a3d8f56416 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:23.198028 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c1095-b57d-4ff1-87a8-83a3d8f56416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:23.198503 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c1095-b57d-4ff1-87a8-83a3d8f56416 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:23.202331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c1095-b57d-4ff1-87a8-83a3d8f56416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:23.210131 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c1095-b57d-4ff1-87a8-83a3d8f56416 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:23.364138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 858/1726] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:22 2021] POST /identity/v3/projects => generated 385 bytes in 667 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:23.365028 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c1095-b57d-4ff1-87a8-83a3d8f56416 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:23.376463 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b08c1095-b57d-4ff1-87a8-83a3d8f56416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:23.402312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0a1d5-6368-41ef-ac1a-db9bfbaefd8b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:23.664342 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42fcf4-64e9-4ace-b19a-187eb6f84b29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:23.665619 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42fcf4-64e9-4ace-b19a-187eb6f84b29 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:23.666017 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42fcf4-64e9-4ace-b19a-187eb6f84b29 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:23.666406 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42fcf4-64e9-4ace-b19a-187eb6f84b29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:23.686312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-db42fcf4-64e9-4ace-b19a-187eb6f84b29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:23.765820 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c1095-b57d-4ff1-87a8-83a3d8f56416 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:23.792543 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dd0a6-8bfd-45a7-aa58-a72228c2e670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:23.793724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dd0a6-8bfd-45a7-aa58-a72228c2e670 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:23.794237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dd0a6-8bfd-45a7-aa58-a72228c2e670 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:23.795567 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dd0a6-8bfd-45a7-aa58-a72228c2e670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:23.810055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42fcf4-64e9-4ace-b19a-187eb6f84b29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:23.811901 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42fcf4-64e9-4ace-b19a-187eb6f84b29 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:23.830386 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 869/1727] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:23 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 810 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:23.831996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42fcf4-64e9-4ace-b19a-187eb6f84b29 service nova] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:23.832334 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dd0a6-8bfd-45a7-aa58-a72228c2e670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:23.839046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dd0a6-8bfd-45a7-aa58-a72228c2e670 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:23.872038 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 859/1728] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:23 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:23.999564 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42fcf4-64e9-4ace-b19a-187eb6f84b29 service nova] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:24.007564 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7820b3-af3d-4ee1-82ec-1a12ec4ca7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:24.009362 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7820b3-af3d-4ee1-82ec-1a12ec4ca7ef admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:24.009929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7820b3-af3d-4ee1-82ec-1a12ec4ca7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:24.010219 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7820b3-af3d-4ee1-82ec-1a12ec4ca7ef admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:24.010990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7820b3-af3d-4ee1-82ec-1a12ec4ca7ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:24.013753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7820b3-af3d-4ee1-82ec-1a12ec4ca7ef admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:24.055096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dd0a6-8bfd-45a7-aa58-a72228c2e670 service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:24.061072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 870/1729] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:23 2021] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:24.096727 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dd0a6-8bfd-45a7-aa58-a72228c2e670 service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:24.112493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1625e00-0b03-471a-afa0-879cdf47ac50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:24.130702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1625e00-0b03-471a-afa0-879cdf47ac50 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:24.134195 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1625e00-0b03-471a-afa0-879cdf47ac50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:24.134718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1625e00-0b03-471a-afa0-879cdf47ac50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:24.143424 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1625e00-0b03-471a-afa0-879cdf47ac50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:24.150285 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1625e00-0b03-471a-afa0-879cdf47ac50 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:24.191455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 860/1730] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:24 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:24.197457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7820b3-af3d-4ee1-82ec-1a12ec4ca7ef admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:24.245116 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7820b3-af3d-4ee1-82ec-1a12ec4ca7ef admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:24.275737 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fec6a-00ce-440d-80b0-578bd773cb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:24.276829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fec6a-00ce-440d-80b0-578bd773cb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:24.277211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fec6a-00ce-440d-80b0-578bd773cb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:24.278171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fec6a-00ce-440d-80b0-578bd773cb72 admin admin] PATH_INFO: `/v3/projects/64fac972fc644b11a9be7c67ecbd23fa/users/e212b5aa1dca4792b03a61333a524952/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:24.335087 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1625e00-0b03-471a-afa0-879cdf47ac50 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:24.337384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d1625e00-0b03-471a-afa0-879cdf47ac50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:24.374483 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1625e00-0b03-471a-afa0-879cdf47ac50 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:24.384755 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fec6a-00ce-440d-80b0-578bd773cb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fac972fc644b11a9be7c67ecbd23fa, user_id=e212b5aa1dca4792b03a61333a524952, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:24.390528 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fec6a-00ce-440d-80b0-578bd773cb72 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:24.426356 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6ce09-0a95-41e5-8619-85c2583bc00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:24.427749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6ce09-0a95-41e5-8619-85c2583bc00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:24.428111 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6ce09-0a95-41e5-8619-85c2583bc00f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:24.428452 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6ce09-0a95-41e5-8619-85c2583bc00f admin admin] PATH_INFO: `/v3/projects/1afe8bcdc210478595d5e0735ab6fef2` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:24.435205 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6ce09-0a95-41e5-8619-85c2583bc00f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1afe8bcdc210478595d5e0735ab6fef2)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:24.438312 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6ce09-0a95-41e5-8619-85c2583bc00f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:24.475660 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 871/1731] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:24 2021] PUT /identity/v3/projects/64fac972fc644b11a9be7c67ecbd23fa/users/e212b5aa1dca4792b03a61333a524952/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:24.488640 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fec6a-00ce-440d-80b0-578bd773cb72 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:24.745196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-65c6ce09-0a95-41e5-8619-85c2583bc00f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1afe8bcdc210478595d5e0735ab6fef2', 'request_id': 'req-65c6ce09-0a95-41e5-8619-85c2583bc00f'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:24.758205 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-65c6ce09-0a95-41e5-8619-85c2583bc00f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1afe8bcdc210478595d5e0735ab6fef2', 'request_id': 'req-65c6ce09-0a95-41e5-8619-85c2583bc00f'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:24.777628 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fec6a-00ce-440d-80b0-578bd773cb72 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:24.796416 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-65c6ce09-0a95-41e5-8619-85c2583bc00f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1afe8bcdc210478595d5e0735ab6fef2', 'request_id': 'req-65c6ce09-0a95-41e5-8619-85c2583bc00f'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:24.852056 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-65c6ce09-0a95-41e5-8619-85c2583bc00f admin admin] The token cache is being invalidate because project 1afe8bcdc210478595d5e0735ab6fef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:24.853940 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-65c6ce09-0a95-41e5-8619-85c2583bc00f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:24.858162 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-65c6ce09-0a95-41e5-8619-85c2583bc00f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:24.869014 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 861/1732] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:24 2021] DELETE /identity/v3/projects/1afe8bcdc210478595d5e0735ab6fef2 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:24.882670 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6411dcd-8fdd-4754-ab96-bba02f4fb708 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:24.883550 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6411dcd-8fdd-4754-ab96-bba02f4fb708 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:24.886074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6411dcd-8fdd-4754-ab96-bba02f4fb708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:24.977902 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-b6411dcd-8fdd-4754-ab96-bba02f4fb708 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:24.991811 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b6411dcd-8fdd-4754-ab96-bba02f4fb708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:25.052850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1514d5-6fbf-456b-a114-44ae5eef029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:25.053891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1514d5-6fbf-456b-a114-44ae5eef029e admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:25.054235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1514d5-6fbf-456b-a114-44ae5eef029e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:25.055453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1514d5-6fbf-456b-a114-44ae5eef029e admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:25.056420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1514d5-6fbf-456b-a114-44ae5eef029e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:25.058774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1514d5-6fbf-456b-a114-44ae5eef029e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:25.085182 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 872/1733] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:24 2021] GET /identity/v3/roles => generated 1420 bytes in 597 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:25.086443 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1514d5-6fbf-456b-a114-44ae5eef029e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:25.093974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ed1514d5-6fbf-456b-a114-44ae5eef029e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:25.122221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1514d5-6fbf-456b-a114-44ae5eef029e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:25.131575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076e960-ff74-4a30-a085-a64ace84d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:25.132503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076e960-ff74-4a30-a085-a64ace84d612 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:25.133228 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076e960-ff74-4a30-a085-a64ace84d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:25.133348 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076e960-ff74-4a30-a085-a64ace84d612 admin admin] PATH_INFO: `/v3/projects/64fac972fc644b11a9be7c67ecbd23fa/users/e212b5aa1dca4792b03a61333a524952/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:25.137022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076e960-ff74-4a30-a085-a64ace84d612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fac972fc644b11a9be7c67ecbd23fa, user_id=e212b5aa1dca4792b03a61333a524952, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:25.140377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076e960-ff74-4a30-a085-a64ace84d612 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:25.155962 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 873/1734] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:25 2021] PUT /identity/v3/projects/64fac972fc644b11a9be7c67ecbd23fa/users/e212b5aa1dca4792b03a61333a524952/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:25.168054 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f38bd-6d64-49eb-88ad-3770fbaeed72 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:25.168434 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f38bd-6d64-49eb-88ad-3770fbaeed72 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:25.168751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f38bd-6d64-49eb-88ad-3770fbaeed72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:25.229332 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-324f38bd-6d64-49eb-88ad-3770fbaeed72 None None] MFA Rules not processed for user `e212b5aa1dca4792b03a61333a524952`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:25.229332 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-324f38bd-6d64-49eb-88ad-3770fbaeed72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:25.281352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 862/1735] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:25.290158 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c12193-c4ce-4e21-b15b-bbc5b3a57459 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:25.290764 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c12193-c4ce-4e21-b15b-bbc5b3a57459 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:25.291414 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c12193-c4ce-4e21-b15b-bbc5b3a57459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:25.344112 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-83c12193-c4ce-4e21-b15b-bbc5b3a57459 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:25.346140 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-83c12193-c4ce-4e21-b15b-bbc5b3a57459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:25.467710 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 874/1736] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:25 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:25.475212 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f38bd-6d64-49eb-88ad-3770fbaeed72 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:25.479925 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-324f38bd-6d64-49eb-88ad-3770fbaeed72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:25.587109 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 863/1737] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:25.592141 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c12193-c4ce-4e21-b15b-bbc5b3a57459 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:25.616007 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c12193-c4ce-4e21-b15b-bbc5b3a57459 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:25.628351 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af5f0-c992-400f-b701-c753309602ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:25.630092 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af5f0-c992-400f-b701-c753309602ac admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:25.630583 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af5f0-c992-400f-b701-c753309602ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:25.631785 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af5f0-c992-400f-b701-c753309602ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:25.635097 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4af5f0-c992-400f-b701-c753309602ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:25.636024 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4af5f0-c992-400f-b701-c753309602ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:25.644607 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4af5f0-c992-400f-b701-c753309602ac admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:25.690832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 864/1738] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:25.691883 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af5f0-c992-400f-b701-c753309602ac admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:25.732635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af5f0-c992-400f-b701-c753309602ac admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:25.737354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f38bd-6d64-49eb-88ad-3770fbaeed72 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:25.749571 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210b8b3-82df-42e2-9cfd-02fe9bb0ece2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:25.749819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8d8ad-f88d-47c5-b5b6-417458163427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:25.750257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210b8b3-82df-42e2-9cfd-02fe9bb0ece2 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:25.750467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8d8ad-f88d-47c5-b5b6-417458163427 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:25.750567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210b8b3-82df-42e2-9cfd-02fe9bb0ece2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:25.750748 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8d8ad-f88d-47c5-b5b6-417458163427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:25.750892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210b8b3-82df-42e2-9cfd-02fe9bb0ece2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:25.751331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8d8ad-f88d-47c5-b5b6-417458163427 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:25.752704 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8d8ad-f88d-47c5-b5b6-417458163427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:25.764937 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8d8ad-f88d-47c5-b5b6-417458163427 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:25.784705 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210b8b3-82df-42e2-9cfd-02fe9bb0ece2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:25.787894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210b8b3-82df-42e2-9cfd-02fe9bb0ece2 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:25.825995 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 875/1739] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:25 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:25.859152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 865/1740] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:25 2021] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:25.864372 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210b8b3-82df-42e2-9cfd-02fe9bb0ece2 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:25.901140 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210b8b3-82df-42e2-9cfd-02fe9bb0ece2 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:26.158468 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c11eb-fbbc-493b-a357-5e0ac23b7f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:26.159742 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c11eb-fbbc-493b-a357-5e0ac23b7f61 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:26.160376 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c11eb-fbbc-493b-a357-5e0ac23b7f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:26.160993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c11eb-fbbc-493b-a357-5e0ac23b7f61 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:26.166241 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c11eb-fbbc-493b-a357-5e0ac23b7f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:26.176253 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c11eb-fbbc-493b-a357-5e0ac23b7f61 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:26.244398 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 876/1741] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:25 2021] POST /identity/v3/users => generated 293 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:01:26.248339 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8d8ad-f88d-47c5-b5b6-417458163427 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:26.298342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8d8ad-f88d-47c5-b5b6-417458163427 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:26.370864 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f273f-d6a8-41bd-b6f9-3fcd3e958c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:26.375152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f273f-d6a8-41bd-b6f9-3fcd3e958c04 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:26.377722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f273f-d6a8-41bd-b6f9-3fcd3e958c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:26.380506 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f273f-d6a8-41bd-b6f9-3fcd3e958c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:26.392616 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f273f-d6a8-41bd-b6f9-3fcd3e958c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:26.405911 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f273f-d6a8-41bd-b6f9-3fcd3e958c04 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:26.483970 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c11eb-fbbc-493b-a357-5e0ac23b7f61 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:26.485951 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-2f9c11eb-fbbc-493b-a357-5e0ac23b7f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:26.497676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 866/1742] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:26 2021] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:26.499348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f273f-d6a8-41bd-b6f9-3fcd3e958c04 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:26.517791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c11eb-fbbc-493b-a357-5e0ac23b7f61 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:26.541534 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfd1fb-1100-4846-9bb2-ea30bb2ee7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:26.543179 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd1fb-1100-4846-9bb2-ea30bb2ee7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:26.544729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd1fb-1100-4846-9bb2-ea30bb2ee7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:26.545115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd1fb-1100-4846-9bb2-ea30bb2ee7bf admin admin] PATH_INFO: `/v3/users/6b6db48e16de4413b7b971269801a756` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:26.548822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfd1fb-1100-4846-9bb2-ea30bb2ee7bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6db48e16de4413b7b971269801a756)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:26.552076 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfd1fb-1100-4846-9bb2-ea30bb2ee7bf admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:26.560924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f273f-d6a8-41bd-b6f9-3fcd3e958c04 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:26.584207 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c63685-3571-4077-ac4f-2e9a6f350100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:26.587021 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c63685-3571-4077-ac4f-2e9a6f350100 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:26.588058 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c63685-3571-4077-ac4f-2e9a6f350100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:26.589203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c63685-3571-4077-ac4f-2e9a6f350100 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:26.591622 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c63685-3571-4077-ac4f-2e9a6f350100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:26.595051 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c63685-3571-4077-ac4f-2e9a6f350100 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:26.622641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 867/1743] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:26 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:26.624545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c63685-3571-4077-ac4f-2e9a6f350100 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:26.660146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c63685-3571-4077-ac4f-2e9a6f350100 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:26.688289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd2a1a-29b8-49b8-9e06-e04f083914b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:26.689891 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd2a1a-29b8-49b8-9e06-e04f083914b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:26.697422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd2a1a-29b8-49b8-9e06-e04f083914b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:26.698171 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd2a1a-29b8-49b8-9e06-e04f083914b6 admin admin] PATH_INFO: `/v3/projects/ad8ae628cb1e4b65be28688644bb01fd/users/ff3d85de8ab54556a6cf8fbad2958219/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:26.708770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1dcfd1fb-1100-4846-9bb2-ea30bb2ee7bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6db48e16de4413b7b971269801a756'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:26.710369 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1dcfd1fb-1100-4846-9bb2-ea30bb2ee7bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6db48e16de4413b7b971269801a756'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:26.740364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1dcfd1fb-1100-4846-9bb2-ea30bb2ee7bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6db48e16de4413b7b971269801a756'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:26.741643 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1dcfd1fb-1100-4846-9bb2-ea30bb2ee7bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6db48e16de4413b7b971269801a756'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:26.764721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd2a1a-29b8-49b8-9e06-e04f083914b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8ae628cb1e4b65be28688644bb01fd, user_id=ff3d85de8ab54556a6cf8fbad2958219, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:26.771281 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd2a1a-29b8-49b8-9e06-e04f083914b6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:26.785427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1dcfd1fb-1100-4846-9bb2-ea30bb2ee7bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6db48e16de4413b7b971269801a756'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:26.821138 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 877/1744] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:26 2021] DELETE /identity/v3/users/6b6db48e16de4413b7b971269801a756 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:26.833902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb37ba0-6870-43e9-ba9c-1e07498d73b0 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:26.834553 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb37ba0-6870-43e9-ba9c-1e07498d73b0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:26.835082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb37ba0-6870-43e9-ba9c-1e07498d73b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:26.840177 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 868/1745] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:26 2021] PUT /identity/v3/projects/ad8ae628cb1e4b65be28688644bb01fd/users/ff3d85de8ab54556a6cf8fbad2958219/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:26.859034 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a3c59-4af9-4ea9-8f79-ed244bd8f700 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:26.859494 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a3c59-4af9-4ea9-8f79-ed244bd8f700 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:26.860099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a3c59-4af9-4ea9-8f79-ed244bd8f700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:26.885144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-9cb37ba0-6870-43e9-ba9c-1e07498d73b0 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:26.886936 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9cb37ba0-6870-43e9-ba9c-1e07498d73b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:26.936661 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-692a3c59-4af9-4ea9-8f79-ed244bd8f700 None None] MFA Rules not processed for user `ff3d85de8ab54556a6cf8fbad2958219`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:26.938683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-692a3c59-4af9-4ea9-8f79-ed244bd8f700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:26.958205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 878/1746] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:26.971876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb37ba0-6870-43e9-ba9c-1e07498d73b0 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:26.974063 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9cb37ba0-6870-43e9-ba9c-1e07498d73b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:27.097385 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb37ba0-6870-43e9-ba9c-1e07498d73b0 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:27.114818 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 869/1747] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:26 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:27.114983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061fafe-88ca-4843-86e5-ba78cb4dc8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:27.114983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061fafe-88ca-4843-86e5-ba78cb4dc8cb service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:27.114983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061fafe-88ca-4843-86e5-ba78cb4dc8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:27.114983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061fafe-88ca-4843-86e5-ba78cb4dc8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:27.133500 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a3c59-4af9-4ea9-8f79-ed244bd8f700 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:27.136185 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061fafe-88ca-4843-86e5-ba78cb4dc8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:27.139046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-692a3c59-4af9-4ea9-8f79-ed244bd8f700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:27.142374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061fafe-88ca-4843-86e5-ba78cb4dc8cb service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:27.160857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 879/1748] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:27.162671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061fafe-88ca-4843-86e5-ba78cb4dc8cb service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:27.164734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6061fafe-88ca-4843-86e5-ba78cb4dc8cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:27.182086 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061fafe-88ca-4843-86e5-ba78cb4dc8cb service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:27.187829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287e9d-023b-47da-a983-4bba2f4b82db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:27.189065 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287e9d-023b-47da-a983-4bba2f4b82db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:27.189496 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287e9d-023b-47da-a983-4bba2f4b82db admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:27.190035 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287e9d-023b-47da-a983-4bba2f4b82db admin admin] PATH_INFO: `/v3/users/a4cf6695016641baba742b8cf01d1648` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:27.192077 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92287e9d-023b-47da-a983-4bba2f4b82db admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cf6695016641baba742b8cf01d1648)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:27.195034 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92287e9d-023b-47da-a983-4bba2f4b82db admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:27.247912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a3c59-4af9-4ea9-8f79-ed244bd8f700 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:27.256261 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66b57a-ef05-471c-b277-cf533907e902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:27.257606 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66b57a-ef05-471c-b277-cf533907e902 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:27.258309 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66b57a-ef05-471c-b277-cf533907e902 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:27.259160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66b57a-ef05-471c-b277-cf533907e902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:27.262396 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-92287e9d-023b-47da-a983-4bba2f4b82db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cf6695016641baba742b8cf01d1648'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.263887 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-92287e9d-023b-47da-a983-4bba2f4b82db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cf6695016641baba742b8cf01d1648'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.278920 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66b57a-ef05-471c-b277-cf533907e902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:27.279183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-92287e9d-023b-47da-a983-4bba2f4b82db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cf6695016641baba742b8cf01d1648'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.280488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-92287e9d-023b-47da-a983-4bba2f4b82db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cf6695016641baba742b8cf01d1648'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.282986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66b57a-ef05-471c-b277-cf533907e902 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:27.297259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-92287e9d-023b-47da-a983-4bba2f4b82db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cf6695016641baba742b8cf01d1648'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.301764 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 870/1749] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:27 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:01:27.313822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 880/1750] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:27 2021] DELETE /identity/v3/users/a4cf6695016641baba742b8cf01d1648 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:27.318588 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9fdef-8a50-4eea-85fd-4b48c13832b2 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:27.318751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9fdef-8a50-4eea-85fd-4b48c13832b2 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:27.319036 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9fdef-8a50-4eea-85fd-4b48c13832b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:27.327328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287e9d-023b-47da-a983-4bba2f4b82db admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:27.329321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-92287e9d-023b-47da-a983-4bba2f4b82db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:27.340899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-6bb9fdef-8a50-4eea-85fd-4b48c13832b2 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:27.342432 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6bb9fdef-8a50-4eea-85fd-4b48c13832b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:27.410330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287e9d-023b-47da-a983-4bba2f4b82db admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:27.416483 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 871/1751] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:27.419582 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766666e-832e-463d-85e8-6db88ca1fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:27.420650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766666e-832e-463d-85e8-6db88ca1fbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:27.420932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766666e-832e-463d-85e8-6db88ca1fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:27.421197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766666e-832e-463d-85e8-6db88ca1fbf8 admin admin] PATH_INFO: `/v3/users/ff3d85de8ab54556a6cf8fbad2958219` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:27.422820 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766666e-832e-463d-85e8-6db88ca1fbf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff3d85de8ab54556a6cf8fbad2958219)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:27.425100 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766666e-832e-463d-85e8-6db88ca1fbf8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:27.433982 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac098c4-a25f-4208-a8cf-c3db6bf55336 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:27.434273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac098c4-a25f-4208-a8cf-c3db6bf55336 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:27.434567 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac098c4-a25f-4208-a8cf-c3db6bf55336 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:27.436858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 872/1752] 10.222.0.20 () {54 vars in 921 bytes} [Mon Nov 8 11:01:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 11:01:27.437748 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac098c4-a25f-4208-a8cf-c3db6bf55336 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:27.439772 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-eac098c4-a25f-4208-a8cf-c3db6bf55336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:27.507934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-c766666e-832e-463d-85e8-6db88ca1fbf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff3d85de8ab54556a6cf8fbad2958219'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.509155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-c766666e-832e-463d-85e8-6db88ca1fbf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff3d85de8ab54556a6cf8fbad2958219'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.519050 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-c766666e-832e-463d-85e8-6db88ca1fbf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff3d85de8ab54556a6cf8fbad2958219'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.519644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-c766666e-832e-463d-85e8-6db88ca1fbf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff3d85de8ab54556a6cf8fbad2958219'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.523020 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac098c4-a25f-4208-a8cf-c3db6bf55336 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:27.526964 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247aecb-c55d-46da-ace5-03c7a581339f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:27.527831 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247aecb-c55d-46da-ace5-03c7a581339f service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:27.528210 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247aecb-c55d-46da-ace5-03c7a581339f service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:27.528714 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247aecb-c55d-46da-ace5-03c7a581339f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:27.531254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e247aecb-c55d-46da-ace5-03c7a581339f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:27.543976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-c766666e-832e-463d-85e8-6db88ca1fbf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff3d85de8ab54556a6cf8fbad2958219'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.544760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247aecb-c55d-46da-ace5-03c7a581339f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:27.546358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247aecb-c55d-46da-ace5-03c7a581339f service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:27.556784 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 873/1753] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:27.560552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 881/1754] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:27 2021] DELETE /identity/v3/users/ff3d85de8ab54556a6cf8fbad2958219 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:27.560705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa2786-9902-4f18-b2f5-df5adb4de2d3 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:27.560705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa2786-9902-4f18-b2f5-df5adb4de2d3 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:27.560705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa2786-9902-4f18-b2f5-df5adb4de2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:27.562682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca741c-45bb-4011-bb9f-cacf1c612355 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:27.563054 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca741c-45bb-4011-bb9f-cacf1c612355 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:27.563360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca741c-45bb-4011-bb9f-cacf1c612355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:27.586294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-ceca741c-45bb-4011-bb9f-cacf1c612355 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:27.587956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-76aa2786-9902-4f18-b2f5-df5adb4de2d3 None None] MFA Rules not processed for user `d3421cf1bbb24423a2f24c4667adfdda`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:27.588086 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ceca741c-45bb-4011-bb9f-cacf1c612355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:27.589585 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-76aa2786-9902-4f18-b2f5-df5adb4de2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:27.689721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 874/1755] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Nov 8 11:01:27 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:27.693276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 882/1756] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:27.705260 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa2786-9902-4f18-b2f5-df5adb4de2d3 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:27.707518 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-76aa2786-9902-4f18-b2f5-df5adb4de2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:27.708744 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca741c-45bb-4011-bb9f-cacf1c612355 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:27.711282 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ceca741c-45bb-4011-bb9f-cacf1c612355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:27.722011 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa2786-9902-4f18-b2f5-df5adb4de2d3 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:27.733420 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bcdf7-8bb5-44e5-ae3f-2ac03b1351fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:27.734226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bcdf7-8bb5-44e5-ae3f-2ac03b1351fd service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:27.734514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bcdf7-8bb5-44e5-ae3f-2ac03b1351fd service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:27.734787 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bcdf7-8bb5-44e5-ae3f-2ac03b1351fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:27.749552 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bcdf7-8bb5-44e5-ae3f-2ac03b1351fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:27.752589 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bcdf7-8bb5-44e5-ae3f-2ac03b1351fd service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:27.777423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 875/1757] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:27 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:27.779103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca741c-45bb-4011-bb9f-cacf1c612355 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:27.779281 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bcdf7-8bb5-44e5-ae3f-2ac03b1351fd service nova] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:27.781168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-457bcdf7-8bb5-44e5-ae3f-2ac03b1351fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:27.783592 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9e9f7-10b5-459b-bc4a-45aa5a74282c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:27.784472 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9e9f7-10b5-459b-bc4a-45aa5a74282c service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:27.784896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9e9f7-10b5-459b-bc4a-45aa5a74282c service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:27.785378 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9e9f7-10b5-459b-bc4a-45aa5a74282c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:27.796712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9e9f7-10b5-459b-bc4a-45aa5a74282c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:27.800767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9e9f7-10b5-459b-bc4a-45aa5a74282c service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:27.803145 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bcdf7-8bb5-44e5-ae3f-2ac03b1351fd service nova] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:27.810625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:27.811849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 883/1758] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:01:27.812500 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:27.812793 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:27.813067 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] PATH_INFO: `/v3/projects/b452430f1fe141f6bb51d1d36198f222` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:27.814366 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b452430f1fe141f6bb51d1d36198f222)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:27.816509 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:27.902853 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b452430f1fe141f6bb51d1d36198f222', 'request_id': 'req-e1b8a62d-d765-4f88-87bc-3113cffc3b86'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.912566 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b452430f1fe141f6bb51d1d36198f222', 'request_id': 'req-e1b8a62d-d765-4f88-87bc-3113cffc3b86'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.920684 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b452430f1fe141f6bb51d1d36198f222', 'request_id': 'req-e1b8a62d-d765-4f88-87bc-3113cffc3b86'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.942789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] The token cache is being invalidate because project b452430f1fe141f6bb51d1d36198f222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:27.943472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.944207 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:27.946277 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 876/1759] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:27 2021] DELETE /identity/v3/projects/b452430f1fe141f6bb51d1d36198f222 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:27.954068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ba7e-844f-48a6-9802-93c917f7f02a None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:27.954388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ba7e-844f-48a6-9802-93c917f7f02a None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:27.954666 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ba7e-844f-48a6-9802-93c917f7f02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:27.986838 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-50b7ba7e-844f-48a6-9802-93c917f7f02a None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:27.988145 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-50b7ba7e-844f-48a6-9802-93c917f7f02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:27.992190 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:27.993589 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:28.094022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 884/1760] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:28.132557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8a62d-d765-4f88-87bc-3113cffc3b86 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:28.138295 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:28.139404 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:28.139800 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:28.140204 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] PATH_INFO: `/v3/projects/21126171942c439ab1c1c9a541858c9b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:28.141731 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21126171942c439ab1c1c9a541858c9b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:28.143970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:28.149715 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ec6e-e8cd-4a7b-92e2-db4281c7754e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:28.150110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ec6e-e8cd-4a7b-92e2-db4281c7754e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:28.150561 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ec6e-e8cd-4a7b-92e2-db4281c7754e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:28.177505 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-f349ec6e-e8cd-4a7b-92e2-db4281c7754e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:28.179272 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f349ec6e-e8cd-4a7b-92e2-db4281c7754e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:28.193882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 885/1761] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:28.200739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349ec6e-e8cd-4a7b-92e2-db4281c7754e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:28.218174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349ec6e-e8cd-4a7b-92e2-db4281c7754e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:28.222332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21126171942c439ab1c1c9a541858c9b', 'request_id': 'req-3547c625-e354-4df3-aea0-8b33958824f2'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.230683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21126171942c439ab1c1c9a541858c9b', 'request_id': 'req-3547c625-e354-4df3-aea0-8b33958824f2'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.239764 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21126171942c439ab1c1c9a541858c9b', 'request_id': 'req-3547c625-e354-4df3-aea0-8b33958824f2'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.260198 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] The token cache is being invalidate because project 21126171942c439ab1c1c9a541858c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:28.261112 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.261948 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.264533 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 877/1762] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:27 2021] DELETE /identity/v3/projects/21126171942c439ab1c1c9a541858c9b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:28.268358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:28.269737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:28.312289 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad6f4-79cd-44b7-8272-a07c44059574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:28.313516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad6f4-79cd-44b7-8272-a07c44059574 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:28.313799 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad6f4-79cd-44b7-8272-a07c44059574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:28.314073 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad6f4-79cd-44b7-8272-a07c44059574 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:28.315019 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ad6f4-79cd-44b7-8272-a07c44059574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:28.315365 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ad6f4-79cd-44b7-8272-a07c44059574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:28.317334 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ad6f4-79cd-44b7-8272-a07c44059574 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:28.332835 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 886/1763] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:28.333716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad6f4-79cd-44b7-8272-a07c44059574 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:28.335440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8a0ad6f4-79cd-44b7-8272-a07c44059574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:28.348958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad6f4-79cd-44b7-8272-a07c44059574 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:28.349781 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547c625-e354-4df3-aea0-8b33958824f2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:28.353707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:28.354584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:28.354866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:28.355021 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655ce47-c3d2-408b-a1b3-bf5bc780d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:28.355213 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] PATH_INFO: `/v3/projects/ad8ae628cb1e4b65be28688644bb01fd` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:28.355950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655ce47-c3d2-408b-a1b3-bf5bc780d5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:28.356238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655ce47-c3d2-408b-a1b3-bf5bc780d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:28.356506 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655ce47-c3d2-408b-a1b3-bf5bc780d5bf admin admin] PATH_INFO: `/v3/users/e212b5aa1dca4792b03a61333a524952` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:28.356780 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8ae628cb1e4b65be28688644bb01fd)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:28.357773 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655ce47-c3d2-408b-a1b3-bf5bc780d5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e212b5aa1dca4792b03a61333a524952)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:28.358706 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:28.359880 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655ce47-c3d2-408b-a1b3-bf5bc780d5bf admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:28.407760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8ae628cb1e4b65be28688644bb01fd', 'request_id': 'req-a1ef47af-26e8-49c6-8580-e821cf42d28d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.414811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8ae628cb1e4b65be28688644bb01fd', 'request_id': 'req-a1ef47af-26e8-49c6-8580-e821cf42d28d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.421014 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8ae628cb1e4b65be28688644bb01fd', 'request_id': 'req-a1ef47af-26e8-49c6-8580-e821cf42d28d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.421901 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c655ce47-c3d2-408b-a1b3-bf5bc780d5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e212b5aa1dca4792b03a61333a524952'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.422718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c655ce47-c3d2-408b-a1b3-bf5bc780d5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e212b5aa1dca4792b03a61333a524952'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.432166 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c655ce47-c3d2-408b-a1b3-bf5bc780d5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e212b5aa1dca4792b03a61333a524952'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.433024 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c655ce47-c3d2-408b-a1b3-bf5bc780d5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e212b5aa1dca4792b03a61333a524952'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.441484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c655ce47-c3d2-408b-a1b3-bf5bc780d5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e212b5aa1dca4792b03a61333a524952'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.441634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] The token cache is being invalidate because project ad8ae628cb1e4b65be28688644bb01fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:28.441736 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.442535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:28.444579 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 887/1764] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:28 2021] DELETE /identity/v3/projects/ad8ae628cb1e4b65be28688644bb01fd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:28.445482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:28.446879 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:28.472372 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 878/1765] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:28 2021] DELETE /identity/v3/users/e212b5aa1dca4792b03a61333a524952 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:28.473425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c58dde-5a9a-42c2-a531-af588c6fa25b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:28.474006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c58dde-5a9a-42c2-a531-af588c6fa25b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:28.474006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c58dde-5a9a-42c2-a531-af588c6fa25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:28.529713 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-f7c58dde-5a9a-42c2-a531-af588c6fa25b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:28.532925 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f7c58dde-5a9a-42c2-a531-af588c6fa25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:28.548542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef47af-26e8-49c6-8580-e821cf42d28d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:28.612930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 879/1766] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:28.616078 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c559f-ec40-4102-a621-29f6ea1a4173 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:28.617663 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c559f-ec40-4102-a621-29f6ea1a4173 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:28.618229 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c559f-ec40-4102-a621-29f6ea1a4173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:28.676470 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a56466-e861-42f6-8859-535223b78f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:28.677175 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56466-e861-42f6-8859-535223b78f62 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:28.677463 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56466-e861-42f6-8859-535223b78f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:28.677742 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56466-e861-42f6-8859-535223b78f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:28.678469 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a56466-e861-42f6-8859-535223b78f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:28.686056 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-2e1c559f-ec40-4102-a621-29f6ea1a4173 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:28.688718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2e1c559f-ec40-4102-a621-29f6ea1a4173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:28.688873 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a56466-e861-42f6-8859-535223b78f62 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:28.722069 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 880/1767] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:28.728638 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c559f-ec40-4102-a621-29f6ea1a4173 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:28.739704 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c559f-ec40-4102-a621-29f6ea1a4173 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:28.745319 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1e405-184e-4195-959c-f92365216fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:28.746480 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1e405-184e-4195-959c-f92365216fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:28.746765 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1e405-184e-4195-959c-f92365216fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:28.747065 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1e405-184e-4195-959c-f92365216fe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:28.747972 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1e405-184e-4195-959c-f92365216fe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:28.748291 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1e405-184e-4195-959c-f92365216fe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:28.750130 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1e405-184e-4195-959c-f92365216fe1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:28.765373 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 881/1768] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:28.770498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1e405-184e-4195-959c-f92365216fe1 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:28.787435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1e405-184e-4195-959c-f92365216fe1 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:28.787665 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 888/1769] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:28 2021] POST /identity/v3/projects => generated 385 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:28.793112 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a56466-e861-42f6-8859-535223b78f62 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:28.886959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a56466-e861-42f6-8859-535223b78f62 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:28.895000 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547da19c-ddea-4a68-b1c8-4eb72c56620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:28.896291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547da19c-ddea-4a68-b1c8-4eb72c56620c admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:28.896650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547da19c-ddea-4a68-b1c8-4eb72c56620c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:28.896930 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547da19c-ddea-4a68-b1c8-4eb72c56620c admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:28.898275 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547da19c-ddea-4a68-b1c8-4eb72c56620c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:28.900046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547da19c-ddea-4a68-b1c8-4eb72c56620c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:28.932658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64d4b-5259-4e70-8bbe-842e179ae27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:28.933533 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64d4b-5259-4e70-8bbe-842e179ae27f admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:28.933711 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64d4b-5259-4e70-8bbe-842e179ae27f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:28.934303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64d4b-5259-4e70-8bbe-842e179ae27f admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:28.934927 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb64d4b-5259-4e70-8bbe-842e179ae27f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:28.941071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb64d4b-5259-4e70-8bbe-842e179ae27f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:28.952523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 889/1770] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:28 2021] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:01:28.954833 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547da19c-ddea-4a68-b1c8-4eb72c56620c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:28.967337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547da19c-ddea-4a68-b1c8-4eb72c56620c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:28.990575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c386eb6-bc31-48a2-96fb-fed4dc5c5461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:28.992068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c386eb6-bc31-48a2-96fb-fed4dc5c5461 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:28.992667 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c386eb6-bc31-48a2-96fb-fed4dc5c5461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:28.993320 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c386eb6-bc31-48a2-96fb-fed4dc5c5461 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:28.994528 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c386eb6-bc31-48a2-96fb-fed4dc5c5461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:28.996823 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c386eb6-bc31-48a2-96fb-fed4dc5c5461 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:29.020924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 890/1771] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:28 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:29.028199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c386eb6-bc31-48a2-96fb-fed4dc5c5461 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:29.028975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 882/1772] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:28 2021] POST /identity/v3/projects => generated 377 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:29.029954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64d4b-5259-4e70-8bbe-842e179ae27f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:29.036575 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-4bb64d4b-5259-4e70-8bbe-842e179ae27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:29.046873 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c386eb6-bc31-48a2-96fb-fed4dc5c5461 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:29.137586 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64d4b-5259-4e70-8bbe-842e179ae27f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:29.152693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:29.153603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:29.153883 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:29.154161 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] PATH_INFO: `/v3/projects/64fac972fc644b11a9be7c67ecbd23fa` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:29.157796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64fac972fc644b11a9be7c67ecbd23fa)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:29.160159 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:29.250755 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9eabe-63ec-411d-86cc-804bced61149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:29.251503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9eabe-63ec-411d-86cc-804bced61149 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:29.251789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9eabe-63ec-411d-86cc-804bced61149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:29.252063 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9eabe-63ec-411d-86cc-804bced61149 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:29.258076 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9eabe-63ec-411d-86cc-804bced61149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:29.263092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9eabe-63ec-411d-86cc-804bced61149 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:29.284294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64fac972fc644b11a9be7c67ecbd23fa', 'request_id': 'req-434f5640-4bb7-4f44-8238-5d7f06feed32'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:29.288644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 891/1773] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:29 2021] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:29.289650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9eabe-63ec-411d-86cc-804bced61149 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:29.302718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9eabe-63ec-411d-86cc-804bced61149 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:29.315899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64fac972fc644b11a9be7c67ecbd23fa', 'request_id': 'req-434f5640-4bb7-4f44-8238-5d7f06feed32'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:29.323646 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64fac972fc644b11a9be7c67ecbd23fa', 'request_id': 'req-434f5640-4bb7-4f44-8238-5d7f06feed32'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:29.343206 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] The token cache is being invalidate because project 64fac972fc644b11a9be7c67ecbd23fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:29.343523 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:29.346164 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:29.349829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 883/1774] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:29 2021] DELETE /identity/v3/projects/64fac972fc644b11a9be7c67ecbd23fa => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:29.350661 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:29.362412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:29.441234 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c77c1-c28a-40a1-b70b-7cf6692fd0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:29.441917 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c77c1-c28a-40a1-b70b-7cf6692fd0cd admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:29.442208 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c77c1-c28a-40a1-b70b-7cf6692fd0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:29.442479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c77c1-c28a-40a1-b70b-7cf6692fd0cd admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:29.443230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c77c1-c28a-40a1-b70b-7cf6692fd0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:29.447968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c77c1-c28a-40a1-b70b-7cf6692fd0cd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:29.494104 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 892/1775] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:29 2021] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:29.495558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ea09-42eb-44c9-9677-63fa5cbc0fe6 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:29.495841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ea09-42eb-44c9-9677-63fa5cbc0fe6 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:29.496238 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ea09-42eb-44c9-9677-63fa5cbc0fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:29.519488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-c235ea09-42eb-44c9-9677-63fa5cbc0fe6 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:29.521037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c235ea09-42eb-44c9-9677-63fa5cbc0fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:29.523433 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f5640-4bb7-4f44-8238-5d7f06feed32 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:29.530138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06995e-df3a-4be0-a9c7-81483fddacd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:29.531650 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06995e-df3a-4be0-a9c7-81483fddacd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:29.532191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06995e-df3a-4be0-a9c7-81483fddacd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:29.532559 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06995e-df3a-4be0-a9c7-81483fddacd9 admin admin] PATH_INFO: `/v3/projects/d4f4c33875464c368797e411ee87bc48/users/c202115620f341fd96412a13fdde2646/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:29.533412 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 893/1776] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:29.534162 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ea09-42eb-44c9-9677-63fa5cbc0fe6 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:29.543929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c235ea09-42eb-44c9-9677-63fa5cbc0fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:29.557345 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ea09-42eb-44c9-9677-63fa5cbc0fe6 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:29.563180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06995e-df3a-4be0-a9c7-81483fddacd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f4c33875464c368797e411ee87bc48, user_id=c202115620f341fd96412a13fdde2646, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:29.563595 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dad11b-9b88-4cce-9e45-4e8cd52d4867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:29.564425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dad11b-9b88-4cce-9e45-4e8cd52d4867 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:29.564705 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dad11b-9b88-4cce-9e45-4e8cd52d4867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:29.565081 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dad11b-9b88-4cce-9e45-4e8cd52d4867 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:29.565924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dad11b-9b88-4cce-9e45-4e8cd52d4867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:29.566892 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06995e-df3a-4be0-a9c7-81483fddacd9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:29.567664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dad11b-9b88-4cce-9e45-4e8cd52d4867 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:29.580138 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 894/1777] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:29 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:29.584694 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf48d1-92a0-4e25-9f0b-87bb1086d620 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:29.585029 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf48d1-92a0-4e25-9f0b-87bb1086d620 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:29.585311 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf48d1-92a0-4e25-9f0b-87bb1086d620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:29.586366 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 884/1778] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:29 2021] PUT /identity/v3/projects/d4f4c33875464c368797e411ee87bc48/users/c202115620f341fd96412a13fdde2646/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:29.587640 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06995e-df3a-4be0-a9c7-81483fddacd9 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:29.622440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-2cdf48d1-92a0-4e25-9f0b-87bb1086d620 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:29.624194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-2cdf48d1-92a0-4e25-9f0b-87bb1086d620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:29.661242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06995e-df3a-4be0-a9c7-81483fddacd9 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:29.666540 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b418f30-4728-4b30-be16-1f05ac999b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:29.667315 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b418f30-4728-4b30-be16-1f05ac999b90 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:29.667620 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b418f30-4728-4b30-be16-1f05ac999b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:29.668026 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b418f30-4728-4b30-be16-1f05ac999b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:29.668861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b418f30-4728-4b30-be16-1f05ac999b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:29.670667 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b418f30-4728-4b30-be16-1f05ac999b90 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:29.685196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 885/1779] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:29 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:29.685196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a6d5e-03b5-4789-92fa-cbce105b500c None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:29.685196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a6d5e-03b5-4789-92fa-cbce105b500c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:29.685196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a6d5e-03b5-4789-92fa-cbce105b500c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:29.697248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 895/1780] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:29.701907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf48d1-92a0-4e25-9f0b-87bb1086d620 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:29.712672 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf48d1-92a0-4e25-9f0b-87bb1086d620 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:29.718441 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25b21a-6bc9-4d91-a37e-caa1f893a29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:29.719501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25b21a-6bc9-4d91-a37e-caa1f893a29e admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:29.719838 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25b21a-6bc9-4d91-a37e-caa1f893a29e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:29.720179 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25b21a-6bc9-4d91-a37e-caa1f893a29e admin admin] PATH_INFO: `/v3/projects/9bc71ba0195e472a9cac0d8bc25f50af/users/dda36b1b39dd42eb93b0eed0cf0606c2/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:29.721445 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-395a6d5e-03b5-4789-92fa-cbce105b500c None None] MFA Rules not processed for user `c202115620f341fd96412a13fdde2646`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:29.722899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-395a6d5e-03b5-4789-92fa-cbce105b500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:29.741475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25b21a-6bc9-4d91-a37e-caa1f893a29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc71ba0195e472a9cac0d8bc25f50af, user_id=dda36b1b39dd42eb93b0eed0cf0606c2, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:29.744703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25b21a-6bc9-4d91-a37e-caa1f893a29e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:29.760644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 896/1781] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:29 2021] PUT /identity/v3/projects/9bc71ba0195e472a9cac0d8bc25f50af/users/dda36b1b39dd42eb93b0eed0cf0606c2/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:29.761481 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25b21a-6bc9-4d91-a37e-caa1f893a29e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:29.808987 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 886/1782] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:29 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:29.810859 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef004e7d-7e95-4a49-9c81-8f5cb1226018 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:29.811338 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef004e7d-7e95-4a49-9c81-8f5cb1226018 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:29.811801 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef004e7d-7e95-4a49-9c81-8f5cb1226018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:29.827931 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25b21a-6bc9-4d91-a37e-caa1f893a29e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:29.846304 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc5409-56ae-4fd9-8149-406de797d154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:29.846304 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc5409-56ae-4fd9-8149-406de797d154 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:29.846304 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc5409-56ae-4fd9-8149-406de797d154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:29.846304 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc5409-56ae-4fd9-8149-406de797d154 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:29.846828 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc5409-56ae-4fd9-8149-406de797d154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:29.847162 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc5409-56ae-4fd9-8149-406de797d154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:29.847729 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-ef004e7d-7e95-4a49-9c81-8f5cb1226018 None None] MFA Rules not processed for user `dda36b1b39dd42eb93b0eed0cf0606c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:29.848793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc5409-56ae-4fd9-8149-406de797d154 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:29.848988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-ef004e7d-7e95-4a49-9c81-8f5cb1226018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:29.863074 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 897/1783] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:29.864190 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc5409-56ae-4fd9-8149-406de797d154 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:29.876554 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc5409-56ae-4fd9-8149-406de797d154 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:29.893169 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f2860-5f68-4260-895c-8a2af1999b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:29.893850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2860-5f68-4260-895c-8a2af1999b7e admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:29.894136 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2860-5f68-4260-895c-8a2af1999b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:29.894398 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2860-5f68-4260-895c-8a2af1999b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:29.895116 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f2860-5f68-4260-895c-8a2af1999b7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:29.897365 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f2860-5f68-4260-895c-8a2af1999b7e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:29.932514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 898/1784] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:29 2021] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:29.933372 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f2860-5f68-4260-895c-8a2af1999b7e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:29.937079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 887/1785] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:29 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:29.938272 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef004e7d-7e95-4a49-9c81-8f5cb1226018 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:29.950536 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef004e7d-7e95-4a49-9c81-8f5cb1226018 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:30.010968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436aaee-7104-424b-a983-bd607841fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:30.011846 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436aaee-7104-424b-a983-bd607841fca4 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:30.012186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436aaee-7104-424b-a983-bd607841fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:30.012537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436aaee-7104-424b-a983-bd607841fca4 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:30.013860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436aaee-7104-424b-a983-bd607841fca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:30.016115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436aaee-7104-424b-a983-bd607841fca4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:30.024962 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f2860-5f68-4260-895c-8a2af1999b7e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:30.030773 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f2d5f-a537-4c78-ac7d-f8e6bcbe4fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:30.031487 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f2d5f-a537-4c78-ac7d-f8e6bcbe4fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:30.031772 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f2d5f-a537-4c78-ac7d-f8e6bcbe4fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:30.032048 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f2d5f-a537-4c78-ac7d-f8e6bcbe4fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:30.032905 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f2d5f-a537-4c78-ac7d-f8e6bcbe4fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:30.035004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f2d5f-a537-4c78-ac7d-f8e6bcbe4fd2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:30.044320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 888/1786] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:29 2021] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:30.044320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436aaee-7104-424b-a983-bd607841fca4 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:30.044320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d436aaee-7104-424b-a983-bd607841fca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:30.066900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 899/1787] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:29 2021] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:30.066900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f2d5f-a537-4c78-ac7d-f8e6bcbe4fd2 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:30.108249 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436aaee-7104-424b-a983-bd607841fca4 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:30.164414 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f2d5f-a537-4c78-ac7d-f8e6bcbe4fd2 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:30.169458 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdba60b-9754-40bc-a231-e8e11df91658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:30.170246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdba60b-9754-40bc-a231-e8e11df91658 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:30.170527 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdba60b-9754-40bc-a231-e8e11df91658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:30.170798 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdba60b-9754-40bc-a231-e8e11df91658 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:30.171713 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdba60b-9754-40bc-a231-e8e11df91658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:30.173384 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdba60b-9754-40bc-a231-e8e11df91658 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:30.175563 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41d7a9-3d46-4e66-9da3-fad3e8e0ef92 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a71b8adef243049d3b055e66566a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:30.176315 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41d7a9-3d46-4e66-9da3-fad3e8e0ef92 service glance] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:30.176596 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41d7a9-3d46-4e66-9da3-fad3e8e0ef92 service glance] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:30.176918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41d7a9-3d46-4e66-9da3-fad3e8e0ef92 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:30.191617 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 900/1788] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:30 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:30.193025 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdba60b-9754-40bc-a231-e8e11df91658 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:30.206585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdba60b-9754-40bc-a231-e8e11df91658 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:30.212206 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20cdb3-8694-415b-8f45-d9a66be3f6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:30.213021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20cdb3-8694-415b-8f45-d9a66be3f6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:30.213403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20cdb3-8694-415b-8f45-d9a66be3f6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:30.213780 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20cdb3-8694-415b-8f45-d9a66be3f6e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:30.214598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20cdb3-8694-415b-8f45-d9a66be3f6e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:30.217065 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20cdb3-8694-415b-8f45-d9a66be3f6e7 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:30.249790 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 901/1789] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:30 2021] POST /identity/v3/users => generated 291 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:30.250978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20cdb3-8694-415b-8f45-d9a66be3f6e7 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:30.266119 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20cdb3-8694-415b-8f45-d9a66be3f6e7 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:30.272407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de5ea8-7bdd-4017-a4f4-1e8a6e53cae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:30.273292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5ea8-7bdd-4017-a4f4-1e8a6e53cae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:30.273715 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5ea8-7bdd-4017-a4f4-1e8a6e53cae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:30.274124 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5ea8-7bdd-4017-a4f4-1e8a6e53cae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:30.275087 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de5ea8-7bdd-4017-a4f4-1e8a6e53cae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:30.277236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de5ea8-7bdd-4017-a4f4-1e8a6e53cae4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:30.277611 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41d7a9-3d46-4e66-9da3-fad3e8e0ef92 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:30.279498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41d7a9-3d46-4e66-9da3-fad3e8e0ef92 service glance] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:30.294267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 902/1790] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:30 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:30.295355 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de5ea8-7bdd-4017-a4f4-1e8a6e53cae4 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:30.297749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 889/1791] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:30 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:30.299287 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41d7a9-3d46-4e66-9da3-fad3e8e0ef92 service glance] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:30.312674 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41d7a9-3d46-4e66-9da3-fad3e8e0ef92 service glance] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:30.321565 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de5ea8-7bdd-4017-a4f4-1e8a6e53cae4 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:30.328981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79bed9-d89d-43f9-b046-5111989b945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:30.329762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79bed9-d89d-43f9-b046-5111989b945c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:30.330112 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79bed9-d89d-43f9-b046-5111989b945c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:30.330387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79bed9-d89d-43f9-b046-5111989b945c admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:30.331254 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79bed9-d89d-43f9-b046-5111989b945c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:30.334011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79bed9-d89d-43f9-b046-5111989b945c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:30.335481 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af39ffb-64d9-4c06-94da-69738f0b3d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:30.337854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af39ffb-64d9-4c06-94da-69738f0b3d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:30.338153 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af39ffb-64d9-4c06-94da-69738f0b3d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:30.338476 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af39ffb-64d9-4c06-94da-69738f0b3d0a admin admin] PATH_INFO: `/v3/projects/8e15969d9c2a475dbe86352d72f5efe0/users/a8e25ed17a524294b7ccd64387f3e847/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:30.349902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 903/1792] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:30 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:30.350876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79bed9-d89d-43f9-b046-5111989b945c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:30.362998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79bed9-d89d-43f9-b046-5111989b945c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:30.370309 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99701060-bcfe-4c8e-bb5b-3044502d8fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:30.371085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99701060-bcfe-4c8e-bb5b-3044502d8fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:30.371425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99701060-bcfe-4c8e-bb5b-3044502d8fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:30.371695 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99701060-bcfe-4c8e-bb5b-3044502d8fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:30.372458 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99701060-bcfe-4c8e-bb5b-3044502d8fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:30.374361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99701060-bcfe-4c8e-bb5b-3044502d8fc6 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:30.391559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 904/1793] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:30 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:30.401164 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af39ffb-64d9-4c06-94da-69738f0b3d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e15969d9c2a475dbe86352d72f5efe0, user_id=a8e25ed17a524294b7ccd64387f3e847, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:30.404487 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af39ffb-64d9-4c06-94da-69738f0b3d0a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:30.407460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99701060-bcfe-4c8e-bb5b-3044502d8fc6 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:30.422145 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99701060-bcfe-4c8e-bb5b-3044502d8fc6 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:30.441077 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 890/1794] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:30 2021] PUT /identity/v3/projects/8e15969d9c2a475dbe86352d72f5efe0/users/a8e25ed17a524294b7ccd64387f3e847/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:30.451728 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3452c2a-8f7c-493f-89f9-8bce7db7a942 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:30.452496 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3452c2a-8f7c-493f-89f9-8bce7db7a942 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:30.453058 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3452c2a-8f7c-493f-89f9-8bce7db7a942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:30.564888 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-b3452c2a-8f7c-493f-89f9-8bce7db7a942 None None] MFA Rules not processed for user `a8e25ed17a524294b7ccd64387f3e847`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:30.566150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b3452c2a-8f7c-493f-89f9-8bce7db7a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:30.612056 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699be29-8ca1-4944-8186-0f43eda43303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:30.613287 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699be29-8ca1-4944-8186-0f43eda43303 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:30.613994 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699be29-8ca1-4944-8186-0f43eda43303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:30.614338 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699be29-8ca1-4944-8186-0f43eda43303 admin admin] PATH_INFO: `/v3/projects/ff6b8193c2534e95851c5fb3d62c6f06/users/caaa3dc110ac4590ac399fe7f29ff032/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:30.653006 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699be29-8ca1-4944-8186-0f43eda43303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6b8193c2534e95851c5fb3d62c6f06, user_id=caaa3dc110ac4590ac399fe7f29ff032, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:30.658899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699be29-8ca1-4944-8186-0f43eda43303 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:30.694355 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 891/1795] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:30 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:30.697431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3452c2a-8f7c-493f-89f9-8bce7db7a942 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:30.711309 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3452c2a-8f7c-493f-89f9-8bce7db7a942 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:30.730817 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 905/1796] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:30 2021] PUT /identity/v3/projects/ff6b8193c2534e95851c5fb3d62c6f06/users/caaa3dc110ac4590ac399fe7f29ff032/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:30.748259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d64b67-15ae-4001-8df2-d907ed49f779 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:30.748494 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d64b67-15ae-4001-8df2-d907ed49f779 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:30.748855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d64b67-15ae-4001-8df2-d907ed49f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:30.794038 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78db368-53ac-4308-aea3-ca26003a80d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:30.794895 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78db368-53ac-4308-aea3-ca26003a80d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:30.795405 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78db368-53ac-4308-aea3-ca26003a80d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:30.795781 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78db368-53ac-4308-aea3-ca26003a80d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:30.797980 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78db368-53ac-4308-aea3-ca26003a80d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:30.806639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78db368-53ac-4308-aea3-ca26003a80d8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:30.875816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-99d64b67-15ae-4001-8df2-d907ed49f779 None None] MFA Rules not processed for user `caaa3dc110ac4590ac399fe7f29ff032`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:30.878652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 892/1797] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:30 2021] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:01:30.879829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-99d64b67-15ae-4001-8df2-d907ed49f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:30.883807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78db368-53ac-4308-aea3-ca26003a80d8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:31.029762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 906/1798] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:30 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:31.030453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d64b67-15ae-4001-8df2-d907ed49f779 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:31.093572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78db368-53ac-4308-aea3-ca26003a80d8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:31.099816 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814ac3-df7c-45fa-8af9-54329cbb2ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:31.101045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814ac3-df7c-45fa-8af9-54329cbb2ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:31.101822 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814ac3-df7c-45fa-8af9-54329cbb2ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:31.102413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814ac3-df7c-45fa-8af9-54329cbb2ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:31.103755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44814ac3-df7c-45fa-8af9-54329cbb2ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:31.107379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44814ac3-df7c-45fa-8af9-54329cbb2ae5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:31.183081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 893/1799] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:30 2021] POST /identity/v3/users => generated 299 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:31.188562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814ac3-df7c-45fa-8af9-54329cbb2ae5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:31.211163 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814ac3-df7c-45fa-8af9-54329cbb2ae5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:31.225397 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d64b67-15ae-4001-8df2-d907ed49f779 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:31.231202 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734655c0-92b6-4320-b233-797a2f8716b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:31.232612 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734655c0-92b6-4320-b233-797a2f8716b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:31.234649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734655c0-92b6-4320-b233-797a2f8716b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:31.235108 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734655c0-92b6-4320-b233-797a2f8716b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:31.242836 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734655c0-92b6-4320-b233-797a2f8716b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:31.248197 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734655c0-92b6-4320-b233-797a2f8716b4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:31.249486 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee712a14-211b-4210-92b3-0056b74a96d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:31.250197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712a14-211b-4210-92b3-0056b74a96d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:31.250509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712a14-211b-4210-92b3-0056b74a96d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:31.250808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712a14-211b-4210-92b3-0056b74a96d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:31.251618 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee712a14-211b-4210-92b3-0056b74a96d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:31.259652 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee712a14-211b-4210-92b3-0056b74a96d5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:31.326263 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 907/1800] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:31 2021] POST /identity/v3/projects => generated 381 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:01:31.326514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 894/1801] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:31 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:31.326710 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee712a14-211b-4210-92b3-0056b74a96d5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:31.327781 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734655c0-92b6-4320-b233-797a2f8716b4 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:31.340915 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734655c0-92b6-4320-b233-797a2f8716b4 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:31.425825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f93169-3d33-44e4-93b0-da9f1828a519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:31.426582 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f93169-3d33-44e4-93b0-da9f1828a519 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:31.426859 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f93169-3d33-44e4-93b0-da9f1828a519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:31.427331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f93169-3d33-44e4-93b0-da9f1828a519 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:31.428059 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f93169-3d33-44e4-93b0-da9f1828a519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:31.430342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f93169-3d33-44e4-93b0-da9f1828a519 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:31.435232 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee712a14-211b-4210-92b3-0056b74a96d5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:31.445146 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746ef4a-0fb4-473c-8b31-8e39095160e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:31.446205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746ef4a-0fb4-473c-8b31-8e39095160e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:31.446487 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746ef4a-0fb4-473c-8b31-8e39095160e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:31.446758 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746ef4a-0fb4-473c-8b31-8e39095160e8 admin admin] PATH_INFO: `/v3/projects/7e46160805c04184a5d4df93454917ce/users/e4f1d376acdb432cb9e268a145bbafdb/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:31.472707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746ef4a-0fb4-473c-8b31-8e39095160e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e46160805c04184a5d4df93454917ce, user_id=e4f1d376acdb432cb9e268a145bbafdb, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:31.479185 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746ef4a-0fb4-473c-8b31-8e39095160e8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:31.482461 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 895/1802] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:31 2021] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:31.485497 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f93169-3d33-44e4-93b0-da9f1828a519 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:31.498864 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f93169-3d33-44e4-93b0-da9f1828a519 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:31.499815 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 908/1803] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:31 2021] PUT /identity/v3/projects/7e46160805c04184a5d4df93454917ce/users/e4f1d376acdb432cb9e268a145bbafdb/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:31.504005 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746ef4a-0fb4-473c-8b31-8e39095160e8 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:31.567617 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63f272-f6d0-4648-954b-840d6dc98733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:31.568374 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63f272-f6d0-4648-954b-840d6dc98733 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:31.568680 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63f272-f6d0-4648-954b-840d6dc98733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:31.569003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63f272-f6d0-4648-954b-840d6dc98733 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:31.569847 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63f272-f6d0-4648-954b-840d6dc98733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:31.571706 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63f272-f6d0-4648-954b-840d6dc98733 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:31.577622 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746ef4a-0fb4-473c-8b31-8e39095160e8 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:31.584223 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 896/1804] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:31 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:31.585150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52289af7-020c-47a6-b89a-aaa9424797f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:31.586037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52289af7-020c-47a6-b89a-aaa9424797f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:31.586487 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52289af7-020c-47a6-b89a-aaa9424797f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:31.586850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52289af7-020c-47a6-b89a-aaa9424797f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:31.587891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52289af7-020c-47a6-b89a-aaa9424797f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:31.597103 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63f272-f6d0-4648-954b-840d6dc98733 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:31.600526 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52289af7-020c-47a6-b89a-aaa9424797f4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:31.609538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63f272-f6d0-4648-954b-840d6dc98733 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:31.616854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f911f3-e311-43a2-bb23-f69848482ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:31.617974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f911f3-e311-43a2-bb23-f69848482ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:31.618361 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f911f3-e311-43a2-bb23-f69848482ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:31.618742 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f911f3-e311-43a2-bb23-f69848482ffb admin admin] PATH_INFO: `/v3/projects/99010b41f39f4802a1462efcf6455902/users/af5ab15e49d4449387c0248e3e2911c9/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:31.627311 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 909/1805] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:31 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:31.628501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52289af7-020c-47a6-b89a-aaa9424797f4 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:31.639815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f911f3-e311-43a2-bb23-f69848482ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=99010b41f39f4802a1462efcf6455902, user_id=af5ab15e49d4449387c0248e3e2911c9, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:31.643536 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f911f3-e311-43a2-bb23-f69848482ffb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:31.644194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52289af7-020c-47a6-b89a-aaa9424797f4 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:31.651477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8cc3c-1263-4ce0-9b96-47f1cdef61c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:31.657695 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8cc3c-1263-4ce0-9b96-47f1cdef61c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:31.658395 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8cc3c-1263-4ce0-9b96-47f1cdef61c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:31.659394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8cc3c-1263-4ce0-9b96-47f1cdef61c2 admin admin] PATH_INFO: `/v3/projects/7e46160805c04184a5d4df93454917ce/users/e4f1d376acdb432cb9e268a145bbafdb/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:31.665161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8cc3c-1263-4ce0-9b96-47f1cdef61c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e46160805c04184a5d4df93454917ce, user_id=e4f1d376acdb432cb9e268a145bbafdb, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:31.671860 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8cc3c-1263-4ce0-9b96-47f1cdef61c2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:31.673074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 897/1806] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:31 2021] PUT /identity/v3/projects/99010b41f39f4802a1462efcf6455902/users/af5ab15e49d4449387c0248e3e2911c9/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:31.676924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f911f3-e311-43a2-bb23-f69848482ffb admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:31.691761 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 910/1807] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:31 2021] PUT /identity/v3/projects/7e46160805c04184a5d4df93454917ce/users/e4f1d376acdb432cb9e268a145bbafdb/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:31.703611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc57d2d-8209-4309-881d-684fd7bc7c3f None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:31.703944 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc57d2d-8209-4309-881d-684fd7bc7c3f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:31.704227 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc57d2d-8209-4309-881d-684fd7bc7c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:31.735115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-1bc57d2d-8209-4309-881d-684fd7bc7c3f None None] MFA Rules not processed for user `e4f1d376acdb432cb9e268a145bbafdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:31.736659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1bc57d2d-8209-4309-881d-684fd7bc7c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:31.765006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f911f3-e311-43a2-bb23-f69848482ffb admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:31.826013 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 911/1808] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:31 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:31.837802 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc57d2d-8209-4309-881d-684fd7bc7c3f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:31.839792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1bc57d2d-8209-4309-881d-684fd7bc7c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:31.841591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1d0fe-e902-43a9-b4f1-4159a2a1ba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:31.842493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1d0fe-e902-43a9-b4f1-4159a2a1ba09 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:31.842830 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1d0fe-e902-43a9-b4f1-4159a2a1ba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:31.843166 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1d0fe-e902-43a9-b4f1-4159a2a1ba09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:31.844013 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1d0fe-e902-43a9-b4f1-4159a2a1ba09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:31.846177 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1d0fe-e902-43a9-b4f1-4159a2a1ba09 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:31.864009 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 898/1809] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:31 2021] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:31.864009 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1d0fe-e902-43a9-b4f1-4159a2a1ba09 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:31.874702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1d0fe-e902-43a9-b4f1-4159a2a1ba09 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:31.879654 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817f535-7567-406b-b85d-206c7306cb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:31.880704 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817f535-7567-406b-b85d-206c7306cb90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:31.881082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817f535-7567-406b-b85d-206c7306cb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:31.881447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817f535-7567-406b-b85d-206c7306cb90 admin admin] PATH_INFO: `/v3/projects/99010b41f39f4802a1462efcf6455902/users/af5ab15e49d4449387c0248e3e2911c9/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:31.883599 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817f535-7567-406b-b85d-206c7306cb90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99010b41f39f4802a1462efcf6455902, user_id=af5ab15e49d4449387c0248e3e2911c9, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:31.886452 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817f535-7567-406b-b85d-206c7306cb90 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:31.916694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 899/1810] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:31 2021] PUT /identity/v3/projects/99010b41f39f4802a1462efcf6455902/users/af5ab15e49d4449387c0248e3e2911c9/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:31.916919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc57d2d-8209-4309-881d-684fd7bc7c3f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:31.918686 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b796790-4d60-446a-b24a-5533b1289dd7 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:31.918976 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b796790-4d60-446a-b24a-5533b1289dd7 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:31.919284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b796790-4d60-446a-b24a-5533b1289dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:31.972249 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-5b796790-4d60-446a-b24a-5533b1289dd7 None None] MFA Rules not processed for user `af5ab15e49d4449387c0248e3e2911c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:31.974054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5b796790-4d60-446a-b24a-5533b1289dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:31.992523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16056b62-f7a0-42a1-886e-2150dea7e792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:31.993105 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16056b62-f7a0-42a1-886e-2150dea7e792 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:31.995186 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16056b62-f7a0-42a1-886e-2150dea7e792 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:31.995537 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16056b62-f7a0-42a1-886e-2150dea7e792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:32.073110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16056b62-f7a0-42a1-886e-2150dea7e792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:32.074599 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16056b62-f7a0-42a1-886e-2150dea7e792 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:32.082202 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 900/1811] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:31 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:32.085512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 912/1812] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:31 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:32.093529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b796790-4d60-446a-b24a-5533b1289dd7 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:32.096316 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5b796790-4d60-446a-b24a-5533b1289dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:32.109961 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b796790-4d60-446a-b24a-5533b1289dd7 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:32.114127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2c820-8c8e-40bf-94d6-e288db8c4fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:32.114819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c820-8c8e-40bf-94d6-e288db8c4fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:32.115147 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c820-8c8e-40bf-94d6-e288db8c4fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:32.115410 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c820-8c8e-40bf-94d6-e288db8c4fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:32.130276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2c820-8c8e-40bf-94d6-e288db8c4fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:32.130276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2c820-8c8e-40bf-94d6-e288db8c4fb5 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:32.139085 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 901/1813] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:32 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:01:32.230092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16056b62-f7a0-42a1-886e-2150dea7e792 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:32.238478 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16056b62-f7a0-42a1-886e-2150dea7e792 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:32.242157 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609d9ee-2ba0-4331-bb91-3ba30c111584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:32.242867 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609d9ee-2ba0-4331-bb91-3ba30c111584 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:32.243091 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609d9ee-2ba0-4331-bb91-3ba30c111584 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:32.243399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609d9ee-2ba0-4331-bb91-3ba30c111584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:32.305688 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609d9ee-2ba0-4331-bb91-3ba30c111584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:32.307342 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609d9ee-2ba0-4331-bb91-3ba30c111584 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:32.317023 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 913/1814] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:32 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:32.616781 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2c820-8c8e-40bf-94d6-e288db8c4fb5 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:32.627428 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609d9ee-2ba0-4331-bb91-3ba30c111584 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:32.635814 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609d9ee-2ba0-4331-bb91-3ba30c111584 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:32.640456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc96e3c-ebee-490e-9df7-2c799e61715f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:32.641100 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc96e3c-ebee-490e-9df7-2c799e61715f service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:32.641378 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc96e3c-ebee-490e-9df7-2c799e61715f service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:32.641649 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc96e3c-ebee-490e-9df7-2c799e61715f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:32.683194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2c820-8c8e-40bf-94d6-e288db8c4fb5 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:32.689240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbffae-3785-4ac4-b109-a1d8abf10aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:32.690332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbffae-3785-4ac4-b109-a1d8abf10aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:32.690703 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbffae-3785-4ac4-b109-a1d8abf10aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:32.691079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbffae-3785-4ac4-b109-a1d8abf10aa9 admin admin] PATH_INFO: `/v3/users/caaa3dc110ac4590ac399fe7f29ff032` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:32.692602 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbffae-3785-4ac4-b109-a1d8abf10aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caaa3dc110ac4590ac399fe7f29ff032)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:32.694796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbffae-3785-4ac4-b109-a1d8abf10aa9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:32.697150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc96e3c-ebee-490e-9df7-2c799e61715f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:32.698589 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc96e3c-ebee-490e-9df7-2c799e61715f service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:32.708046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 914/1815] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:32 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:32.742753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1abbffae-3785-4ac4-b109-a1d8abf10aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caaa3dc110ac4590ac399fe7f29ff032'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:32.743438 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1abbffae-3785-4ac4-b109-a1d8abf10aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caaa3dc110ac4590ac399fe7f29ff032'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:32.751279 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1abbffae-3785-4ac4-b109-a1d8abf10aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caaa3dc110ac4590ac399fe7f29ff032'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:32.751909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1abbffae-3785-4ac4-b109-a1d8abf10aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caaa3dc110ac4590ac399fe7f29ff032'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:32.759368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1abbffae-3785-4ac4-b109-a1d8abf10aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caaa3dc110ac4590ac399fe7f29ff032'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:32.779398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 902/1816] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:32 2021] DELETE /identity/v3/users/caaa3dc110ac4590ac399fe7f29ff032 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:32.784225 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb2034-7724-4da7-81c8-b120613a329a None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:32.784517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb2034-7724-4da7-81c8-b120613a329a None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:32.784790 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb2034-7724-4da7-81c8-b120613a329a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:32.802721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-67bb2034-7724-4da7-81c8-b120613a329a None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:32.804031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-67bb2034-7724-4da7-81c8-b120613a329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:32.868690 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 915/1817] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:32.879949 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbffae-3785-4ac4-b109-a1d8abf10aa9 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:32.881725 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1abbffae-3785-4ac4-b109-a1d8abf10aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:32.948720 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbffae-3785-4ac4-b109-a1d8abf10aa9 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:32.959188 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffd57d-392f-467d-9801-430aef101af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:32.960137 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffd57d-392f-467d-9801-430aef101af9 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:32.960508 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffd57d-392f-467d-9801-430aef101af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:32.960870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffd57d-392f-467d-9801-430aef101af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:32.976685 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffd57d-392f-467d-9801-430aef101af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:32.978652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffd57d-392f-467d-9801-430aef101af9 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:32.993115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 903/1818] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:33.362985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb2034-7724-4da7-81c8-b120613a329a None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:33.364739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-67bb2034-7724-4da7-81c8-b120613a329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:33.378034 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb2034-7724-4da7-81c8-b120613a329a None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:33.384357 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:33.385341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:33.385669 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:33.387025 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] PATH_INFO: `/v3/projects/ff6b8193c2534e95851c5fb3d62c6f06` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:33.389124 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6b8193c2534e95851c5fb3d62c6f06)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:33.391724 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:33.448473 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6b8193c2534e95851c5fb3d62c6f06', 'request_id': 'req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:33.455249 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6b8193c2534e95851c5fb3d62c6f06', 'request_id': 'req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:33.461499 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6b8193c2534e95851c5fb3d62c6f06', 'request_id': 'req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:33.480936 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] The token cache is being invalidate because project ff6b8193c2534e95851c5fb3d62c6f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:33.481225 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:33.481907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:33.483690 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 916/1819] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:33 2021] DELETE /identity/v3/projects/ff6b8193c2534e95851c5fb3d62c6f06 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:33.488196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffd57d-392f-467d-9801-430aef101af9 service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:33.498983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffd57d-392f-467d-9801-430aef101af9 service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:33.563183 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b061a-55fe-4c04-91e4-300e3beaddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:33.564000 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b061a-55fe-4c04-91e4-300e3beaddde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:33.564280 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b061a-55fe-4c04-91e4-300e3beaddde admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:33.564554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b061a-55fe-4c04-91e4-300e3beaddde admin admin] PATH_INFO: `/v3/users/af5ab15e49d4449387c0248e3e2911c9` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:33.565831 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b061a-55fe-4c04-91e4-300e3beaddde admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5ab15e49d4449387c0248e3e2911c9)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:33.567799 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b061a-55fe-4c04-91e4-300e3beaddde admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:33.624391 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d22b061a-55fe-4c04-91e4-300e3beaddde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5ab15e49d4449387c0248e3e2911c9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:33.625643 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d22b061a-55fe-4c04-91e4-300e3beaddde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5ab15e49d4449387c0248e3e2911c9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:33.638257 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d22b061a-55fe-4c04-91e4-300e3beaddde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5ab15e49d4449387c0248e3e2911c9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:33.638939 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d22b061a-55fe-4c04-91e4-300e3beaddde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5ab15e49d4449387c0248e3e2911c9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:33.646152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d22b061a-55fe-4c04-91e4-300e3beaddde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5ab15e49d4449387c0248e3e2911c9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:33.664044 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 904/1820] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:33 2021] DELETE /identity/v3/users/af5ab15e49d4449387c0248e3e2911c9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:33.974133 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:33.975855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:33.991904 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d74cd3-77f5-4c6e-8633-b2abc2290a08 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:34.054743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:34.055656 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:34.055966 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:34.056234 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5 admin admin] PATH_INFO: `/v3/projects/99010b41f39f4802a1462efcf6455902` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:34.057437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99010b41f39f4802a1462efcf6455902)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:34.059583 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:34.108861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99010b41f39f4802a1462efcf6455902', 'request_id': 'req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:34.115928 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99010b41f39f4802a1462efcf6455902', 'request_id': 'req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:34.122117 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99010b41f39f4802a1462efcf6455902', 'request_id': 'req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:34.136613 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5 admin admin] The token cache is being invalidate because project 99010b41f39f4802a1462efcf6455902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:34.136900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:34.138060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-87cd6946-c3e1-4dc8-9633-423dd2f6d2d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:34.139755 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 917/1821] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:33 2021] DELETE /identity/v3/projects/99010b41f39f4802a1462efcf6455902 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:34.145847 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8889-13cb-4721-ab6c-7a4a0385ef4b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:34.146113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8889-13cb-4721-ab6c-7a4a0385ef4b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:34.146387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8889-13cb-4721-ab6c-7a4a0385ef4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:34.164851 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-447e8889-13cb-4721-ab6c-7a4a0385ef4b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:34.166204 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-447e8889-13cb-4721-ab6c-7a4a0385ef4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:34.246329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 905/1822] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:34.255846 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dd718-cc44-46f1-8406-04477661317d None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:34.256161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dd718-cc44-46f1-8406-04477661317d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:34.256466 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dd718-cc44-46f1-8406-04477661317d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:34.277499 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-0b9dd718-cc44-46f1-8406-04477661317d None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:34.279036 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0b9dd718-cc44-46f1-8406-04477661317d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:34.288412 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 918/1823] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:34.293398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e8889-13cb-4721-ab6c-7a4a0385ef4b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:34.304866 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e8889-13cb-4721-ab6c-7a4a0385ef4b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:34.311411 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16609e-bcac-4c2a-8f3a-fa77dd2f8cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:34.311411 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16609e-bcac-4c2a-8f3a-fa77dd2f8cac admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:34.311730 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16609e-bcac-4c2a-8f3a-fa77dd2f8cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:34.311880 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16609e-bcac-4c2a-8f3a-fa77dd2f8cac admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:34.312644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16609e-bcac-4c2a-8f3a-fa77dd2f8cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:34.312946 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16609e-bcac-4c2a-8f3a-fa77dd2f8cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:34.314754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16609e-bcac-4c2a-8f3a-fa77dd2f8cac admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:34.336041 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 906/1824] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:34.344249 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dd718-cc44-46f1-8406-04477661317d None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:34.356193 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dd718-cc44-46f1-8406-04477661317d None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:34.362361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54940cf8-6401-49ec-88c2-da557b5118f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:34.363109 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54940cf8-6401-49ec-88c2-da557b5118f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:34.363700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54940cf8-6401-49ec-88c2-da557b5118f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:34.363790 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54940cf8-6401-49ec-88c2-da557b5118f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:34.364658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54940cf8-6401-49ec-88c2-da557b5118f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:34.367074 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54940cf8-6401-49ec-88c2-da557b5118f5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:34.399236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 919/1825] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:34 2021] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:34.400860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16609e-bcac-4c2a-8f3a-fa77dd2f8cac admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:34.411299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16609e-bcac-4c2a-8f3a-fa77dd2f8cac admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:34.518420 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447379ca-996c-4835-9d8d-d6fb35aa6cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:34.519139 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447379ca-996c-4835-9d8d-d6fb35aa6cbd admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:34.519422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447379ca-996c-4835-9d8d-d6fb35aa6cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:34.519795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447379ca-996c-4835-9d8d-d6fb35aa6cbd admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:34.520399 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447379ca-996c-4835-9d8d-d6fb35aa6cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:34.522339 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447379ca-996c-4835-9d8d-d6fb35aa6cbd admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:34.553216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 907/1826] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:34 2021] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:34.554282 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54940cf8-6401-49ec-88c2-da557b5118f5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:34.570947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54940cf8-6401-49ec-88c2-da557b5118f5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:34.578733 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28ef77-694a-4426-9e99-0d8f9646bfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:34.580682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28ef77-694a-4426-9e99-0d8f9646bfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:34.580840 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28ef77-694a-4426-9e99-0d8f9646bfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:34.584182 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28ef77-694a-4426-9e99-0d8f9646bfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:34.585202 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28ef77-694a-4426-9e99-0d8f9646bfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:34.587767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28ef77-694a-4426-9e99-0d8f9646bfa2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:34.602445 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 920/1827] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:34 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:34.604072 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447379ca-996c-4835-9d8d-d6fb35aa6cbd admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:34.614918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447379ca-996c-4835-9d8d-d6fb35aa6cbd admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:34.621286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89680d97-f236-479d-aaa8-79b05428337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:34.622579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89680d97-f236-479d-aaa8-79b05428337c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:34.623338 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89680d97-f236-479d-aaa8-79b05428337c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:34.623338 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89680d97-f236-479d-aaa8-79b05428337c admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:34.624358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89680d97-f236-479d-aaa8-79b05428337c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:34.626117 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89680d97-f236-479d-aaa8-79b05428337c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:34.638441 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 908/1828] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:34 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:34.643627 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28ef77-694a-4426-9e99-0d8f9646bfa2 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:34.659783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28ef77-694a-4426-9e99-0d8f9646bfa2 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:34.665040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb7651-c1aa-489f-8208-8892032221f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:34.666131 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb7651-c1aa-489f-8208-8892032221f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:34.666585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb7651-c1aa-489f-8208-8892032221f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:34.666853 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb7651-c1aa-489f-8208-8892032221f2 admin admin] PATH_INFO: `/v3/projects/1f99847b246e49c89c0a30cec88804ac/users/6a6a49ae146b44a4b8e52ce52c128bd3/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:34.686500 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb7651-c1aa-489f-8208-8892032221f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f99847b246e49c89c0a30cec88804ac, user_id=6a6a49ae146b44a4b8e52ce52c128bd3, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:34.689733 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb7651-c1aa-489f-8208-8892032221f2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:34.711190 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 921/1829] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:34 2021] PUT /identity/v3/projects/1f99847b246e49c89c0a30cec88804ac/users/6a6a49ae146b44a4b8e52ce52c128bd3/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:34.713282 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f25b1-2070-439c-bcbb-76d8a0fa9327 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:34.713571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f25b1-2070-439c-bcbb-76d8a0fa9327 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:34.713981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f25b1-2070-439c-bcbb-76d8a0fa9327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:34.747890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-e03f25b1-2070-439c-bcbb-76d8a0fa9327 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:34.750147 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e03f25b1-2070-439c-bcbb-76d8a0fa9327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:34.845810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 909/1830] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:34.946520 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb7651-c1aa-489f-8208-8892032221f2 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:34.949686 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-61eb7651-c1aa-489f-8208-8892032221f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:35.052454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb7651-c1aa-489f-8208-8892032221f2 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:35.059716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85b55e-521c-4bc5-9554-ee8fb0e1429c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:35.061135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b55e-521c-4bc5-9554-ee8fb0e1429c service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:35.061840 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b55e-521c-4bc5-9554-ee8fb0e1429c service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:35.062451 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b55e-521c-4bc5-9554-ee8fb0e1429c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:35.078248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85b55e-521c-4bc5-9554-ee8fb0e1429c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:35.081508 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85b55e-521c-4bc5-9554-ee8fb0e1429c service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:35.097612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 922/1831] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:35.803160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8435f-bfac-4258-8cd1-6661aaca41ef None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:35.804113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8435f-bfac-4258-8cd1-6661aaca41ef None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:35.804539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8435f-bfac-4258-8cd1-6661aaca41ef None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:35.806735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 910/1832] 10.222.0.20 () {54 vars in 921 bytes} [Mon Nov 8 11:01:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 11:01:35.848461 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfbc8d-b34b-46e5-bd04-36c1f2077a20 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:35.849208 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfbc8d-b34b-46e5-bd04-36c1f2077a20 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:35.849208 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfbc8d-b34b-46e5-bd04-36c1f2077a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:35.871204 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-babfbc8d-b34b-46e5-bd04-36c1f2077a20 None None] MFA Rules not processed for user `d3421cf1bbb24423a2f24c4667adfdda`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:35.873413 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-babfbc8d-b34b-46e5-bd04-36c1f2077a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:36.007775 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 923/1833] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Nov 8 11:01:35 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:36.073894 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8435f-bfac-4258-8cd1-6661aaca41ef None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:36.075987 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6ab8435f-bfac-4258-8cd1-6661aaca41ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:36.095228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8435f-bfac-4258-8cd1-6661aaca41ef None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:36.102856 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4f4b2-09fa-4780-9b9b-4637ed8ba63c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:36.103639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4f4b2-09fa-4780-9b9b-4637ed8ba63c service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:36.103923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4f4b2-09fa-4780-9b9b-4637ed8ba63c service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:36.104195 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4f4b2-09fa-4780-9b9b-4637ed8ba63c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:36.114632 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4f4b2-09fa-4780-9b9b-4637ed8ba63c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:36.116291 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4f4b2-09fa-4780-9b9b-4637ed8ba63c service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:36.128043 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 911/1834] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:01:38.117353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242ffdb-f181-4a02-b10f-94ffc2a59be1 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:38.117889 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242ffdb-f181-4a02-b10f-94ffc2a59be1 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:38.117889 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242ffdb-f181-4a02-b10f-94ffc2a59be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:38.164819 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-e242ffdb-f181-4a02-b10f-94ffc2a59be1 None None] MFA Rules not processed for user `6a6a49ae146b44a4b8e52ce52c128bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:38.166535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e242ffdb-f181-4a02-b10f-94ffc2a59be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:38.297563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 924/1835] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:38 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:38.302053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4f4b2-09fa-4780-9b9b-4637ed8ba63c service nova] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:38.316165 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4f4b2-09fa-4780-9b9b-4637ed8ba63c service nova] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:38.333520 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d581b8-e6ef-440c-9864-6777d7122e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:38.334481 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d581b8-e6ef-440c-9864-6777d7122e78 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:38.334937 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d581b8-e6ef-440c-9864-6777d7122e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:38.335439 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d581b8-e6ef-440c-9864-6777d7122e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:38.336332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d581b8-e6ef-440c-9864-6777d7122e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:38.339951 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d581b8-e6ef-440c-9864-6777d7122e78 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:38.417333 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242ffdb-f181-4a02-b10f-94ffc2a59be1 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:38.418508 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 912/1836] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:38 2021] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:38.425085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e242ffdb-f181-4a02-b10f-94ffc2a59be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:38.425652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d581b8-e6ef-440c-9864-6777d7122e78 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:38.565581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242ffdb-f181-4a02-b10f-94ffc2a59be1 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:38.574121 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d581b8-e6ef-440c-9864-6777d7122e78 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:38.595405 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d47f5-4ac7-4c5d-a45a-90bf3f42ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:38.596562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d47f5-4ac7-4c5d-a45a-90bf3f42ae97 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:38.597008 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d47f5-4ac7-4c5d-a45a-90bf3f42ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:38.597436 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d47f5-4ac7-4c5d-a45a-90bf3f42ae97 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:38.598590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d47f5-4ac7-4c5d-a45a-90bf3f42ae97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:38.600814 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d47f5-4ac7-4c5d-a45a-90bf3f42ae97 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:38.637473 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a2cc5-cc10-4530-a52c-07a40cdcb6d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:38.639228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 913/1837] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:38 2021] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:38.642928 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d47f5-4ac7-4c5d-a45a-90bf3f42ae97 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:38.643465 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a2cc5-cc10-4530-a52c-07a40cdcb6d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:38.643780 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a2cc5-cc10-4530-a52c-07a40cdcb6d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:38.644056 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a2cc5-cc10-4530-a52c-07a40cdcb6d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:38.646256 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9b1a2cc5-cc10-4530-a52c-07a40cdcb6d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:38.660868 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d47f5-4ac7-4c5d-a45a-90bf3f42ae97 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:38.677458 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4aa504-9484-405e-b75b-a3f26ea3ce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:38.678419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aa504-9484-405e-b75b-a3f26ea3ce99 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:38.678842 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aa504-9484-405e-b75b-a3f26ea3ce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:38.679312 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aa504-9484-405e-b75b-a3f26ea3ce99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:38.680274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4aa504-9484-405e-b75b-a3f26ea3ce99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:38.682148 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4aa504-9484-405e-b75b-a3f26ea3ce99 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:38.706976 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 914/1838] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:38 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:38.710920 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4aa504-9484-405e-b75b-a3f26ea3ce99 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:38.721064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4aa504-9484-405e-b75b-a3f26ea3ce99 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:38.726070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec42f68-aee1-4761-a88b-b0c0020c26e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:38.726980 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec42f68-aee1-4761-a88b-b0c0020c26e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:38.727376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec42f68-aee1-4761-a88b-b0c0020c26e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:38.728351 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec42f68-aee1-4761-a88b-b0c0020c26e6 admin admin] PATH_INFO: `/v3/projects/a40ff217ebe54f969ade1960574286ca/users/d5c94046d9dc49bfbccf421c6661a88d/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:38.742380 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a2cc5-cc10-4530-a52c-07a40cdcb6d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:38.744214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a2cc5-cc10-4530-a52c-07a40cdcb6d9 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:38.746745 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec42f68-aee1-4761-a88b-b0c0020c26e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40ff217ebe54f969ade1960574286ca, user_id=d5c94046d9dc49bfbccf421c6661a88d, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:38.749549 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec42f68-aee1-4761-a88b-b0c0020c26e6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:38.755434 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 925/1839] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:38 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:01:38.770940 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 915/1840] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:38 2021] PUT /identity/v3/projects/a40ff217ebe54f969ade1960574286ca/users/d5c94046d9dc49bfbccf421c6661a88d/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:38.775296 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a2cc5-cc10-4530-a52c-07a40cdcb6d9 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:38.788325 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a2cc5-cc10-4530-a52c-07a40cdcb6d9 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:38.868022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165250b-39a1-411f-ba77-fd6fcc607082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:38.868674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165250b-39a1-411f-ba77-fd6fcc607082 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:38.869016 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165250b-39a1-411f-ba77-fd6fcc607082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:38.869322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165250b-39a1-411f-ba77-fd6fcc607082 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:38.870150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165250b-39a1-411f-ba77-fd6fcc607082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:38.872324 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165250b-39a1-411f-ba77-fd6fcc607082 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:38.890196 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 926/1841] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:38 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:38.891647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec42f68-aee1-4761-a88b-b0c0020c26e6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:38.903174 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec42f68-aee1-4761-a88b-b0c0020c26e6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:38.909758 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a0d2d-1e24-4328-9e4f-c939f4e45869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:38.910746 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0d2d-1e24-4328-9e4f-c939f4e45869 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:38.911289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0d2d-1e24-4328-9e4f-c939f4e45869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:38.911783 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0d2d-1e24-4328-9e4f-c939f4e45869 admin admin] PATH_INFO: `/v3/projects/a40ff217ebe54f969ade1960574286ca/users/d5c94046d9dc49bfbccf421c6661a88d/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:38.914044 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a0d2d-1e24-4328-9e4f-c939f4e45869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40ff217ebe54f969ade1960574286ca, user_id=d5c94046d9dc49bfbccf421c6661a88d, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:38.917115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a0d2d-1e24-4328-9e4f-c939f4e45869 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:38.932737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 916/1842] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:38 2021] PUT /identity/v3/projects/a40ff217ebe54f969ade1960574286ca/users/d5c94046d9dc49bfbccf421c6661a88d/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:39.744954 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165250b-39a1-411f-ba77-fd6fcc607082 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:39.747205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e165250b-39a1-411f-ba77-fd6fcc607082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:39.772392 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165250b-39a1-411f-ba77-fd6fcc607082 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:39.846471 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee4fcd-2c9a-4d72-b6a8-89cbae07bc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:39.848070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee4fcd-2c9a-4d72-b6a8-89cbae07bc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:39.848512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee4fcd-2c9a-4d72-b6a8-89cbae07bc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:39.848950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee4fcd-2c9a-4d72-b6a8-89cbae07bc04 admin admin] PATH_INFO: `/v3/users/7fe3ca5065164b3d9ad0c4f710e357c2` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:39.850425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee4fcd-2c9a-4d72-b6a8-89cbae07bc04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe3ca5065164b3d9ad0c4f710e357c2)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:39.852599 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee4fcd-2c9a-4d72-b6a8-89cbae07bc04 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:39.933732 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ce3d6-e9b2-4575-b77f-c02db7469444 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:39.934425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ce3d6-e9b2-4575-b77f-c02db7469444 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:39.934425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ce3d6-e9b2-4575-b77f-c02db7469444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:39.969248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-55ee4fcd-2c9a-4d72-b6a8-89cbae07bc04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe3ca5065164b3d9ad0c4f710e357c2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:39.970860 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-55ee4fcd-2c9a-4d72-b6a8-89cbae07bc04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe3ca5065164b3d9ad0c4f710e357c2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:39.982717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-55ee4fcd-2c9a-4d72-b6a8-89cbae07bc04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe3ca5065164b3d9ad0c4f710e357c2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:39.984558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-55ee4fcd-2c9a-4d72-b6a8-89cbae07bc04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe3ca5065164b3d9ad0c4f710e357c2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:39.996075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-fe7ce3d6-e9b2-4575-b77f-c02db7469444 None None] MFA Rules not processed for user `d5c94046d9dc49bfbccf421c6661a88d`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:39.998867 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-fe7ce3d6-e9b2-4575-b77f-c02db7469444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:39.999335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-55ee4fcd-2c9a-4d72-b6a8-89cbae07bc04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe3ca5065164b3d9ad0c4f710e357c2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:40.022576 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 927/1843] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:39 2021] DELETE /identity/v3/users/7fe3ca5065164b3d9ad0c4f710e357c2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:40.027316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7aca8-1ece-4858-b82f-5665d6e63e36 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:40.027797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7aca8-1ece-4858-b82f-5665d6e63e36 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:40.028809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7aca8-1ece-4858-b82f-5665d6e63e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:40.048753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-3df7aca8-1ece-4858-b82f-5665d6e63e36 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:40.050292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-3df7aca8-1ece-4858-b82f-5665d6e63e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:40.152787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 928/1844] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:40.162354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 917/1845] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:39 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:40.176844 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7aca8-1ece-4858-b82f-5665d6e63e36 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:40.179070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-3df7aca8-1ece-4858-b82f-5665d6e63e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:40.194258 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ce3d6-e9b2-4575-b77f-c02db7469444 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:40.198222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-fe7ce3d6-e9b2-4575-b77f-c02db7469444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:40.324892 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ce3d6-e9b2-4575-b77f-c02db7469444 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:40.336585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7aca8-1ece-4858-b82f-5665d6e63e36 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:40.349872 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcc2a6-dbcf-4461-b1d4-1d0c9006b803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:40.350773 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcc2a6-dbcf-4461-b1d4-1d0c9006b803 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:40.351231 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcc2a6-dbcf-4461-b1d4-1d0c9006b803 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:40.351648 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcc2a6-dbcf-4461-b1d4-1d0c9006b803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:40.355907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6bbcc2a6-dbcf-4461-b1d4-1d0c9006b803 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:40.396921 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae82d06-b46d-4e48-aee7-7f28d98a7d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:40.397720 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae82d06-b46d-4e48-aee7-7f28d98a7d3b service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:40.398198 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae82d06-b46d-4e48-aee7-7f28d98a7d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:40.398474 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae82d06-b46d-4e48-aee7-7f28d98a7d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:40.409768 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae82d06-b46d-4e48-aee7-7f28d98a7d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:40.411724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae82d06-b46d-4e48-aee7-7f28d98a7d3b service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:40.423152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 918/1846] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:40.458964 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcc2a6-dbcf-4461-b1d4-1d0c9006b803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:40.460609 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcc2a6-dbcf-4461-b1d4-1d0c9006b803 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:40.477977 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 929/1847] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:40 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:40.877041 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae82d06-b46d-4e48-aee7-7f28d98a7d3b service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:40.878871 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9ae82d06-b46d-4e48-aee7-7f28d98a7d3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:40.923543 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae82d06-b46d-4e48-aee7-7f28d98a7d3b service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:40.947546 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:40.948507 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:40.948745 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:40.949073 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] PATH_INFO: `/v3/projects/aac8ef5b866d4fb0940bde3f28b69e5d` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:40.959210 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac8ef5b866d4fb0940bde3f28b69e5d)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:40.971459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:41.063670 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac8ef5b866d4fb0940bde3f28b69e5d', 'request_id': 'req-f40204bd-3876-441c-8389-c5250b8fafac'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.072313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac8ef5b866d4fb0940bde3f28b69e5d', 'request_id': 'req-f40204bd-3876-441c-8389-c5250b8fafac'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.079560 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac8ef5b866d4fb0940bde3f28b69e5d', 'request_id': 'req-f40204bd-3876-441c-8389-c5250b8fafac'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.098718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] The token cache is being invalidate because project aac8ef5b866d4fb0940bde3f28b69e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:41.099326 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.100688 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.103369 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 919/1848] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:40 2021] DELETE /identity/v3/projects/aac8ef5b866d4fb0940bde3f28b69e5d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:41.109070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcc2a6-dbcf-4461-b1d4-1d0c9006b803 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:41.125537 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcc2a6-dbcf-4461-b1d4-1d0c9006b803 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:41.254584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9377b-202a-4ec1-97f8-5e50882be3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:41.257861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9377b-202a-4ec1-97f8-5e50882be3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:41.258519 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9377b-202a-4ec1-97f8-5e50882be3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:41.259650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9377b-202a-4ec1-97f8-5e50882be3a4 admin admin] PATH_INFO: `/v3/users/1e3f3467248845ff96e964cee25284f3` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:41.267940 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9377b-202a-4ec1-97f8-5e50882be3a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3f3467248845ff96e964cee25284f3)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:41.273211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9377b-202a-4ec1-97f8-5e50882be3a4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:41.382793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f4d9377b-202a-4ec1-97f8-5e50882be3a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3f3467248845ff96e964cee25284f3'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.384234 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f4d9377b-202a-4ec1-97f8-5e50882be3a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3f3467248845ff96e964cee25284f3'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.398683 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f4d9377b-202a-4ec1-97f8-5e50882be3a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3f3467248845ff96e964cee25284f3'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.399969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f4d9377b-202a-4ec1-97f8-5e50882be3a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3f3467248845ff96e964cee25284f3'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.424815 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f4d9377b-202a-4ec1-97f8-5e50882be3a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3f3467248845ff96e964cee25284f3'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.446880 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 930/1849] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:41 2021] DELETE /identity/v3/users/1e3f3467248845ff96e964cee25284f3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:41.703081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:41.704700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:41.720923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40204bd-3876-441c-8389-c5250b8fafac admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:41.793269 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa24a9-42a3-421b-8c98-bdca0ec7b37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:41.795979 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa24a9-42a3-421b-8c98-bdca0ec7b37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:41.796691 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa24a9-42a3-421b-8c98-bdca0ec7b37f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:41.797202 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa24a9-42a3-421b-8c98-bdca0ec7b37f admin admin] PATH_INFO: `/v3/users/c202115620f341fd96412a13fdde2646` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:41.800169 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa24a9-42a3-421b-8c98-bdca0ec7b37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c202115620f341fd96412a13fdde2646)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:41.802807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa24a9-42a3-421b-8c98-bdca0ec7b37f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:41.851999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9377b-202a-4ec1-97f8-5e50882be3a4 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:41.854700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f4d9377b-202a-4ec1-97f8-5e50882be3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:41.885742 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9377b-202a-4ec1-97f8-5e50882be3a4 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:41.894009 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3536cc5-24b3-43d8-b9e0-892109aedfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:41.894607 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-defa24a9-42a3-421b-8c98-bdca0ec7b37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c202115620f341fd96412a13fdde2646'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.895215 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3536cc5-24b3-43d8-b9e0-892109aedfa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:41.895614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3536cc5-24b3-43d8-b9e0-892109aedfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:41.895736 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-defa24a9-42a3-421b-8c98-bdca0ec7b37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c202115620f341fd96412a13fdde2646'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.896556 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3536cc5-24b3-43d8-b9e0-892109aedfa1 admin admin] PATH_INFO: `/v3/projects/90cd161081f24b6eb1b75829badda48f` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:41.898336 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3536cc5-24b3-43d8-b9e0-892109aedfa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90cd161081f24b6eb1b75829badda48f)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:41.903233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3536cc5-24b3-43d8-b9e0-892109aedfa1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:41.908354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-defa24a9-42a3-421b-8c98-bdca0ec7b37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c202115620f341fd96412a13fdde2646'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.909292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-defa24a9-42a3-421b-8c98-bdca0ec7b37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c202115620f341fd96412a13fdde2646'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.922769 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-defa24a9-42a3-421b-8c98-bdca0ec7b37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c202115620f341fd96412a13fdde2646'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.950499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 920/1850] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:41 2021] DELETE /identity/v3/users/c202115620f341fd96412a13fdde2646 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:41.955273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680343c-bf6f-42b6-9fcb-14e345b98ad4 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:41.955599 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680343c-bf6f-42b6-9fcb-14e345b98ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:41.955900 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680343c-bf6f-42b6-9fcb-14e345b98ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:41.974134 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e3536cc5-24b3-43d8-b9e0-892109aedfa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90cd161081f24b6eb1b75829badda48f', 'request_id': 'req-e3536cc5-24b3-43d8-b9e0-892109aedfa1'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.980379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-d680343c-bf6f-42b6-9fcb-14e345b98ad4 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:41.982028 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d680343c-bf6f-42b6-9fcb-14e345b98ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:41.982553 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e3536cc5-24b3-43d8-b9e0-892109aedfa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90cd161081f24b6eb1b75829badda48f', 'request_id': 'req-e3536cc5-24b3-43d8-b9e0-892109aedfa1'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:41.989433 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e3536cc5-24b3-43d8-b9e0-892109aedfa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90cd161081f24b6eb1b75829badda48f', 'request_id': 'req-e3536cc5-24b3-43d8-b9e0-892109aedfa1'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:42.004032 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e3536cc5-24b3-43d8-b9e0-892109aedfa1 admin admin] The token cache is being invalidate because project 90cd161081f24b6eb1b75829badda48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:42.004430 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e3536cc5-24b3-43d8-b9e0-892109aedfa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:42.004983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e3536cc5-24b3-43d8-b9e0-892109aedfa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:42.006655 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 931/1851] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:41 2021] DELETE /identity/v3/projects/90cd161081f24b6eb1b75829badda48f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:42.013407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4f65f-0840-478c-825c-52b572e044e0 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:42.014229 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4f65f-0840-478c-825c-52b572e044e0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:42.014560 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4f65f-0840-478c-825c-52b572e044e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:42.091157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 921/1852] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:42.103092 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680343c-bf6f-42b6-9fcb-14e345b98ad4 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:42.105815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d680343c-bf6f-42b6-9fcb-14e345b98ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:42.196195 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680343c-bf6f-42b6-9fcb-14e345b98ad4 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:42.203180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f033184-4c31-4a39-8d81-50fe2afece35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:42.204249 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f033184-4c31-4a39-8d81-50fe2afece35 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:42.204249 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f033184-4c31-4a39-8d81-50fe2afece35 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:42.204447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f033184-4c31-4a39-8d81-50fe2afece35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:42.206434 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5f033184-4c31-4a39-8d81-50fe2afece35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:42.216603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-68e4f65f-0840-478c-825c-52b572e044e0 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:42.217963 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-68e4f65f-0840-478c-825c-52b572e044e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:42.228611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 932/1853] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:42.229267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4f65f-0840-478c-825c-52b572e044e0 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:42.231504 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-68e4f65f-0840-478c-825c-52b572e044e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:42.322642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4f65f-0840-478c-825c-52b572e044e0 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:42.338681 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a7ad6-a30d-4fd2-8d81-8358f4e0f524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:42.339759 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a7ad6-a30d-4fd2-8d81-8358f4e0f524 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:42.340239 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a7ad6-a30d-4fd2-8d81-8358f4e0f524 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:42.340952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a7ad6-a30d-4fd2-8d81-8358f4e0f524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:42.355264 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f033184-4c31-4a39-8d81-50fe2afece35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:42.356479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f033184-4c31-4a39-8d81-50fe2afece35 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:42.368047 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a7ad6-a30d-4fd2-8d81-8358f4e0f524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:42.368893 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 922/1854] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:42 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:42.370354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec216be8-3697-4bd3-9f1e-9f23e3002fff None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:42.370702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec216be8-3697-4bd3-9f1e-9f23e3002fff None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:42.371158 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec216be8-3697-4bd3-9f1e-9f23e3002fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:42.371565 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a7ad6-a30d-4fd2-8d81-8358f4e0f524 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:42.398363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-ec216be8-3697-4bd3-9f1e-9f23e3002fff None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:42.400006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-ec216be8-3697-4bd3-9f1e-9f23e3002fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:42.410208 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 933/1855] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:42.421809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a7ad6-a30d-4fd2-8d81-8358f4e0f524 service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:42.423223 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 923/1856] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:42.445419 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a7ad6-a30d-4fd2-8d81-8358f4e0f524 service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:42.454785 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08efe0-0306-4db3-aa2c-3fd4bc4fc893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:42.456372 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08efe0-0306-4db3-aa2c-3fd4bc4fc893 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:42.456650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08efe0-0306-4db3-aa2c-3fd4bc4fc893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:42.457148 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08efe0-0306-4db3-aa2c-3fd4bc4fc893 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:42.458714 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08efe0-0306-4db3-aa2c-3fd4bc4fc893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:42.459289 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08efe0-0306-4db3-aa2c-3fd4bc4fc893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:42.493580 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08efe0-0306-4db3-aa2c-3fd4bc4fc893 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:42.518054 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 934/1857] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:42.522586 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec216be8-3697-4bd3-9f1e-9f23e3002fff None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:42.538397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec216be8-3697-4bd3-9f1e-9f23e3002fff None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:42.558621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893a803-f8c3-4165-80bc-f1f47d033d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:42.581607 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893a803-f8c3-4165-80bc-f1f47d033d9a admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:42.581607 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893a803-f8c3-4165-80bc-f1f47d033d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:42.581607 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893a803-f8c3-4165-80bc-f1f47d033d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:42.597614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893a803-f8c3-4165-80bc-f1f47d033d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:42.620305 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893a803-f8c3-4165-80bc-f1f47d033d9a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:42.713520 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08efe0-0306-4db3-aa2c-3fd4bc4fc893 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:42.725672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 924/1858] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:42 2021] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:42.726514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08efe0-0306-4db3-aa2c-3fd4bc4fc893 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:42.876902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd8c85-9bac-4fbe-9eff-a5dda7c95d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:42.878204 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd8c85-9bac-4fbe-9eff-a5dda7c95d50 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:42.878483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd8c85-9bac-4fbe-9eff-a5dda7c95d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:42.882519 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd8c85-9bac-4fbe-9eff-a5dda7c95d50 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:42.883685 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd8c85-9bac-4fbe-9eff-a5dda7c95d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:42.886280 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd8c85-9bac-4fbe-9eff-a5dda7c95d50 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:42.946379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 935/1859] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:42 2021] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:42.949724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893a803-f8c3-4165-80bc-f1f47d033d9a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:42.968221 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893a803-f8c3-4165-80bc-f1f47d033d9a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:42.982429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef45aa-9a6b-46bf-9198-d3898a6d07e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:42.984254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef45aa-9a6b-46bf-9198-d3898a6d07e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:42.984975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef45aa-9a6b-46bf-9198-d3898a6d07e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:42.985719 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef45aa-9a6b-46bf-9198-d3898a6d07e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:42.986828 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef45aa-9a6b-46bf-9198-d3898a6d07e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:42.989815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef45aa-9a6b-46bf-9198-d3898a6d07e5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:43.003826 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 925/1860] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:42 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:43.009445 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd8c85-9bac-4fbe-9eff-a5dda7c95d50 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:43.028574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd8c85-9bac-4fbe-9eff-a5dda7c95d50 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:43.039594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71895c-95e9-497e-b216-da1dfb47ae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:43.040611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71895c-95e9-497e-b216-da1dfb47ae73 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:43.040995 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71895c-95e9-497e-b216-da1dfb47ae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:43.041372 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71895c-95e9-497e-b216-da1dfb47ae73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:43.044518 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71895c-95e9-497e-b216-da1dfb47ae73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:43.047220 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71895c-95e9-497e-b216-da1dfb47ae73 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:43.052533 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef45aa-9a6b-46bf-9198-d3898a6d07e5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:43.055404 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-a3ef45aa-9a6b-46bf-9198-d3898a6d07e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:43.082548 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef45aa-9a6b-46bf-9198-d3898a6d07e5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:43.088740 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 936/1861] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:43 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:43.090618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:43.091684 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:43.092208 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:43.092642 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] PATH_INFO: `/v3/projects/d4f4c33875464c368797e411ee87bc48` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:43.094227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f4c33875464c368797e411ee87bc48)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:43.094803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71895c-95e9-497e-b216-da1dfb47ae73 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:43.097282 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:43.132746 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71895c-95e9-497e-b216-da1dfb47ae73 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:43.147072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380da8d-c780-4250-a0c0-40702529cf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:43.148227 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380da8d-c780-4250-a0c0-40702529cf42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:43.148645 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380da8d-c780-4250-a0c0-40702529cf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:43.148916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380da8d-c780-4250-a0c0-40702529cf42 admin admin] PATH_INFO: `/v3/projects/21278669fefe4ff6b36532c995833ad8/users/4eae46a75af044109fc29572f339000a/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:43.192846 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380da8d-c780-4250-a0c0-40702529cf42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21278669fefe4ff6b36532c995833ad8, user_id=4eae46a75af044109fc29572f339000a, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:43.203441 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380da8d-c780-4250-a0c0-40702529cf42 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:43.213950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f4c33875464c368797e411ee87bc48', 'request_id': 'req-c4df088c-6d58-497c-887a-a0cfa55780ce'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:43.229063 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f4c33875464c368797e411ee87bc48', 'request_id': 'req-c4df088c-6d58-497c-887a-a0cfa55780ce'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:43.234299 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 937/1862] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:43 2021] PUT /identity/v3/projects/21278669fefe4ff6b36532c995833ad8/users/4eae46a75af044109fc29572f339000a/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:43.245399 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f4c33875464c368797e411ee87bc48', 'request_id': 'req-c4df088c-6d58-497c-887a-a0cfa55780ce'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:43.246266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ce3cc-d4c1-469b-9099-30f165257df3 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:43.246560 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ce3cc-d4c1-469b-9099-30f165257df3 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:43.246840 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ce3cc-d4c1-469b-9099-30f165257df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:43.262983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] The token cache is being invalidate because project d4f4c33875464c368797e411ee87bc48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:43.263417 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:43.264465 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:43.266203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 926/1863] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:43 2021] DELETE /identity/v3/projects/d4f4c33875464c368797e411ee87bc48 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:43.273819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:43.273819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:43.299523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-949ce3cc-d4c1-469b-9099-30f165257df3 None None] MFA Rules not processed for user `4eae46a75af044109fc29572f339000a`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:43.300765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-949ce3cc-d4c1-469b-9099-30f165257df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:43.362721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df088c-6d58-497c-887a-a0cfa55780ce admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:43.375426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 938/1864] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:43 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:43.379531 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ce3cc-d4c1-469b-9099-30f165257df3 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:43.381222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-949ce3cc-d4c1-469b-9099-30f165257df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:43.443779 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9227877-8119-4e13-8fa3-d0ec7d11161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:43.444703 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9227877-8119-4e13-8fa3-d0ec7d11161c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:43.444991 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9227877-8119-4e13-8fa3-d0ec7d11161c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:43.445268 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9227877-8119-4e13-8fa3-d0ec7d11161c admin admin] PATH_INFO: `/v3/users/a8e25ed17a524294b7ccd64387f3e847` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:43.446649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9227877-8119-4e13-8fa3-d0ec7d11161c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e25ed17a524294b7ccd64387f3e847)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:43.448746 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9227877-8119-4e13-8fa3-d0ec7d11161c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:43.458412 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ce3cc-d4c1-469b-9099-30f165257df3 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:43.467285 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975568d-9126-4465-b0a2-bc640a2b772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:43.468025 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975568d-9126-4465-b0a2-bc640a2b772a admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:43.468317 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975568d-9126-4465-b0a2-bc640a2b772a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:43.468597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975568d-9126-4465-b0a2-bc640a2b772a admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:43.469488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975568d-9126-4465-b0a2-bc640a2b772a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:43.474953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975568d-9126-4465-b0a2-bc640a2b772a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:43.510093 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 939/1865] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:43 2021] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:01:43.514410 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975568d-9126-4465-b0a2-bc640a2b772a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:43.516418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e9227877-8119-4e13-8fa3-d0ec7d11161c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e25ed17a524294b7ccd64387f3e847'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:43.517316 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e9227877-8119-4e13-8fa3-d0ec7d11161c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e25ed17a524294b7ccd64387f3e847'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:43.527342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e9227877-8119-4e13-8fa3-d0ec7d11161c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e25ed17a524294b7ccd64387f3e847'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:43.528330 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e9227877-8119-4e13-8fa3-d0ec7d11161c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e25ed17a524294b7ccd64387f3e847'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:43.536932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e9227877-8119-4e13-8fa3-d0ec7d11161c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e25ed17a524294b7ccd64387f3e847'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:43.559550 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 927/1866] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:43 2021] DELETE /identity/v3/users/a8e25ed17a524294b7ccd64387f3e847 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:43.588296 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975568d-9126-4465-b0a2-bc640a2b772a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:43.663625 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73a2f1-5178-4d87-af55-de478a64ed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:43.664768 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73a2f1-5178-4d87-af55-de478a64ed00 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:43.664768 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73a2f1-5178-4d87-af55-de478a64ed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:43.664957 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73a2f1-5178-4d87-af55-de478a64ed00 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:43.665874 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73a2f1-5178-4d87-af55-de478a64ed00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:43.668412 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73a2f1-5178-4d87-af55-de478a64ed00 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:43.701647 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 940/1867] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:43 2021] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:43.703746 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9227877-8119-4e13-8fa3-d0ec7d11161c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:43.706003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e9227877-8119-4e13-8fa3-d0ec7d11161c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:43.720915 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9227877-8119-4e13-8fa3-d0ec7d11161c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:43.726936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee834eb2-f8a3-4405-9753-9e38f61aa1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:43.727750 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee834eb2-f8a3-4405-9753-9e38f61aa1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:43.728079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee834eb2-f8a3-4405-9753-9e38f61aa1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:43.728549 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee834eb2-f8a3-4405-9753-9e38f61aa1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:43.729402 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee834eb2-f8a3-4405-9753-9e38f61aa1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:43.731333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee834eb2-f8a3-4405-9753-9e38f61aa1c3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:43.749194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 928/1868] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:43 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:43.751098 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73a2f1-5178-4d87-af55-de478a64ed00 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:43.768763 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73a2f1-5178-4d87-af55-de478a64ed00 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:43.776078 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63081c-0bc2-4a5c-a359-1bd046cf263d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:43.777155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63081c-0bc2-4a5c-a359-1bd046cf263d admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:43.777483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63081c-0bc2-4a5c-a359-1bd046cf263d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:43.777847 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63081c-0bc2-4a5c-a359-1bd046cf263d admin admin] PATH_INFO: `/v3/projects/31c792d6d2524840982f6cb6037f4898/users/93372de74a144529bd6659b32fc07b8d/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:43.796122 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63081c-0bc2-4a5c-a359-1bd046cf263d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c792d6d2524840982f6cb6037f4898, user_id=93372de74a144529bd6659b32fc07b8d, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:43.802488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63081c-0bc2-4a5c-a359-1bd046cf263d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:43.832313 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 941/1869] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:43 2021] PUT /identity/v3/projects/31c792d6d2524840982f6cb6037f4898/users/93372de74a144529bd6659b32fc07b8d/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:43.837702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee834eb2-f8a3-4405-9753-9e38f61aa1c3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:43.851349 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee834eb2-f8a3-4405-9753-9e38f61aa1c3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:43.943644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4ff6d-9414-4a1b-a599-c0c9b9f29e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:43.944453 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4ff6d-9414-4a1b-a599-c0c9b9f29e50 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:43.944807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4ff6d-9414-4a1b-a599-c0c9b9f29e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:43.945154 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4ff6d-9414-4a1b-a599-c0c9b9f29e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:43.945982 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4ff6d-9414-4a1b-a599-c0c9b9f29e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:43.947895 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4ff6d-9414-4a1b-a599-c0c9b9f29e50 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:43.960051 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 929/1870] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:43 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:43.964606 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63081c-0bc2-4a5c-a359-1bd046cf263d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:43.991679 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63081c-0bc2-4a5c-a359-1bd046cf263d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:44.008316 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4ff6d-9414-4a1b-a599-c0c9b9f29e50 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:44.010983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8ea9b-7461-4114-b441-5cd2f2e27280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:44.011595 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b8d4ff6d-9414-4a1b-a599-c0c9b9f29e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:44.012142 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ea9b-7461-4114-b441-5cd2f2e27280 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:44.012367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ea9b-7461-4114-b441-5cd2f2e27280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:44.012999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ea9b-7461-4114-b441-5cd2f2e27280 admin admin] PATH_INFO: `/v3/projects/31c792d6d2524840982f6cb6037f4898/users/93372de74a144529bd6659b32fc07b8d/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:44.015362 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8ea9b-7461-4114-b441-5cd2f2e27280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c792d6d2524840982f6cb6037f4898, user_id=93372de74a144529bd6659b32fc07b8d, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:44.018330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8ea9b-7461-4114-b441-5cd2f2e27280 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:44.038436 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 942/1871] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:43 2021] PUT /identity/v3/projects/31c792d6d2524840982f6cb6037f4898/users/93372de74a144529bd6659b32fc07b8d/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:44.042064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4ff6d-9414-4a1b-a599-c0c9b9f29e50 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:44.048860 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6565d3-5b02-4fe2-aba3-1abaa44cd62c None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:44.049453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6565d3-5b02-4fe2-aba3-1abaa44cd62c None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:44.049927 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6565d3-5b02-4fe2-aba3-1abaa44cd62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:44.090754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-cf6565d3-5b02-4fe2-aba3-1abaa44cd62c None None] MFA Rules not processed for user `93372de74a144529bd6659b32fc07b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:44.092330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-cf6565d3-5b02-4fe2-aba3-1abaa44cd62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:44.149577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:44.151897 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:44.154866 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:44.155238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] PATH_INFO: `/v3/projects/8e15969d9c2a475dbe86352d72f5efe0` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:44.156695 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e15969d9c2a475dbe86352d72f5efe0)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:44.168462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:44.210067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 943/1872] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:44 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:44.220753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6565d3-5b02-4fe2-aba3-1abaa44cd62c None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:44.223166 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-cf6565d3-5b02-4fe2-aba3-1abaa44cd62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:44.264501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e15969d9c2a475dbe86352d72f5efe0', 'request_id': 'req-34498d60-32e0-4970-a417-00054d80d56f'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.279869 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e15969d9c2a475dbe86352d72f5efe0', 'request_id': 'req-34498d60-32e0-4970-a417-00054d80d56f'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.289129 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e15969d9c2a475dbe86352d72f5efe0', 'request_id': 'req-34498d60-32e0-4970-a417-00054d80d56f'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.313448 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] The token cache is being invalidate because project 8e15969d9c2a475dbe86352d72f5efe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:44.313748 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.315191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.321290 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 930/1873] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:44 2021] DELETE /identity/v3/projects/8e15969d9c2a475dbe86352d72f5efe0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:44.325564 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:44.338839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:44.360913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6565d3-5b02-4fe2-aba3-1abaa44cd62c None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:44.433875 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e09ae4-4480-486c-9d04-d0974f00c7cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:44.434312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09ae4-4480-486c-9d04-d0974f00c7cb service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:44.434602 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09ae4-4480-486c-9d04-d0974f00c7cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:44.434887 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09ae4-4480-486c-9d04-d0974f00c7cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:44.445171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-05e09ae4-4480-486c-9d04-d0974f00c7cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:44.502380 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34498d60-32e0-4970-a417-00054d80d56f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:44.511662 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c405d-8c99-4c27-9672-8e0eb11602e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:44.512945 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c405d-8c99-4c27-9672-8e0eb11602e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:44.513227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c405d-8c99-4c27-9672-8e0eb11602e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:44.513551 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c405d-8c99-4c27-9672-8e0eb11602e2 admin admin] PATH_INFO: `/v3/users/e4f1d376acdb432cb9e268a145bbafdb` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:44.514974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c405d-8c99-4c27-9672-8e0eb11602e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f1d376acdb432cb9e268a145bbafdb)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:44.517014 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c405d-8c99-4c27-9672-8e0eb11602e2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:44.573991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e09ae4-4480-486c-9d04-d0974f00c7cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:44.577257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e09ae4-4480-486c-9d04-d0974f00c7cb service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:44.590751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-758c405d-8c99-4c27-9672-8e0eb11602e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f1d376acdb432cb9e268a145bbafdb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.592206 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-758c405d-8c99-4c27-9672-8e0eb11602e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f1d376acdb432cb9e268a145bbafdb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.597486 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 944/1874] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:44 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:01:44.605486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-758c405d-8c99-4c27-9672-8e0eb11602e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f1d376acdb432cb9e268a145bbafdb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.607353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-758c405d-8c99-4c27-9672-8e0eb11602e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f1d376acdb432cb9e268a145bbafdb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.643297 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-758c405d-8c99-4c27-9672-8e0eb11602e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f1d376acdb432cb9e268a145bbafdb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.653421 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e09ae4-4480-486c-9d04-d0974f00c7cb service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:44.655557 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-05e09ae4-4480-486c-9d04-d0974f00c7cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:44.676811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e09ae4-4480-486c-9d04-d0974f00c7cb service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:44.680384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 931/1875] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:44 2021] DELETE /identity/v3/users/e4f1d376acdb432cb9e268a145bbafdb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:44.686600 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cb9db-af9d-49f7-9481-50e377e499ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:44.688003 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cb9db-af9d-49f7-9481-50e377e499ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:44.688423 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cb9db-af9d-49f7-9481-50e377e499ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:44.688830 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cb9db-af9d-49f7-9481-50e377e499ae admin admin] PATH_INFO: `/v3/users/4eae46a75af044109fc29572f339000a` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:44.690807 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cb9db-af9d-49f7-9481-50e377e499ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eae46a75af044109fc29572f339000a)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:44.701004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cb9db-af9d-49f7-9481-50e377e499ae admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:44.775493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6f4cb9db-af9d-49f7-9481-50e377e499ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eae46a75af044109fc29572f339000a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.776224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6f4cb9db-af9d-49f7-9481-50e377e499ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eae46a75af044109fc29572f339000a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.785265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6f4cb9db-af9d-49f7-9481-50e377e499ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eae46a75af044109fc29572f339000a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.786084 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6f4cb9db-af9d-49f7-9481-50e377e499ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eae46a75af044109fc29572f339000a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.801675 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6f4cb9db-af9d-49f7-9481-50e377e499ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eae46a75af044109fc29572f339000a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:44.818226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93439bd7-1919-4697-98f9-b5b53c07ca50 None None] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:44.818598 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93439bd7-1919-4697-98f9-b5b53c07ca50 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:44.818934 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93439bd7-1919-4697-98f9-b5b53c07ca50 None None] PATH_INFO: `/` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:44.821311 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 932/1876] 10.222.0.20 () {54 vars in 921 bytes} [Mon Nov 8 11:01:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 08 11:01:44.822075 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 945/1877] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:44 2021] DELETE /identity/v3/users/4eae46a75af044109fc29572f339000a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:44.826864 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef26a-6f9e-4042-ad4d-4cd7ff207734 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:44.827255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef26a-6f9e-4042-ad4d-4cd7ff207734 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:44.827753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef26a-6f9e-4042-ad4d-4cd7ff207734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:44.831379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc93ebb-3994-4e35-af5c-1370cc46aa95 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:44.832187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc93ebb-3994-4e35-af5c-1370cc46aa95 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:44.832501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc93ebb-3994-4e35-af5c-1370cc46aa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:44.860895 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-8dc93ebb-3994-4e35-af5c-1370cc46aa95 None None] MFA Rules not processed for user `d3421cf1bbb24423a2f24c4667adfdda`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:44.862299 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8dc93ebb-3994-4e35-af5c-1370cc46aa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:44.862951 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8dfef26a-6f9e-4042-ad4d-4cd7ff207734 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:44.864273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8dfef26a-6f9e-4042-ad4d-4cd7ff207734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:45.008048 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 933/1878] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:45.029272 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfef26a-6f9e-4042-ad4d-4cd7ff207734 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:45.032913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8dfef26a-6f9e-4042-ad4d-4cd7ff207734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:45.036516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 946/1879] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Nov 8 11:01:44 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:45.136124 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfef26a-6f9e-4042-ad4d-4cd7ff207734 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:45.141951 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f8cc-0359-45f7-88dd-da58c4905345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:45.142764 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f8cc-0359-45f7-88dd-da58c4905345 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:45.143166 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f8cc-0359-45f7-88dd-da58c4905345 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:45.143548 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f8cc-0359-45f7-88dd-da58c4905345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:45.159672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2f8cc-0359-45f7-88dd-da58c4905345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:45.161421 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2f8cc-0359-45f7-88dd-da58c4905345 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:45.176049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 934/1880] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:45.206336 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc93ebb-3994-4e35-af5c-1370cc46aa95 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:45.210650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8dc93ebb-3994-4e35-af5c-1370cc46aa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:45.239030 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc93ebb-3994-4e35-af5c-1370cc46aa95 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:45.246522 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:45.248559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:45.249041 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:45.249511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a admin admin] PATH_INFO: `/v3/projects/7e46160805c04184a5d4df93454917ce` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:45.251916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e46160805c04184a5d4df93454917ce)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:45.254832 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:45.404850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e46160805c04184a5d4df93454917ce', 'request_id': 'req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:45.425178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e46160805c04184a5d4df93454917ce', 'request_id': 'req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:45.442727 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f8cc-0359-45f7-88dd-da58c4905345 service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:45.445282 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e2a2f8cc-0359-45f7-88dd-da58c4905345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:45.450771 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e46160805c04184a5d4df93454917ce', 'request_id': 'req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:45.513430 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a admin admin] The token cache is being invalidate because project 7e46160805c04184a5d4df93454917ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:45.515957 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f8cc-0359-45f7-88dd-da58c4905345 service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:45.519947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:45.521766 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6b05bf0d-dfa1-402d-9342-9af7a7764a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:45.525485 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 947/1881] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:45 2021] DELETE /identity/v3/projects/7e46160805c04184a5d4df93454917ce => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:45.543426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2161bd9-92f2-44d0-b001-1f1c37514241 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:45.544641 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2161bd9-92f2-44d0-b001-1f1c37514241 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:45.547509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2161bd9-92f2-44d0-b001-1f1c37514241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:45.642914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-f2161bd9-92f2-44d0-b001-1f1c37514241 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:45.652988 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f2161bd9-92f2-44d0-b001-1f1c37514241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:45.671580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28e4cf-6c80-4346-a679-ab3d063aa1f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:45.672566 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28e4cf-6c80-4346-a679-ab3d063aa1f3 service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:45.672867 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28e4cf-6c80-4346-a679-ab3d063aa1f3 service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:45.673141 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28e4cf-6c80-4346-a679-ab3d063aa1f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:45.675228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-da28e4cf-6c80-4346-a679-ab3d063aa1f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:45.706538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28e4cf-6c80-4346-a679-ab3d063aa1f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:45.711292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28e4cf-6c80-4346-a679-ab3d063aa1f3 service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:45.727376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 935/1882] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:45 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:45.803967 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617164bb-95c2-4b1c-b1d3-61022d8edae7 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:45.804858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617164bb-95c2-4b1c-b1d3-61022d8edae7 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:45.804858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617164bb-95c2-4b1c-b1d3-61022d8edae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:45.816738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 948/1883] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:45.829848 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-617164bb-95c2-4b1c-b1d3-61022d8edae7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:45.831213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-617164bb-95c2-4b1c-b1d3-61022d8edae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:45.850162 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2161bd9-92f2-44d0-b001-1f1c37514241 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:45.851724 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f2161bd9-92f2-44d0-b001-1f1c37514241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:45.864409 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2161bd9-92f2-44d0-b001-1f1c37514241 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:45.869817 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:45.870830 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:45.871106 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:45.871403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] PATH_INFO: `/v3/projects/21278669fefe4ff6b36532c995833ad8` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:45.872951 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] RBAC: Authorizing `identity:delete_project(project_id=21278669fefe4ff6b36532c995833ad8)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:45.874631 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 936/1884] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:45.878325 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:45.910387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617164bb-95c2-4b1c-b1d3-61022d8edae7 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:45.944839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617164bb-95c2-4b1c-b1d3-61022d8edae7 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:45.979055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21278669fefe4ff6b36532c995833ad8', 'request_id': 'req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:45.990082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21278669fefe4ff6b36532c995833ad8', 'request_id': 'req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:46.000004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21278669fefe4ff6b36532c995833ad8', 'request_id': 'req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:46.033014 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] The token cache is being invalidate because project 21278669fefe4ff6b36532c995833ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:46.033360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:46.034196 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:46.036712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 949/1885] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:45 2021] DELETE /identity/v3/projects/21278669fefe4ff6b36532c995833ad8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:46.041474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:46.046224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:46.066631 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca40f9f-729b-45da-a0e1-c02c9353740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:46.067780 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca40f9f-729b-45da-a0e1-c02c9353740a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.068111 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca40f9f-729b-45da-a0e1-c02c9353740a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.068874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca40f9f-729b-45da-a0e1-c02c9353740a admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.070708 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca40f9f-729b-45da-a0e1-c02c9353740a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:46.071024 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca40f9f-729b-45da-a0e1-c02c9353740a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:46.072941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca40f9f-729b-45da-a0e1-c02c9353740a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:46.088128 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 937/1886] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:46.092520 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca40f9f-729b-45da-a0e1-c02c9353740a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:46.094440 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5ca40f9f-729b-45da-a0e1-c02c9353740a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:46.109871 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca40f9f-729b-45da-a0e1-c02c9353740a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:46.117821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57246e-f462-4c10-a659-e74f1d210a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:46.118806 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57246e-f462-4c10-a659-e74f1d210a1d admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.119094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57246e-f462-4c10-a659-e74f1d210a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.119405 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57246e-f462-4c10-a659-e74f1d210a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.120134 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57246e-f462-4c10-a659-e74f1d210a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:46.122123 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57246e-f462-4c10-a659-e74f1d210a1d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:46.146509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3c3f1-ad5f-4795-bd3a-993d5cda292a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:46.151536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d25859-bcc8-4ddd-bd53-fe134aa3bd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:46.152682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d25859-bcc8-4ddd-bd53-fe134aa3bd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.153011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d25859-bcc8-4ddd-bd53-fe134aa3bd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.153224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d25859-bcc8-4ddd-bd53-fe134aa3bd83 admin admin] PATH_INFO: `/v3/users/93372de74a144529bd6659b32fc07b8d` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.154774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d25859-bcc8-4ddd-bd53-fe134aa3bd83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93372de74a144529bd6659b32fc07b8d)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:46.156289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 938/1887] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:46 2021] POST /identity/v3/projects => generated 409 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:01:46.160396 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57246e-f462-4c10-a659-e74f1d210a1d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:46.161749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d25859-bcc8-4ddd-bd53-fe134aa3bd83 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:46.223777 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-27d25859-bcc8-4ddd-bd53-fe134aa3bd83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93372de74a144529bd6659b32fc07b8d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:46.224503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-27d25859-bcc8-4ddd-bd53-fe134aa3bd83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93372de74a144529bd6659b32fc07b8d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:46.232737 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-27d25859-bcc8-4ddd-bd53-fe134aa3bd83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93372de74a144529bd6659b32fc07b8d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:46.233563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-27d25859-bcc8-4ddd-bd53-fe134aa3bd83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93372de74a144529bd6659b32fc07b8d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:46.246296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57246e-f462-4c10-a659-e74f1d210a1d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:46.249463 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-27d25859-bcc8-4ddd-bd53-fe134aa3bd83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93372de74a144529bd6659b32fc07b8d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:46.251253 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe23ac-03a3-49c4-9e18-73d46dba6c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:46.252044 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe23ac-03a3-49c4-9e18-73d46dba6c9e admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.252423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe23ac-03a3-49c4-9e18-73d46dba6c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.252791 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe23ac-03a3-49c4-9e18-73d46dba6c9e admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.253626 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe23ac-03a3-49c4-9e18-73d46dba6c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:46.255748 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe23ac-03a3-49c4-9e18-73d46dba6c9e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:46.266133 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 950/1888] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:46 2021] DELETE /identity/v3/users/93372de74a144529bd6659b32fc07b8d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:46.288990 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 939/1889] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:46 2021] POST /identity/v3/users => generated 305 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:46.290537 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d25859-bcc8-4ddd-bd53-fe134aa3bd83 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:46.292445 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-27d25859-bcc8-4ddd-bd53-fe134aa3bd83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:46.379327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d25859-bcc8-4ddd-bd53-fe134aa3bd83 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:46.384241 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474ed60-d728-47d6-a77d-504217859aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:46.384937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474ed60-d728-47d6-a77d-504217859aaa admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.385216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474ed60-d728-47d6-a77d-504217859aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.385795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474ed60-d728-47d6-a77d-504217859aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.386693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474ed60-d728-47d6-a77d-504217859aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:46.388720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474ed60-d728-47d6-a77d-504217859aaa admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:46.399412 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 951/1890] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:46 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:46.404378 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe23ac-03a3-49c4-9e18-73d46dba6c9e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:46.420613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe23ac-03a3-49c4-9e18-73d46dba6c9e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:46.426753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb8916-26cb-46ff-a8ab-b2c8b1488ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:46.427623 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb8916-26cb-46ff-a8ab-b2c8b1488ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.427926 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb8916-26cb-46ff-a8ab-b2c8b1488ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.428229 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb8916-26cb-46ff-a8ab-b2c8b1488ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.429075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb8916-26cb-46ff-a8ab-b2c8b1488ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:46.431164 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb8916-26cb-46ff-a8ab-b2c8b1488ca8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:46.465191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 940/1891] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:46 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:46.470005 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474ed60-d728-47d6-a77d-504217859aaa admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:46.485418 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474ed60-d728-47d6-a77d-504217859aaa admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:46.496123 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924d2f9-7ff8-4299-8637-82bbeb8a30a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:46.497046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924d2f9-7ff8-4299-8637-82bbeb8a30a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.497436 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924d2f9-7ff8-4299-8637-82bbeb8a30a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.497712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924d2f9-7ff8-4299-8637-82bbeb8a30a5 admin admin] PATH_INFO: `/v3/projects/d478375e18414ef0ba1eaece7fcb4b8e/users/e05a1fd6a1bf48fd869e79be339de763/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.523990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924d2f9-7ff8-4299-8637-82bbeb8a30a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d478375e18414ef0ba1eaece7fcb4b8e, user_id=e05a1fd6a1bf48fd869e79be339de763, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:46.528640 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924d2f9-7ff8-4299-8637-82bbeb8a30a5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:46.556230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 952/1892] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:46 2021] PUT /identity/v3/projects/d478375e18414ef0ba1eaece7fcb4b8e/users/e05a1fd6a1bf48fd869e79be339de763/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:46.569093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac138b-ef47-4450-8289-2dcc466977fd None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.569443 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac138b-ef47-4450-8289-2dcc466977fd None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.569795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac138b-ef47-4450-8289-2dcc466977fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.613590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-b1ac138b-ef47-4450-8289-2dcc466977fd None None] MFA Rules not processed for user `e05a1fd6a1bf48fd869e79be339de763`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:46.614587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b1ac138b-ef47-4450-8289-2dcc466977fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:46.675859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924d2f9-7ff8-4299-8637-82bbeb8a30a5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:46.678139 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-3924d2f9-7ff8-4299-8637-82bbeb8a30a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:46.724843 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 941/1893] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:46 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:46.725722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac138b-ef47-4450-8289-2dcc466977fd None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:46.793358 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924d2f9-7ff8-4299-8637-82bbeb8a30a5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:46.798418 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9660e2-db7c-4e18-a83c-3206d2d330d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:46.799352 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9660e2-db7c-4e18-a83c-3206d2d330d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.799637 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9660e2-db7c-4e18-a83c-3206d2d330d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.799913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9660e2-db7c-4e18-a83c-3206d2d330d4 admin admin] PATH_INFO: `/v3/projects/31c792d6d2524840982f6cb6037f4898` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.801254 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9660e2-db7c-4e18-a83c-3206d2d330d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c792d6d2524840982f6cb6037f4898)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:46.803371 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9660e2-db7c-4e18-a83c-3206d2d330d4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:46.807212 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac138b-ef47-4450-8289-2dcc466977fd None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:46.813236 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114458f-1c71-4563-96f2-8a7b16c069a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:46.813930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114458f-1c71-4563-96f2-8a7b16c069a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.814561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114458f-1c71-4563-96f2-8a7b16c069a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.814849 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114458f-1c71-4563-96f2-8a7b16c069a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.815612 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114458f-1c71-4563-96f2-8a7b16c069a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:46.817580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114458f-1c71-4563-96f2-8a7b16c069a2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:46.847951 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 942/1894] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:46 2021] POST /identity/v3/projects => generated 409 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:46.852803 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114458f-1c71-4563-96f2-8a7b16c069a2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:46.859584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2e9660e2-db7c-4e18-a83c-3206d2d330d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c792d6d2524840982f6cb6037f4898', 'request_id': 'req-2e9660e2-db7c-4e18-a83c-3206d2d330d4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:46.866522 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2e9660e2-db7c-4e18-a83c-3206d2d330d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c792d6d2524840982f6cb6037f4898', 'request_id': 'req-2e9660e2-db7c-4e18-a83c-3206d2d330d4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:46.874950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2e9660e2-db7c-4e18-a83c-3206d2d330d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c792d6d2524840982f6cb6037f4898', 'request_id': 'req-2e9660e2-db7c-4e18-a83c-3206d2d330d4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:46.891830 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2e9660e2-db7c-4e18-a83c-3206d2d330d4 admin admin] The token cache is being invalidate because project 31c792d6d2524840982f6cb6037f4898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:46.892119 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2e9660e2-db7c-4e18-a83c-3206d2d330d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:46.892962 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2e9660e2-db7c-4e18-a83c-3206d2d330d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:46.899328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 953/1895] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:46 2021] DELETE /identity/v3/projects/31c792d6d2524840982f6cb6037f4898 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:46.901075 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815db0c7-c58e-4279-8983-478a5fe7cb76 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.901548 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815db0c7-c58e-4279-8983-478a5fe7cb76 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.901942 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815db0c7-c58e-4279-8983-478a5fe7cb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.924037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-815db0c7-c58e-4279-8983-478a5fe7cb76 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:46.925285 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-815db0c7-c58e-4279-8983-478a5fe7cb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:46.941169 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114458f-1c71-4563-96f2-8a7b16c069a2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:46.941368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 954/1896] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:46.941447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7930-9cea-40f4-8bbc-8921a3033582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:46.941877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7930-9cea-40f4-8bbc-8921a3033582 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.942196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7930-9cea-40f4-8bbc-8921a3033582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.942514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7930-9cea-40f4-8bbc-8921a3033582 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.943214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a846-6fba-48a8-bc2e-aa7a363027ad None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.943327 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7930-9cea-40f4-8bbc-8921a3033582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:46.943509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a846-6fba-48a8-bc2e-aa7a363027ad None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.943829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a846-6fba-48a8-bc2e-aa7a363027ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.945518 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7930-9cea-40f4-8bbc-8921a3033582 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:46.963384 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-9da5a846-6fba-48a8-bc2e-aa7a363027ad None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:46.964839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9da5a846-6fba-48a8-bc2e-aa7a363027ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:46.971437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 943/1897] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:46 2021] POST /identity/v3/users => generated 311 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:46.975341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7930-9cea-40f4-8bbc-8921a3033582 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:46.977185 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-11ce7930-9cea-40f4-8bbc-8921a3033582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:46.980750 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 955/1898] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:46.981878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5a846-6fba-48a8-bc2e-aa7a363027ad None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:46.991786 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5a846-6fba-48a8-bc2e-aa7a363027ad None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:46.992402 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7930-9cea-40f4-8bbc-8921a3033582 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:46.997682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349e872-39b7-434a-bc00-71c2d9a002eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:46.997865 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e33829-bee0-4a31-a242-d6da2ff93cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:46.998390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33829-bee0-4a31-a242-d6da2ff93cec admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.998676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33829-bee0-4a31-a242-d6da2ff93cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.998802 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349e872-39b7-434a-bc00-71c2d9a002eb admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:46.998961 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349e872-39b7-434a-bc00-71c2d9a002eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:46.999069 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33829-bee0-4a31-a242-d6da2ff93cec admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.999283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349e872-39b7-434a-bc00-71c2d9a002eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:46.999748 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e33829-bee0-4a31-a242-d6da2ff93cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:46.999991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349e872-39b7-434a-bc00-71c2d9a002eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:47.000294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349e872-39b7-434a-bc00-71c2d9a002eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:47.001627 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e33829-bee0-4a31-a242-d6da2ff93cec admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.002043 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349e872-39b7-434a-bc00-71c2d9a002eb admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.015231 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 956/1899] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 11:01:47.017447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349e872-39b7-434a-bc00-71c2d9a002eb admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:47.020131 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 944/1900] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:46 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:47.021126 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e33829-bee0-4a31-a242-d6da2ff93cec admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:47.032248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349e872-39b7-434a-bc00-71c2d9a002eb admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:47.032510 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e33829-bee0-4a31-a242-d6da2ff93cec admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:47.037573 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f4f70-f5e1-4893-8917-46dd2305df6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:47.037765 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d7e59-a9ae-40af-a27f-0bfb51b4f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:47.038572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d7e59-a9ae-40af-a27f-0bfb51b4f0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.038945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f4f70-f5e1-4893-8917-46dd2305df6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.039213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d7e59-a9ae-40af-a27f-0bfb51b4f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.039322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f4f70-f5e1-4893-8917-46dd2305df6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.039540 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f4f70-f5e1-4893-8917-46dd2305df6f admin admin] PATH_INFO: `/v3/projects/04ee181a0b58449fa0dacaba2ea416bf/users/6dd95a6f162d4d0fb030ffc9feb18c3b/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.039884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d7e59-a9ae-40af-a27f-0bfb51b4f0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.040799 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d7e59-a9ae-40af-a27f-0bfb51b4f0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:47.043023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d7e59-a9ae-40af-a27f-0bfb51b4f0c0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.058582 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f4f70-f5e1-4893-8917-46dd2305df6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ee181a0b58449fa0dacaba2ea416bf, user_id=6dd95a6f162d4d0fb030ffc9feb18c3b, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:47.062199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f4f70-f5e1-4893-8917-46dd2305df6f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.087508 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 957/1901] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:47 2021] PUT /identity/v3/projects/04ee181a0b58449fa0dacaba2ea416bf/users/6dd95a6f162d4d0fb030ffc9feb18c3b/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:47.090174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f4f70-f5e1-4893-8917-46dd2305df6f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:47.094057 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 945/1902] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:47 2021] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:47.096130 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d7e59-a9ae-40af-a27f-0bfb51b4f0c0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:47.197182 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d7e59-a9ae-40af-a27f-0bfb51b4f0c0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:47.197527 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f4f70-f5e1-4893-8917-46dd2305df6f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:47.203096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a46f3-e5d7-483a-81e1-097a19a41aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:47.203811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a46f3-e5d7-483a-81e1-097a19a41aaf admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.204095 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a46f3-e5d7-483a-81e1-097a19a41aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.204384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a50e8d-8da7-4b61-995e-16da52e31a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:47.204501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a46f3-e5d7-483a-81e1-097a19a41aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.205169 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a46f3-e5d7-483a-81e1-097a19a41aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:47.205276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50e8d-8da7-4b61-995e-16da52e31a83 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.205601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50e8d-8da7-4b61-995e-16da52e31a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.205936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50e8d-8da7-4b61-995e-16da52e31a83 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.206736 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a50e8d-8da7-4b61-995e-16da52e31a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:47.206862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a46f3-e5d7-483a-81e1-097a19a41aaf admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.209114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a50e8d-8da7-4b61-995e-16da52e31a83 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.217490 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 958/1903] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:47 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:47.221801 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a46f3-e5d7-483a-81e1-097a19a41aaf admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:47.233980 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a46f3-e5d7-483a-81e1-097a19a41aaf admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:47.235706 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 946/1904] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:47 2021] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:01:47.240377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917bac3-bcf7-407e-9405-6a893b40abc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:47.241251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a50e8d-8da7-4b61-995e-16da52e31a83 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:47.241514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917bac3-bcf7-407e-9405-6a893b40abc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.241885 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917bac3-bcf7-407e-9405-6a893b40abc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.242251 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917bac3-bcf7-407e-9405-6a893b40abc8 admin admin] PATH_INFO: `/v3/projects/04ee181a0b58449fa0dacaba2ea416bf/users/6dd95a6f162d4d0fb030ffc9feb18c3b/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.245194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917bac3-bcf7-407e-9405-6a893b40abc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ee181a0b58449fa0dacaba2ea416bf, user_id=6dd95a6f162d4d0fb030ffc9feb18c3b, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:47.251616 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917bac3-bcf7-407e-9405-6a893b40abc8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.259422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a50e8d-8da7-4b61-995e-16da52e31a83 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:47.270540 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 959/1905] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:47 2021] PUT /identity/v3/projects/04ee181a0b58449fa0dacaba2ea416bf/users/6dd95a6f162d4d0fb030ffc9feb18c3b/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:47.292993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26c551-6cd2-4c7f-8bc7-ae0d5e72f231 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.293769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26c551-6cd2-4c7f-8bc7-ae0d5e72f231 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.294211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26c551-6cd2-4c7f-8bc7-ae0d5e72f231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.333865 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-1e26c551-6cd2-4c7f-8bc7-ae0d5e72f231 None None] MFA Rules not processed for user `6dd95a6f162d4d0fb030ffc9feb18c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:47.335323 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1e26c551-6cd2-4c7f-8bc7-ae0d5e72f231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:47.354719 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d45539-d593-4918-b9de-22445560fb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:47.355562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d45539-d593-4918-b9de-22445560fb71 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.355853 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d45539-d593-4918-b9de-22445560fb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.356117 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d45539-d593-4918-b9de-22445560fb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.358509 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d45539-d593-4918-b9de-22445560fb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:47.360376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d45539-d593-4918-b9de-22445560fb71 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.384045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 947/1906] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:47 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:47.385546 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d45539-d593-4918-b9de-22445560fb71 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:47.402580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d45539-d593-4918-b9de-22445560fb71 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:47.414199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a75db-4a27-433f-bb4a-6d3f6938544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:47.417312 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a75db-4a27-433f-bb4a-6d3f6938544d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.418122 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a75db-4a27-433f-bb4a-6d3f6938544d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.418575 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a75db-4a27-433f-bb4a-6d3f6938544d admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.419666 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a75db-4a27-433f-bb4a-6d3f6938544d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:47.422454 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a75db-4a27-433f-bb4a-6d3f6938544d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.436801 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 948/1907] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:47 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:47.441040 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a75db-4a27-433f-bb4a-6d3f6938544d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:47.457819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a75db-4a27-433f-bb4a-6d3f6938544d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:47.464908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317a78d-3659-4a51-8cf7-9907f2154027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:47.466002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a78d-3659-4a51-8cf7-9907f2154027 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.466337 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a78d-3659-4a51-8cf7-9907f2154027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.466683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a78d-3659-4a51-8cf7-9907f2154027 admin admin] PATH_INFO: `/v3/projects/94c6b08efc7a40dc81aa12fec24abd1b/users/468cdd4261e44491ac3a4cd7fd1f3fbc/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.485036 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317a78d-3659-4a51-8cf7-9907f2154027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c6b08efc7a40dc81aa12fec24abd1b, user_id=468cdd4261e44491ac3a4cd7fd1f3fbc, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:47.487780 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317a78d-3659-4a51-8cf7-9907f2154027 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.502317 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 960/1908] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:47 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:47.503636 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 949/1909] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:47 2021] PUT /identity/v3/projects/94c6b08efc7a40dc81aa12fec24abd1b/users/468cdd4261e44491ac3a4cd7fd1f3fbc/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:47.514507 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317a78d-3659-4a51-8cf7-9907f2154027 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:47.514695 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845f94a-72bc-40d5-b4df-420062507e46 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.514890 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845f94a-72bc-40d5-b4df-420062507e46 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.515237 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845f94a-72bc-40d5-b4df-420062507e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.516300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5317a78d-3659-4a51-8cf7-9907f2154027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:47.549644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-5845f94a-72bc-40d5-b4df-420062507e46 None None] MFA Rules not processed for user `468cdd4261e44491ac3a4cd7fd1f3fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:47.551333 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-5845f94a-72bc-40d5-b4df-420062507e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:47.591693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317a78d-3659-4a51-8cf7-9907f2154027 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:47.595963 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9399bc-3597-46b3-a097-a044bd0c45fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:47.596755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9399bc-3597-46b3-a097-a044bd0c45fe service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.597100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9399bc-3597-46b3-a097-a044bd0c45fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.597439 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9399bc-3597-46b3-a097-a044bd0c45fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.626171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 961/1910] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:47 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:47.630682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845f94a-72bc-40d5-b4df-420062507e46 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:47.687660 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9399bc-3597-46b3-a097-a044bd0c45fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:47.689310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9399bc-3597-46b3-a097-a044bd0c45fe service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.700204 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 950/1911] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:47 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:01:47.703314 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845f94a-72bc-40d5-b4df-420062507e46 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:47.708506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b097f-e633-4bef-ae00-2d48d62f6499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:47.709244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b097f-e633-4bef-ae00-2d48d62f6499 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.709571 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b097f-e633-4bef-ae00-2d48d62f6499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.709861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b097f-e633-4bef-ae00-2d48d62f6499 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.710791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b097f-e633-4bef-ae00-2d48d62f6499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:47.713173 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b097f-e633-4bef-ae00-2d48d62f6499 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.749675 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 962/1912] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:47 2021] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:01:47.753774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9399bc-3597-46b3-a097-a044bd0c45fe service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:47.765832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9399bc-3597-46b3-a097-a044bd0c45fe service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:47.833477 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b6969-d6ce-42dd-ade8-977f74a78241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:47.834322 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b6969-d6ce-42dd-ade8-977f74a78241 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.834483 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b6969-d6ce-42dd-ade8-977f74a78241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.834890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b6969-d6ce-42dd-ade8-977f74a78241 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.835497 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b6969-d6ce-42dd-ade8-977f74a78241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:47.837504 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b6969-d6ce-42dd-ade8-977f74a78241 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.862212 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 951/1913] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:47 2021] POST /identity/v3/users => generated 301 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:01:47.862581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b097f-e633-4bef-ae00-2d48d62f6499 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:47.863501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b6969-d6ce-42dd-ade8-977f74a78241 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:47.873546 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b6969-d6ce-42dd-ade8-977f74a78241 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:47.882993 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df957102-1887-41c8-9e8f-a28cc9aecd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:47.884456 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df957102-1887-41c8-9e8f-a28cc9aecd87 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.884914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df957102-1887-41c8-9e8f-a28cc9aecd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.885331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df957102-1887-41c8-9e8f-a28cc9aecd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.887076 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df957102-1887-41c8-9e8f-a28cc9aecd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:47.890130 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df957102-1887-41c8-9e8f-a28cc9aecd87 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.902590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 952/1914] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:47 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:47.906951 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df957102-1887-41c8-9e8f-a28cc9aecd87 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:47.919033 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df957102-1887-41c8-9e8f-a28cc9aecd87 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:47.924064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f098200-96d9-41e7-9253-c33b16dd1585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:47.924979 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f098200-96d9-41e7-9253-c33b16dd1585 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.925261 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f098200-96d9-41e7-9253-c33b16dd1585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.925537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f098200-96d9-41e7-9253-c33b16dd1585 admin admin] PATH_INFO: `/v3/projects/4a29297928d64fd38544fdef8eea34f1/users/bf58e53e32bc42f5840a396fd1280a8d/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.936644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b097f-e633-4bef-ae00-2d48d62f6499 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:47.941281 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e16140-7eff-4f9d-803c-228abf098df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:47.942219 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16140-7eff-4f9d-803c-228abf098df0 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:47.942503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16140-7eff-4f9d-803c-228abf098df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:47.942778 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16140-7eff-4f9d-803c-228abf098df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:47.944978 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f098200-96d9-41e7-9253-c33b16dd1585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a29297928d64fd38544fdef8eea34f1, user_id=bf58e53e32bc42f5840a396fd1280a8d, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:47.945328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f4e16140-7eff-4f9d-803c-228abf098df0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:47.947907 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f098200-96d9-41e7-9253-c33b16dd1585 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:47.972088 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 953/1915] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:47 2021] PUT /identity/v3/projects/4a29297928d64fd38544fdef8eea34f1/users/bf58e53e32bc42f5840a396fd1280a8d/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:47.978027 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f098200-96d9-41e7-9253-c33b16dd1585 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:48.028904 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e16140-7eff-4f9d-803c-228abf098df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:48.030379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e16140-7eff-4f9d-803c-228abf098df0 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:48.040292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 963/1916] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:47 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:48.045806 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f098200-96d9-41e7-9253-c33b16dd1585 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:48.051074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059ca2b-881d-4aca-be2f-b3fa05127a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:48.053482 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059ca2b-881d-4aca-be2f-b3fa05127a5d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:48.053789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059ca2b-881d-4aca-be2f-b3fa05127a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:48.054067 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059ca2b-881d-4aca-be2f-b3fa05127a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:48.054898 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059ca2b-881d-4aca-be2f-b3fa05127a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:48.056792 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059ca2b-881d-4aca-be2f-b3fa05127a5d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:48.070805 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 954/1917] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:47 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:48.072058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e16140-7eff-4f9d-803c-228abf098df0 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:48.086099 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e16140-7eff-4f9d-803c-228abf098df0 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:48.092534 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a80d8-0cfb-4c2a-aa35-1180cc7dcad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:48.093197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a80d8-0cfb-4c2a-aa35-1180cc7dcad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:48.093479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a80d8-0cfb-4c2a-aa35-1180cc7dcad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:48.093748 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a80d8-0cfb-4c2a-aa35-1180cc7dcad9 admin admin] PATH_INFO: `/v3/projects/4a29297928d64fd38544fdef8eea34f1/users/bf58e53e32bc42f5840a396fd1280a8d/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:48.095816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a80d8-0cfb-4c2a-aa35-1180cc7dcad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a29297928d64fd38544fdef8eea34f1, user_id=bf58e53e32bc42f5840a396fd1280a8d, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:48.098866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a80d8-0cfb-4c2a-aa35-1180cc7dcad9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:48.118459 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 964/1918] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:48 2021] PUT /identity/v3/projects/4a29297928d64fd38544fdef8eea34f1/users/bf58e53e32bc42f5840a396fd1280a8d/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:48.129571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf351c4d-2722-436d-8937-89cbdd101fb5 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:48.130093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf351c4d-2722-436d-8937-89cbdd101fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:48.130173 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf351c4d-2722-436d-8937-89cbdd101fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:48.171604 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-cf351c4d-2722-436d-8937-89cbdd101fb5 None None] MFA Rules not processed for user `bf58e53e32bc42f5840a396fd1280a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:48.173478 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-cf351c4d-2722-436d-8937-89cbdd101fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:48.269624 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 955/1919] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:48 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:48.280993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a80d8-0cfb-4c2a-aa35-1180cc7dcad9 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:48.282309 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b01a80d8-0cfb-4c2a-aa35-1180cc7dcad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:48.353488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a80d8-0cfb-4c2a-aa35-1180cc7dcad9 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:48.357992 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8bc4d-c50f-46ee-b696-bd393d9e65a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:48.358659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8bc4d-c50f-46ee-b696-bd393d9e65a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:48.359115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8bc4d-c50f-46ee-b696-bd393d9e65a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:48.359428 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8bc4d-c50f-46ee-b696-bd393d9e65a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:48.370380 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8bc4d-c50f-46ee-b696-bd393d9e65a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:48.372315 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8bc4d-c50f-46ee-b696-bd393d9e65a4 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:48.396106 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 965/1920] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:48 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:48.546218 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf351c4d-2722-436d-8937-89cbdd101fb5 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:48.616002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf351c4d-2722-436d-8937-89cbdd101fb5 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:48.622142 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420129f-7c4e-4db5-babb-4fb31811e1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:48.622573 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420129f-7c4e-4db5-babb-4fb31811e1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:48.622880 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420129f-7c4e-4db5-babb-4fb31811e1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:48.623219 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420129f-7c4e-4db5-babb-4fb31811e1c5 admin admin] PATH_INFO: `/v3/users/468cdd4261e44491ac3a4cd7fd1f3fbc` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:48.624565 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420129f-7c4e-4db5-babb-4fb31811e1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=468cdd4261e44491ac3a4cd7fd1f3fbc)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:48.626710 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420129f-7c4e-4db5-babb-4fb31811e1c5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:48.693103 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-4420129f-7c4e-4db5-babb-4fb31811e1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468cdd4261e44491ac3a4cd7fd1f3fbc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:48.694271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-4420129f-7c4e-4db5-babb-4fb31811e1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468cdd4261e44491ac3a4cd7fd1f3fbc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:48.712706 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-4420129f-7c4e-4db5-babb-4fb31811e1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468cdd4261e44491ac3a4cd7fd1f3fbc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:48.713443 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-4420129f-7c4e-4db5-babb-4fb31811e1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468cdd4261e44491ac3a4cd7fd1f3fbc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:48.725245 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-4420129f-7c4e-4db5-babb-4fb31811e1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468cdd4261e44491ac3a4cd7fd1f3fbc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:48.770453 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 956/1921] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:48 2021] DELETE /identity/v3/users/468cdd4261e44491ac3a4cd7fd1f3fbc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:48.776374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f62e-8bf2-46fa-8c81-ba861bdd20b1 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:48.777062 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f62e-8bf2-46fa-8c81-ba861bdd20b1 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:48.777062 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f62e-8bf2-46fa-8c81-ba861bdd20b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:48.797784 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-b300f62e-8bf2-46fa-8c81-ba861bdd20b1 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:48.799097 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b300f62e-8bf2-46fa-8c81-ba861bdd20b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:48.871768 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 966/1922] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:48.881095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420129f-7c4e-4db5-babb-4fb31811e1c5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:48.889028 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-4420129f-7c4e-4db5-babb-4fb31811e1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:48.964272 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420129f-7c4e-4db5-babb-4fb31811e1c5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:48.969272 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7198a9d-9118-40b2-8edb-6aaded5e7b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:48.970242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7198a9d-9118-40b2-8edb-6aaded5e7b99 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:48.970767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7198a9d-9118-40b2-8edb-6aaded5e7b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:48.971229 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7198a9d-9118-40b2-8edb-6aaded5e7b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:48.984277 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7198a9d-9118-40b2-8edb-6aaded5e7b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:48.986429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7198a9d-9118-40b2-8edb-6aaded5e7b99 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:49.001977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 957/1923] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:01:49.305182 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300f62e-8bf2-46fa-8c81-ba861bdd20b1 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:49.306762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b300f62e-8bf2-46fa-8c81-ba861bdd20b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:49.319337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300f62e-8bf2-46fa-8c81-ba861bdd20b1 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:49.324298 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:49.325200 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:49.325570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:49.325717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] PATH_INFO: `/v3/projects/94c6b08efc7a40dc81aa12fec24abd1b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:49.326938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c6b08efc7a40dc81aa12fec24abd1b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:49.328892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:49.381194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c6b08efc7a40dc81aa12fec24abd1b', 'request_id': 'req-bb2c61b4-1249-4042-8787-a841ba7bf860'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:49.388120 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c6b08efc7a40dc81aa12fec24abd1b', 'request_id': 'req-bb2c61b4-1249-4042-8787-a841ba7bf860'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:49.394163 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c6b08efc7a40dc81aa12fec24abd1b', 'request_id': 'req-bb2c61b4-1249-4042-8787-a841ba7bf860'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:49.410665 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] The token cache is being invalidate because project 94c6b08efc7a40dc81aa12fec24abd1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:49.410949 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:49.411644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:49.413491 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 967/1924] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:49 2021] DELETE /identity/v3/projects/94c6b08efc7a40dc81aa12fec24abd1b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:49.417644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7198a9d-9118-40b2-8edb-6aaded5e7b99 service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:49.431191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7198a9d-9118-40b2-8edb-6aaded5e7b99 service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:49.518260 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3ee6e-4317-4c9c-9529-0a31c68d5cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:49.519243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3ee6e-4317-4c9c-9529-0a31c68d5cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:49.519526 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3ee6e-4317-4c9c-9529-0a31c68d5cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:49.519801 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3ee6e-4317-4c9c-9529-0a31c68d5cdf admin admin] PATH_INFO: `/v3/users/bf58e53e32bc42f5840a396fd1280a8d` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:49.521131 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3ee6e-4317-4c9c-9529-0a31c68d5cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf58e53e32bc42f5840a396fd1280a8d)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:49.523310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3ee6e-4317-4c9c-9529-0a31c68d5cdf admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:49.599223 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0ee3ee6e-4317-4c9c-9529-0a31c68d5cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf58e53e32bc42f5840a396fd1280a8d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:49.599918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0ee3ee6e-4317-4c9c-9529-0a31c68d5cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf58e53e32bc42f5840a396fd1280a8d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:49.614641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0ee3ee6e-4317-4c9c-9529-0a31c68d5cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf58e53e32bc42f5840a396fd1280a8d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:49.615861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0ee3ee6e-4317-4c9c-9529-0a31c68d5cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf58e53e32bc42f5840a396fd1280a8d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:49.626115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0ee3ee6e-4317-4c9c-9529-0a31c68d5cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf58e53e32bc42f5840a396fd1280a8d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:49.656591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 958/1925] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:49 2021] DELETE /identity/v3/users/bf58e53e32bc42f5840a396fd1280a8d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:50.142269 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:50.143976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:50.168479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c61b4-1249-4042-8787-a841ba7bf860 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:50.250103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e196e-de63-426f-9f49-e051708e5a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:50.250983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e196e-de63-426f-9f49-e051708e5a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:50.251312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e196e-de63-426f-9f49-e051708e5a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:50.251602 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e196e-de63-426f-9f49-e051708e5a9c admin admin] PATH_INFO: `/v3/projects/4a29297928d64fd38544fdef8eea34f1` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:50.252860 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e196e-de63-426f-9f49-e051708e5a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a29297928d64fd38544fdef8eea34f1)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:50.254793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e196e-de63-426f-9f49-e051708e5a9c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:50.303665 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-520e196e-de63-426f-9f49-e051708e5a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a29297928d64fd38544fdef8eea34f1', 'request_id': 'req-520e196e-de63-426f-9f49-e051708e5a9c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:50.310276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-520e196e-de63-426f-9f49-e051708e5a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a29297928d64fd38544fdef8eea34f1', 'request_id': 'req-520e196e-de63-426f-9f49-e051708e5a9c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:50.316031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-520e196e-de63-426f-9f49-e051708e5a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a29297928d64fd38544fdef8eea34f1', 'request_id': 'req-520e196e-de63-426f-9f49-e051708e5a9c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:50.329568 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-520e196e-de63-426f-9f49-e051708e5a9c admin admin] The token cache is being invalidate because project 4a29297928d64fd38544fdef8eea34f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:50.329861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-520e196e-de63-426f-9f49-e051708e5a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:50.330488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-520e196e-de63-426f-9f49-e051708e5a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:50.332364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 968/1926] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:50 2021] DELETE /identity/v3/projects/4a29297928d64fd38544fdef8eea34f1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:50.337994 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fbb2f-76c6-4442-848e-77b4f2587dad None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:50.338153 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fbb2f-76c6-4442-848e-77b4f2587dad None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:50.338552 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fbb2f-76c6-4442-848e-77b4f2587dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:50.358977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-575fbb2f-76c6-4442-848e-77b4f2587dad None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:50.360277 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-575fbb2f-76c6-4442-848e-77b4f2587dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:50.423007 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 959/1927] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:50.432187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8367c-dfb5-4ef1-aa77-5080583fa9d1 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:50.432894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8367c-dfb5-4ef1-aa77-5080583fa9d1 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:50.433265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8367c-dfb5-4ef1-aa77-5080583fa9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:50.456408 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-d7a8367c-dfb5-4ef1-aa77-5080583fa9d1 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:50.457757 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d7a8367c-dfb5-4ef1-aa77-5080583fa9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:50.467376 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 969/1928] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:50.472373 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fbb2f-76c6-4442-848e-77b4f2587dad None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:50.487683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fbb2f-76c6-4442-848e-77b4f2587dad None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:50.492647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7346fa0-aafc-47f7-99a1-0b8dd68703c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:50.493379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7346fa0-aafc-47f7-99a1-0b8dd68703c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:50.493664 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7346fa0-aafc-47f7-99a1-0b8dd68703c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:50.493969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7346fa0-aafc-47f7-99a1-0b8dd68703c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:50.494784 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7346fa0-aafc-47f7-99a1-0b8dd68703c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:50.495132 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7346fa0-aafc-47f7-99a1-0b8dd68703c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:50.496884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7346fa0-aafc-47f7-99a1-0b8dd68703c7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:50.509905 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 960/1929] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:50.515263 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8367c-dfb5-4ef1-aa77-5080583fa9d1 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:50.524436 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8367c-dfb5-4ef1-aa77-5080583fa9d1 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:50.529405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb4c81-cb92-478f-b41a-e1d004a7774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:50.530159 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4c81-cb92-478f-b41a-e1d004a7774a admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:50.530439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4c81-cb92-478f-b41a-e1d004a7774a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:50.530707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb4c81-cb92-478f-b41a-e1d004a7774a admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:50.531452 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb4c81-cb92-478f-b41a-e1d004a7774a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:50.533354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb4c81-cb92-478f-b41a-e1d004a7774a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:50.565643 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 970/1930] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:50 2021] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:50.566965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7346fa0-aafc-47f7-99a1-0b8dd68703c7 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:50.577433 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7346fa0-aafc-47f7-99a1-0b8dd68703c7 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:50.632833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab51566-1249-4fdb-93f3-41dd60be2fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:50.633525 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab51566-1249-4fdb-93f3-41dd60be2fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:50.633802 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab51566-1249-4fdb-93f3-41dd60be2fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:50.634079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab51566-1249-4fdb-93f3-41dd60be2fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:50.634791 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab51566-1249-4fdb-93f3-41dd60be2fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:50.636871 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab51566-1249-4fdb-93f3-41dd60be2fe8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:50.657360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 961/1931] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:50 2021] POST /identity/v3/users => generated 281 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:50.661827 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb4c81-cb92-478f-b41a-e1d004a7774a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:50.672937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb4c81-cb92-478f-b41a-e1d004a7774a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:50.678861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832747f-9f5f-4d6f-bc54-ce9116d0f201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:50.679557 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832747f-9f5f-4d6f-bc54-ce9116d0f201 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:50.679800 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832747f-9f5f-4d6f-bc54-ce9116d0f201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:50.680064 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832747f-9f5f-4d6f-bc54-ce9116d0f201 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:50.680834 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832747f-9f5f-4d6f-bc54-ce9116d0f201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:50.682424 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832747f-9f5f-4d6f-bc54-ce9116d0f201 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:50.693286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 971/1932] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:50.697613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab51566-1249-4fdb-93f3-41dd60be2fe8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:50.707870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab51566-1249-4fdb-93f3-41dd60be2fe8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:50.712625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e3886-0a7f-459b-9955-f36d134a1d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:50.713308 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e3886-0a7f-459b-9955-f36d134a1d2f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:50.713644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e3886-0a7f-459b-9955-f36d134a1d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:50.714306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e3886-0a7f-459b-9955-f36d134a1d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:50.715060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e3886-0a7f-459b-9955-f36d134a1d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:50.716895 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e3886-0a7f-459b-9955-f36d134a1d2f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:50.731309 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 962/1933] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:50.732779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832747f-9f5f-4d6f-bc54-ce9116d0f201 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:50.747716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832747f-9f5f-4d6f-bc54-ce9116d0f201 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:50.753177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae963124-ebfd-48ec-af85-9b90c2f05a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:50.754241 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae963124-ebfd-48ec-af85-9b90c2f05a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:50.754567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae963124-ebfd-48ec-af85-9b90c2f05a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:50.754867 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae963124-ebfd-48ec-af85-9b90c2f05a47 admin admin] PATH_INFO: `/v3/projects/ab06354a0add4e73b26e4d5ad81b0d8f/users/7e0b201b628245b8a5c637c9fccd94fc/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:50.774839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae963124-ebfd-48ec-af85-9b90c2f05a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab06354a0add4e73b26e4d5ad81b0d8f, user_id=7e0b201b628245b8a5c637c9fccd94fc, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:50.779418 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae963124-ebfd-48ec-af85-9b90c2f05a47 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:50.798024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 972/1934] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:50 2021] PUT /identity/v3/projects/ab06354a0add4e73b26e4d5ad81b0d8f/users/7e0b201b628245b8a5c637c9fccd94fc/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:50.808789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba42aad-e2f3-42f0-86bb-b9e827a74abf None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:50.809173 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba42aad-e2f3-42f0-86bb-b9e827a74abf None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:50.809456 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba42aad-e2f3-42f0-86bb-b9e827a74abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:50.839673 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-1ba42aad-e2f3-42f0-86bb-b9e827a74abf None None] MFA Rules not processed for user `7e0b201b628245b8a5c637c9fccd94fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:50.840906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1ba42aad-e2f3-42f0-86bb-b9e827a74abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:50.913900 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 963/1935] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:50 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:50.948313 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae963124-ebfd-48ec-af85-9b90c2f05a47 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:50.950664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ae963124-ebfd-48ec-af85-9b90c2f05a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:51.040510 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae963124-ebfd-48ec-af85-9b90c2f05a47 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:51.051898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb319961-50d5-41e8-bb80-7bc3f7a5a294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:51.052581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb319961-50d5-41e8-bb80-7bc3f7a5a294 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:51.052864 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb319961-50d5-41e8-bb80-7bc3f7a5a294 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:51.053159 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb319961-50d5-41e8-bb80-7bc3f7a5a294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:51.062766 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb319961-50d5-41e8-bb80-7bc3f7a5a294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:51.065358 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb319961-50d5-41e8-bb80-7bc3f7a5a294 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:51.088154 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 973/1936] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:50 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:51.093718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba42aad-e2f3-42f0-86bb-b9e827a74abf None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:51.176549 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba42aad-e2f3-42f0-86bb-b9e827a74abf None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:51.183539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65661b8-df20-4413-a1c4-8bf04fe91351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:51.184514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65661b8-df20-4413-a1c4-8bf04fe91351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:51.184797 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65661b8-df20-4413-a1c4-8bf04fe91351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:51.185070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65661b8-df20-4413-a1c4-8bf04fe91351 admin admin] PATH_INFO: `/v3/users/7e0b201b628245b8a5c637c9fccd94fc` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:51.187360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65661b8-df20-4413-a1c4-8bf04fe91351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0b201b628245b8a5c637c9fccd94fc)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:51.189699 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65661b8-df20-4413-a1c4-8bf04fe91351 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:51.244257 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d65661b8-df20-4413-a1c4-8bf04fe91351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0b201b628245b8a5c637c9fccd94fc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:51.244996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d65661b8-df20-4413-a1c4-8bf04fe91351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0b201b628245b8a5c637c9fccd94fc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:51.253419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d65661b8-df20-4413-a1c4-8bf04fe91351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0b201b628245b8a5c637c9fccd94fc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:51.254140 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d65661b8-df20-4413-a1c4-8bf04fe91351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0b201b628245b8a5c637c9fccd94fc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:51.263611 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d65661b8-df20-4413-a1c4-8bf04fe91351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0b201b628245b8a5c637c9fccd94fc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:51.290003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 964/1937] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:51 2021] DELETE /identity/v3/users/7e0b201b628245b8a5c637c9fccd94fc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:51.295475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfcb9a-5091-41d6-9ca2-58f9d1dcd11b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:51.296080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfcb9a-5091-41d6-9ca2-58f9d1dcd11b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:51.296818 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfcb9a-5091-41d6-9ca2-58f9d1dcd11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:51.316560 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-2cbfcb9a-5091-41d6-9ca2-58f9d1dcd11b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:51.318401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-2cbfcb9a-5091-41d6-9ca2-58f9d1dcd11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:51.390869 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 974/1938] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:51.402116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65661b8-df20-4413-a1c4-8bf04fe91351 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:51.403973 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d65661b8-df20-4413-a1c4-8bf04fe91351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:51.491869 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65661b8-df20-4413-a1c4-8bf04fe91351 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:51.496244 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dddac-bffe-4d07-96c7-f2ee41fff5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:51.497595 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dddac-bffe-4d07-96c7-f2ee41fff5db service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:51.497997 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dddac-bffe-4d07-96c7-f2ee41fff5db service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:51.499028 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dddac-bffe-4d07-96c7-f2ee41fff5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:51.512237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dddac-bffe-4d07-96c7-f2ee41fff5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:51.514126 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dddac-bffe-4d07-96c7-f2ee41fff5db service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:51.526179 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 965/1939] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:51.817201 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfcb9a-5091-41d6-9ca2-58f9d1dcd11b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:51.820779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-2cbfcb9a-5091-41d6-9ca2-58f9d1dcd11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:51.840428 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfcb9a-5091-41d6-9ca2-58f9d1dcd11b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:51.847777 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:51.849548 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:51.850071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:51.850349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360 admin admin] PATH_INFO: `/v3/projects/ab06354a0add4e73b26e4d5ad81b0d8f` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:51.851717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab06354a0add4e73b26e4d5ad81b0d8f)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:51.853644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:51.904673 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab06354a0add4e73b26e4d5ad81b0d8f', 'request_id': 'req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:51.911228 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab06354a0add4e73b26e4d5ad81b0d8f', 'request_id': 'req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:51.917023 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab06354a0add4e73b26e4d5ad81b0d8f', 'request_id': 'req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:51.929987 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360 admin admin] The token cache is being invalidate because project ab06354a0add4e73b26e4d5ad81b0d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:51.930274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:51.930898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-61854c6d-abb9-4e8f-bcd4-96f27f7b4360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:51.932516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 975/1940] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:51 2021] DELETE /identity/v3/projects/ab06354a0add4e73b26e4d5ad81b0d8f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:51.939623 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ba57e-8e44-4ea5-ab10-02ba110e52a9 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:51.939968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ba57e-8e44-4ea5-ab10-02ba110e52a9 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:51.940307 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ba57e-8e44-4ea5-ab10-02ba110e52a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:51.960070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-dc1ba57e-8e44-4ea5-ab10-02ba110e52a9 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:51.961362 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-dc1ba57e-8e44-4ea5-ab10-02ba110e52a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:52.051443 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 966/1941] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:52.059977 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca51c4-2a45-419d-a0a1-be53546dac68 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:52.060672 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca51c4-2a45-419d-a0a1-be53546dac68 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:52.060906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca51c4-2a45-419d-a0a1-be53546dac68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:52.085950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-0eca51c4-2a45-419d-a0a1-be53546dac68 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:52.087793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0eca51c4-2a45-419d-a0a1-be53546dac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:52.099844 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 976/1942] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:52.101464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ba57e-8e44-4ea5-ab10-02ba110e52a9 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:52.113047 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ba57e-8e44-4ea5-ab10-02ba110e52a9 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:52.118440 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7b1fd-def7-4097-a537-020970a01f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:52.119238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7b1fd-def7-4097-a537-020970a01f09 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:52.119568 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7b1fd-def7-4097-a537-020970a01f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:52.119891 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7b1fd-def7-4097-a537-020970a01f09 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:52.120808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7b1fd-def7-4097-a537-020970a01f09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:52.121158 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7b1fd-def7-4097-a537-020970a01f09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:52.123052 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7b1fd-def7-4097-a537-020970a01f09 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:52.136776 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 967/1943] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:52.142062 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca51c4-2a45-419d-a0a1-be53546dac68 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:52.153020 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca51c4-2a45-419d-a0a1-be53546dac68 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:52.159597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dfa2e-d261-4757-879b-0e149924b96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:52.160626 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dfa2e-d261-4757-879b-0e149924b96b admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:52.160990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dfa2e-d261-4757-879b-0e149924b96b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:52.162083 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dfa2e-d261-4757-879b-0e149924b96b admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:52.163203 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dfa2e-d261-4757-879b-0e149924b96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:52.166509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dfa2e-d261-4757-879b-0e149924b96b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:52.207011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 977/1944] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:52 2021] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:52.208311 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7b1fd-def7-4097-a537-020970a01f09 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:52.219115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7b1fd-def7-4097-a537-020970a01f09 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:52.303618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd3011-7268-446e-b69c-c72b143ef584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:52.304735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd3011-7268-446e-b69c-c72b143ef584 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:52.305200 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd3011-7268-446e-b69c-c72b143ef584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:52.305650 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd3011-7268-446e-b69c-c72b143ef584 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:52.306580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd3011-7268-446e-b69c-c72b143ef584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:52.309089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd3011-7268-446e-b69c-c72b143ef584 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:52.338095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 968/1945] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:52 2021] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:52.342700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dfa2e-d261-4757-879b-0e149924b96b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:52.355647 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dfa2e-d261-4757-879b-0e149924b96b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:52.363873 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02bb1d-ae05-474a-8b87-a562f9be0435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:52.364683 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02bb1d-ae05-474a-8b87-a562f9be0435 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:52.365011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02bb1d-ae05-474a-8b87-a562f9be0435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:52.365336 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02bb1d-ae05-474a-8b87-a562f9be0435 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:52.366184 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02bb1d-ae05-474a-8b87-a562f9be0435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:52.368073 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02bb1d-ae05-474a-8b87-a562f9be0435 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:52.381023 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 978/1946] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:52 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:52.385195 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd3011-7268-446e-b69c-c72b143ef584 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:52.397618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd3011-7268-446e-b69c-c72b143ef584 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:52.403521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53fc1b-93c2-46e0-b815-0d6e3564c436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:52.404341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53fc1b-93c2-46e0-b815-0d6e3564c436 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:52.404700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53fc1b-93c2-46e0-b815-0d6e3564c436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:52.405019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53fc1b-93c2-46e0-b815-0d6e3564c436 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:52.405922 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53fc1b-93c2-46e0-b815-0d6e3564c436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:52.407912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53fc1b-93c2-46e0-b815-0d6e3564c436 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:52.421606 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 969/1947] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:52 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:52.425924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02bb1d-ae05-474a-8b87-a562f9be0435 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:52.437960 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02bb1d-ae05-474a-8b87-a562f9be0435 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:52.444343 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88d158-32d9-47a2-9729-da233a75d911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:52.445505 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88d158-32d9-47a2-9729-da233a75d911 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:52.445787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88d158-32d9-47a2-9729-da233a75d911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:52.446054 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88d158-32d9-47a2-9729-da233a75d911 admin admin] PATH_INFO: `/v3/projects/71e562d4835248e7ade84335e4a1da15/users/5f5f171ce4d743a1b2cf603b81ca2dee/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:52.469902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88d158-32d9-47a2-9729-da233a75d911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e562d4835248e7ade84335e4a1da15, user_id=5f5f171ce4d743a1b2cf603b81ca2dee, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:52.474244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88d158-32d9-47a2-9729-da233a75d911 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:52.492950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 979/1948] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:52 2021] PUT /identity/v3/projects/71e562d4835248e7ade84335e4a1da15/users/5f5f171ce4d743a1b2cf603b81ca2dee/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:52.504448 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99faa3-2070-4112-b43e-f5ba8668f5c4 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:52.504968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99faa3-2070-4112-b43e-f5ba8668f5c4 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:52.504968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99faa3-2070-4112-b43e-f5ba8668f5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:52.532978 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-1c99faa3-2070-4112-b43e-f5ba8668f5c4 None None] MFA Rules not processed for user `5f5f171ce4d743a1b2cf603b81ca2dee`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:52.534194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1c99faa3-2070-4112-b43e-f5ba8668f5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:52.607925 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 970/1949] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:52 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:52.613273 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88d158-32d9-47a2-9729-da233a75d911 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:52.680543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88d158-32d9-47a2-9729-da233a75d911 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:52.685866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bb11d-91f2-47ba-a9dc-43044b440307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:52.686146 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bb11d-91f2-47ba-a9dc-43044b440307 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:52.686343 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bb11d-91f2-47ba-a9dc-43044b440307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:52.686624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bb11d-91f2-47ba-a9dc-43044b440307 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:52.687380 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bb11d-91f2-47ba-a9dc-43044b440307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:52.689833 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bb11d-91f2-47ba-a9dc-43044b440307 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:52.721110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 980/1950] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:52 2021] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:52.725479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99faa3-2070-4112-b43e-f5ba8668f5c4 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:52.737614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99faa3-2070-4112-b43e-f5ba8668f5c4 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:52.807365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3826cd-7170-4545-b36a-eb9d073c1da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:52.808491 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3826cd-7170-4545-b36a-eb9d073c1da1 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:52.808904 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3826cd-7170-4545-b36a-eb9d073c1da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:52.809276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3826cd-7170-4545-b36a-eb9d073c1da1 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:52.810062 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3826cd-7170-4545-b36a-eb9d073c1da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:52.812273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3826cd-7170-4545-b36a-eb9d073c1da1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:52.839527 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 971/1951] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:52 2021] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:52.841042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bb11d-91f2-47ba-a9dc-43044b440307 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:52.851854 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bb11d-91f2-47ba-a9dc-43044b440307 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:52.857004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d42613-39ce-425a-8b68-bdbd993c9f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:52.857788 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d42613-39ce-425a-8b68-bdbd993c9f4b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:52.857973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d42613-39ce-425a-8b68-bdbd993c9f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:52.858251 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d42613-39ce-425a-8b68-bdbd993c9f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:52.859002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d42613-39ce-425a-8b68-bdbd993c9f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:52.860660 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d42613-39ce-425a-8b68-bdbd993c9f4b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:52.874297 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 981/1952] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:52 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:52.878493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3826cd-7170-4545-b36a-eb9d073c1da1 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:52.890647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3826cd-7170-4545-b36a-eb9d073c1da1 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:52.895899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac7b3e-22c1-4324-a891-a44c5aac9f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:52.896649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac7b3e-22c1-4324-a891-a44c5aac9f54 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:52.896980 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac7b3e-22c1-4324-a891-a44c5aac9f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:52.897272 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac7b3e-22c1-4324-a891-a44c5aac9f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:52.898088 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac7b3e-22c1-4324-a891-a44c5aac9f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:52.899911 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac7b3e-22c1-4324-a891-a44c5aac9f54 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:52.912519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 972/1953] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:52 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:52.919503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d42613-39ce-425a-8b68-bdbd993c9f4b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:52.931177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d42613-39ce-425a-8b68-bdbd993c9f4b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:52.935955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480fd32-1a55-4732-a18e-3e53c824ae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:52.936843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480fd32-1a55-4732-a18e-3e53c824ae4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:52.937120 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480fd32-1a55-4732-a18e-3e53c824ae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:52.937392 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480fd32-1a55-4732-a18e-3e53c824ae4f admin admin] PATH_INFO: `/v3/projects/098f28e2e77b4521afb6d03646c820ae/users/26bc9f0686264fa0b1e9d63ee227f4b4/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:52.954682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480fd32-1a55-4732-a18e-3e53c824ae4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=098f28e2e77b4521afb6d03646c820ae, user_id=26bc9f0686264fa0b1e9d63ee227f4b4, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:52.957367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480fd32-1a55-4732-a18e-3e53c824ae4f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:52.972697 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 982/1954] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:52 2021] PUT /identity/v3/projects/098f28e2e77b4521afb6d03646c820ae/users/26bc9f0686264fa0b1e9d63ee227f4b4/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:52.983378 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf281ae-cb33-4b44-80af-c1e89f617f1c None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:52.983715 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf281ae-cb33-4b44-80af-c1e89f617f1c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:52.984044 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf281ae-cb33-4b44-80af-c1e89f617f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:53.031771 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-6cf281ae-cb33-4b44-80af-c1e89f617f1c None None] MFA Rules not processed for user `26bc9f0686264fa0b1e9d63ee227f4b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:53.033176 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6cf281ae-cb33-4b44-80af-c1e89f617f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:53.120942 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 973/1955] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:52 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:53.126431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480fd32-1a55-4732-a18e-3e53c824ae4f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:53.221582 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480fd32-1a55-4732-a18e-3e53c824ae4f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:53.226559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef6ccd-0970-421b-a2f5-3e581b30b104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:53.227402 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef6ccd-0970-421b-a2f5-3e581b30b104 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:53.227682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef6ccd-0970-421b-a2f5-3e581b30b104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:53.228003 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef6ccd-0970-421b-a2f5-3e581b30b104 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:53.228731 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef6ccd-0970-421b-a2f5-3e581b30b104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:53.231105 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef6ccd-0970-421b-a2f5-3e581b30b104 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:53.257710 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 983/1956] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:53 2021] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:53.262939 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf281ae-cb33-4b44-80af-c1e89f617f1c None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:53.281145 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf281ae-cb33-4b44-80af-c1e89f617f1c None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:53.348256 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce36d5-cf78-4f3d-93a5-36d5af82fcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:53.348951 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce36d5-cf78-4f3d-93a5-36d5af82fcd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:53.349237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce36d5-cf78-4f3d-93a5-36d5af82fcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:53.349514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce36d5-cf78-4f3d-93a5-36d5af82fcd1 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:53.350226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce36d5-cf78-4f3d-93a5-36d5af82fcd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:53.352393 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce36d5-cf78-4f3d-93a5-36d5af82fcd1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:53.383174 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 974/1957] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:53 2021] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:53.385061 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef6ccd-0970-421b-a2f5-3e581b30b104 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:53.396151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef6ccd-0970-421b-a2f5-3e581b30b104 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:53.400761 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89791e-9f0b-423c-a490-427caeb49ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:53.401657 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89791e-9f0b-423c-a490-427caeb49ebe admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:53.401856 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89791e-9f0b-423c-a490-427caeb49ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:53.402163 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89791e-9f0b-423c-a490-427caeb49ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:53.402917 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89791e-9f0b-423c-a490-427caeb49ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:53.404565 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89791e-9f0b-423c-a490-427caeb49ebe admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:53.416357 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 984/1958] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:53 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:53.421353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce36d5-cf78-4f3d-93a5-36d5af82fcd1 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:53.432539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce36d5-cf78-4f3d-93a5-36d5af82fcd1 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:53.437310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83946ca-7411-45ac-8da7-96598f597f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:53.438238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83946ca-7411-45ac-8da7-96598f597f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:53.438508 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83946ca-7411-45ac-8da7-96598f597f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:53.438781 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83946ca-7411-45ac-8da7-96598f597f97 admin admin] PATH_INFO: `/v3/projects/5851a21c907b4e698bf0e7b46c65b843/users/d3af8f08c572488284a1d0d1c15b7300/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:53.455744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83946ca-7411-45ac-8da7-96598f597f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5851a21c907b4e698bf0e7b46c65b843, user_id=d3af8f08c572488284a1d0d1c15b7300, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:53.458922 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83946ca-7411-45ac-8da7-96598f597f97 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:53.478121 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 975/1959] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:53 2021] PUT /identity/v3/projects/5851a21c907b4e698bf0e7b46c65b843/users/d3af8f08c572488284a1d0d1c15b7300/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:53.482355 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89791e-9f0b-423c-a490-427caeb49ebe admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:53.492563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89791e-9f0b-423c-a490-427caeb49ebe admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:53.563945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799c011-8513-4839-90da-3503b80ac041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:53.564706 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799c011-8513-4839-90da-3503b80ac041 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:53.564902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799c011-8513-4839-90da-3503b80ac041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:53.565185 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799c011-8513-4839-90da-3503b80ac041 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:53.566089 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799c011-8513-4839-90da-3503b80ac041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:53.568071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799c011-8513-4839-90da-3503b80ac041 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:53.586383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 985/1960] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:53 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:53.588356 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83946ca-7411-45ac-8da7-96598f597f97 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:53.602086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83946ca-7411-45ac-8da7-96598f597f97 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:53.607512 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da762258-4e87-4438-96b6-ebad6ba8df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:53.608591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da762258-4e87-4438-96b6-ebad6ba8df12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:53.608958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da762258-4e87-4438-96b6-ebad6ba8df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:53.609240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da762258-4e87-4438-96b6-ebad6ba8df12 admin admin] PATH_INFO: `/v3/projects/5851a21c907b4e698bf0e7b46c65b843/users/d3af8f08c572488284a1d0d1c15b7300/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:53.611803 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da762258-4e87-4438-96b6-ebad6ba8df12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5851a21c907b4e698bf0e7b46c65b843, user_id=d3af8f08c572488284a1d0d1c15b7300, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:53.614523 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da762258-4e87-4438-96b6-ebad6ba8df12 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:53.630414 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 976/1961] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:53 2021] PUT /identity/v3/projects/5851a21c907b4e698bf0e7b46c65b843/users/d3af8f08c572488284a1d0d1c15b7300/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:53.648076 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322494cb-d512-4b39-8431-e88a91df979a None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:53.648490 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322494cb-d512-4b39-8431-e88a91df979a None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:53.648876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322494cb-d512-4b39-8431-e88a91df979a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:53.692765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-322494cb-d512-4b39-8431-e88a91df979a None None] MFA Rules not processed for user `d3af8f08c572488284a1d0d1c15b7300`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:53.694840 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-322494cb-d512-4b39-8431-e88a91df979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:53.811597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 986/1962] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:53 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:53.822515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da762258-4e87-4438-96b6-ebad6ba8df12 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:53.824471 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-da762258-4e87-4438-96b6-ebad6ba8df12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:53.894452 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da762258-4e87-4438-96b6-ebad6ba8df12 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:53.898410 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203201c-4367-416b-962c-e957ee1fdb01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:53.899069 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203201c-4367-416b-962c-e957ee1fdb01 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:53.899388 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203201c-4367-416b-962c-e957ee1fdb01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:53.899839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203201c-4367-416b-962c-e957ee1fdb01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:53.978577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203201c-4367-416b-962c-e957ee1fdb01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:53.980467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203201c-4367-416b-962c-e957ee1fdb01 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:53.991531 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 977/1963] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:53 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:55.610908 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322494cb-d512-4b39-8431-e88a91df979a None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:55.612384 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-322494cb-d512-4b39-8431-e88a91df979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:55.625159 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322494cb-d512-4b39-8431-e88a91df979a None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:55.629331 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d738c-03f0-4538-b64b-6da077d10819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:55.630239 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d738c-03f0-4538-b64b-6da077d10819 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:55.630548 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d738c-03f0-4538-b64b-6da077d10819 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:55.630851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d738c-03f0-4538-b64b-6da077d10819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:55.701148 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d738c-03f0-4538-b64b-6da077d10819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:55.702796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d738c-03f0-4538-b64b-6da077d10819 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:55.713332 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 987/1964] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:55 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:55.945301 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203201c-4367-416b-962c-e957ee1fdb01 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:55.948026 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6203201c-4367-416b-962c-e957ee1fdb01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:56.073634 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203201c-4367-416b-962c-e957ee1fdb01 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:56.080313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cd8d0-7bed-43a2-9254-1735a07f1aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:56.081218 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cd8d0-7bed-43a2-9254-1735a07f1aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:56.081552 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cd8d0-7bed-43a2-9254-1735a07f1aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:56.081827 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cd8d0-7bed-43a2-9254-1735a07f1aa8 admin admin] PATH_INFO: `/v3/users/dda36b1b39dd42eb93b0eed0cf0606c2` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:56.083082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cd8d0-7bed-43a2-9254-1735a07f1aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda36b1b39dd42eb93b0eed0cf0606c2)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:56.085087 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cd8d0-7bed-43a2-9254-1735a07f1aa8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:56.132698 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f32cd8d0-7bed-43a2-9254-1735a07f1aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda36b1b39dd42eb93b0eed0cf0606c2'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.133363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f32cd8d0-7bed-43a2-9254-1735a07f1aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda36b1b39dd42eb93b0eed0cf0606c2'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.142180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f32cd8d0-7bed-43a2-9254-1735a07f1aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda36b1b39dd42eb93b0eed0cf0606c2'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.142905 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f32cd8d0-7bed-43a2-9254-1735a07f1aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda36b1b39dd42eb93b0eed0cf0606c2'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.149936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f32cd8d0-7bed-43a2-9254-1735a07f1aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda36b1b39dd42eb93b0eed0cf0606c2'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.169015 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 978/1965] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:55 2021] DELETE /identity/v3/users/dda36b1b39dd42eb93b0eed0cf0606c2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:56.174620 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a779db-e1cc-46fd-a555-8e254d1b828b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:56.175333 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a779db-e1cc-46fd-a555-8e254d1b828b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:56.177640 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a779db-e1cc-46fd-a555-8e254d1b828b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:56.198110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-17a779db-e1cc-46fd-a555-8e254d1b828b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:56.199580 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-17a779db-e1cc-46fd-a555-8e254d1b828b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:56.273950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 988/1966] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:56.285172 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cd8d0-7bed-43a2-9254-1735a07f1aa8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:56.286593 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f32cd8d0-7bed-43a2-9254-1735a07f1aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:56.359630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cd8d0-7bed-43a2-9254-1735a07f1aa8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:56.366931 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cab6ce-c564-4b51-bead-e2ad6621ea31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:56.368025 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab6ce-c564-4b51-bead-e2ad6621ea31 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:56.368571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab6ce-c564-4b51-bead-e2ad6621ea31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:56.368941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cab6ce-c564-4b51-bead-e2ad6621ea31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:56.380567 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cab6ce-c564-4b51-bead-e2ad6621ea31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:56.382345 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cab6ce-c564-4b51-bead-e2ad6621ea31 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:56.393668 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 979/1967] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:56.422378 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a779db-e1cc-46fd-a555-8e254d1b828b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:56.424133 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-17a779db-e1cc-46fd-a555-8e254d1b828b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:56.485481 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a779db-e1cc-46fd-a555-8e254d1b828b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:56.489454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb44cb-32a7-423e-ade1-1c4ca43e888e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:56.490214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb44cb-32a7-423e-ade1-1c4ca43e888e service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:56.490389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb44cb-32a7-423e-ade1-1c4ca43e888e service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:56.490663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb44cb-32a7-423e-ade1-1c4ca43e888e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:56.492711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1adb44cb-32a7-423e-ade1-1c4ca43e888e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:56.559150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb44cb-32a7-423e-ade1-1c4ca43e888e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:56.560906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb44cb-32a7-423e-ade1-1c4ca43e888e service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:56.571583 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 989/1968] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:56 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:56.674779 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cab6ce-c564-4b51-bead-e2ad6621ea31 service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:56.678991 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-00cab6ce-c564-4b51-bead-e2ad6621ea31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:56.692506 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cab6ce-c564-4b51-bead-e2ad6621ea31 service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:56.700778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3a24c-fbe7-471a-9a83-9ac2d67b949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:56.702260 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3a24c-fbe7-471a-9a83-9ac2d67b949e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:56.702810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3a24c-fbe7-471a-9a83-9ac2d67b949e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:56.703332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3a24c-fbe7-471a-9a83-9ac2d67b949e admin admin] PATH_INFO: `/v3/users/e05a1fd6a1bf48fd869e79be339de763` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:56.705676 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb44cb-32a7-423e-ade1-1c4ca43e888e service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:56.706194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3a24c-fbe7-471a-9a83-9ac2d67b949e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e05a1fd6a1bf48fd869e79be339de763)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:56.707601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1adb44cb-32a7-423e-ade1-1c4ca43e888e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:56.711955 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3a24c-fbe7-471a-9a83-9ac2d67b949e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:56.724996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb44cb-32a7-423e-ade1-1c4ca43e888e service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:56.732662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12124653-d1ed-4a1c-9720-21cff744547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:56.733455 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12124653-d1ed-4a1c-9720-21cff744547a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:56.733734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12124653-d1ed-4a1c-9720-21cff744547a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:56.734004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12124653-d1ed-4a1c-9720-21cff744547a admin admin] PATH_INFO: `/v3/projects/9bc71ba0195e472a9cac0d8bc25f50af` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:56.735312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12124653-d1ed-4a1c-9720-21cff744547a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc71ba0195e472a9cac0d8bc25f50af)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:56.737307 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12124653-d1ed-4a1c-9720-21cff744547a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:56.786586 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-fac3a24c-fbe7-471a-9a83-9ac2d67b949e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e05a1fd6a1bf48fd869e79be339de763'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.787374 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-fac3a24c-fbe7-471a-9a83-9ac2d67b949e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e05a1fd6a1bf48fd869e79be339de763'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.787887 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-12124653-d1ed-4a1c-9720-21cff744547a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc71ba0195e472a9cac0d8bc25f50af', 'request_id': 'req-12124653-d1ed-4a1c-9720-21cff744547a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.794823 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-12124653-d1ed-4a1c-9720-21cff744547a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc71ba0195e472a9cac0d8bc25f50af', 'request_id': 'req-12124653-d1ed-4a1c-9720-21cff744547a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.795831 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-fac3a24c-fbe7-471a-9a83-9ac2d67b949e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e05a1fd6a1bf48fd869e79be339de763'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.796544 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-fac3a24c-fbe7-471a-9a83-9ac2d67b949e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e05a1fd6a1bf48fd869e79be339de763'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.800946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-12124653-d1ed-4a1c-9720-21cff744547a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc71ba0195e472a9cac0d8bc25f50af', 'request_id': 'req-12124653-d1ed-4a1c-9720-21cff744547a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.804126 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-fac3a24c-fbe7-471a-9a83-9ac2d67b949e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e05a1fd6a1bf48fd869e79be339de763'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.814508 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-12124653-d1ed-4a1c-9720-21cff744547a admin admin] The token cache is being invalidate because project 9bc71ba0195e472a9cac0d8bc25f50af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:56.814932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-12124653-d1ed-4a1c-9720-21cff744547a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.815595 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-12124653-d1ed-4a1c-9720-21cff744547a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:56.817275 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 990/1969] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:56 2021] DELETE /identity/v3/projects/9bc71ba0195e472a9cac0d8bc25f50af => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:56.824007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447e1e7-edaa-4931-aba6-bbf753118f75 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:56.824007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447e1e7-edaa-4931-aba6-bbf753118f75 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:56.824627 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447e1e7-edaa-4931-aba6-bbf753118f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:56.827247 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 980/1970] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:56 2021] DELETE /identity/v3/users/e05a1fd6a1bf48fd869e79be339de763 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:56.831885 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56284569-2350-4068-81e1-0a520844d9b6 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:56.832443 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56284569-2350-4068-81e1-0a520844d9b6 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:56.832863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56284569-2350-4068-81e1-0a520844d9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:56.851791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-6447e1e7-edaa-4931-aba6-bbf753118f75 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:56.853803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6447e1e7-edaa-4931-aba6-bbf753118f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:56.854599 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-56284569-2350-4068-81e1-0a520844d9b6 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:56.856288 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-56284569-2350-4068-81e1-0a520844d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:56.928061 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 991/1971] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:56.928597 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 981/1972] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:56.937069 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ec9ed-068e-4e96-984f-9e4d1f731b07 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:56.937548 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ec9ed-068e-4e96-984f-9e4d1f731b07 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:56.937944 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ec9ed-068e-4e96-984f-9e4d1f731b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:56.939365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56284569-2350-4068-81e1-0a520844d9b6 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:56.941099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-56284569-2350-4068-81e1-0a520844d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:56.959598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-b14ec9ed-068e-4e96-984f-9e4d1f731b07 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:56.960953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b14ec9ed-068e-4e96-984f-9e4d1f731b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:56.970506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 992/1973] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:56.974839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ec9ed-068e-4e96-984f-9e4d1f731b07 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:56.983911 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ec9ed-068e-4e96-984f-9e4d1f731b07 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:56.988529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e734d-9436-4589-85b3-2b1bb28d3a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:56.989188 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e734d-9436-4589-85b3-2b1bb28d3a10 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:56.989469 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e734d-9436-4589-85b3-2b1bb28d3a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:56.989737 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e734d-9436-4589-85b3-2b1bb28d3a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:56.990471 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e734d-9436-4589-85b3-2b1bb28d3a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:56.990772 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e734d-9436-4589-85b3-2b1bb28d3a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:56.992447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e734d-9436-4589-85b3-2b1bb28d3a10 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:57.004306 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 993/1974] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 11:01:57.008998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e734d-9436-4589-85b3-2b1bb28d3a10 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:57.010523 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56284569-2350-4068-81e1-0a520844d9b6 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:57.014888 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c6b18-94c6-41f3-b208-5ea0364f1127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:57.015587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6b18-94c6-41f3-b208-5ea0364f1127 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:57.015869 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6b18-94c6-41f3-b208-5ea0364f1127 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:57.016142 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6b18-94c6-41f3-b208-5ea0364f1127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:57.021465 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e734d-9436-4589-85b3-2b1bb28d3a10 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:57.026199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c6b18-94c6-41f3-b208-5ea0364f1127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:57.027870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c6b18-94c6-41f3-b208-5ea0364f1127 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:57.028835 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77222d-8805-468d-a63b-afe8c9e6bf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:57.029515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77222d-8805-468d-a63b-afe8c9e6bf3d admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:57.029802 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77222d-8805-468d-a63b-afe8c9e6bf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:57.030067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77222d-8805-468d-a63b-afe8c9e6bf3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:57.030769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77222d-8805-468d-a63b-afe8c9e6bf3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:57.032739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77222d-8805-468d-a63b-afe8c9e6bf3d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:57.037687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 982/1975] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:57.075756 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 994/1976] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:57 2021] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:01:57.080625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c6b18-94c6-41f3-b208-5ea0364f1127 service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:57.098296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c6b18-94c6-41f3-b208-5ea0364f1127 service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:57.181718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f28c05-4575-47bd-890e-4a1445da6885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:57.182388 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f28c05-4575-47bd-890e-4a1445da6885 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:57.182720 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f28c05-4575-47bd-890e-4a1445da6885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:57.183254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f28c05-4575-47bd-890e-4a1445da6885 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:57.184009 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f28c05-4575-47bd-890e-4a1445da6885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:57.186018 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f28c05-4575-47bd-890e-4a1445da6885 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:57.231717 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 983/1977] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:57 2021] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:01:57.236231 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77222d-8805-468d-a63b-afe8c9e6bf3d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:57.264035 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77222d-8805-468d-a63b-afe8c9e6bf3d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:57.280249 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86305f6-d20e-41d0-a6de-6e8431fab716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:57.280941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86305f6-d20e-41d0-a6de-6e8431fab716 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:57.281221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86305f6-d20e-41d0-a6de-6e8431fab716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:57.281488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86305f6-d20e-41d0-a6de-6e8431fab716 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:57.282232 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86305f6-d20e-41d0-a6de-6e8431fab716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:57.284009 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86305f6-d20e-41d0-a6de-6e8431fab716 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:57.300765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 995/1978] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:57 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:57.302381 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f28c05-4575-47bd-890e-4a1445da6885 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:57.314663 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f28c05-4575-47bd-890e-4a1445da6885 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:57.319518 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceeeb58-305f-4a62-a442-2a6425a5668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:57.320204 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeeb58-305f-4a62-a442-2a6425a5668b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:57.320487 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeeb58-305f-4a62-a442-2a6425a5668b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:57.320756 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeeb58-305f-4a62-a442-2a6425a5668b admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:57.321499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceeeb58-305f-4a62-a442-2a6425a5668b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:57.323731 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceeeb58-305f-4a62-a442-2a6425a5668b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:57.338413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 984/1979] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:57 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:57.340789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86305f6-d20e-41d0-a6de-6e8431fab716 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:57.359589 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86305f6-d20e-41d0-a6de-6e8431fab716 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:57.367876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79561dda-87cd-4752-94b9-9d58bc3d9784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:57.368953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79561dda-87cd-4752-94b9-9d58bc3d9784 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:57.369195 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79561dda-87cd-4752-94b9-9d58bc3d9784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:57.369739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79561dda-87cd-4752-94b9-9d58bc3d9784 admin admin] PATH_INFO: `/v3/projects/90a772dfbfc046f294fb88e9a815aec2/users/e8d5f91a1f704c0b954b15855eb10f03/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:57.388343 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79561dda-87cd-4752-94b9-9d58bc3d9784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a772dfbfc046f294fb88e9a815aec2, user_id=e8d5f91a1f704c0b954b15855eb10f03, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:57.391437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79561dda-87cd-4752-94b9-9d58bc3d9784 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:57.415073 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 996/1980] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:57 2021] PUT /identity/v3/projects/90a772dfbfc046f294fb88e9a815aec2/users/e8d5f91a1f704c0b954b15855eb10f03/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:57.427550 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7b426-a4b3-4a0d-a745-5a25aee5e2ef None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:57.427877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7b426-a4b3-4a0d-a745-5a25aee5e2ef None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:57.428222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7b426-a4b3-4a0d-a745-5a25aee5e2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:57.490492 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-b3f7b426-a4b3-4a0d-a745-5a25aee5e2ef None None] MFA Rules not processed for user `e8d5f91a1f704c0b954b15855eb10f03`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:57.492582 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79561dda-87cd-4752-94b9-9d58bc3d9784 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:57.494444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b3f7b426-a4b3-4a0d-a745-5a25aee5e2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:57.494597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-79561dda-87cd-4752-94b9-9d58bc3d9784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:57.617934 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 985/1981] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:57 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:57.635655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7b426-a4b3-4a0d-a745-5a25aee5e2ef None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:57.650959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79561dda-87cd-4752-94b9-9d58bc3d9784 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:57.653903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b3f7b426-a4b3-4a0d-a745-5a25aee5e2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:57.658596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:57.659638 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:57.659979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:57.660294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] PATH_INFO: `/v3/projects/d478375e18414ef0ba1eaece7fcb4b8e` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:57.661672 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d478375e18414ef0ba1eaece7fcb4b8e)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:57.663800 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:57.724216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd478375e18414ef0ba1eaece7fcb4b8e', 'request_id': 'req-9ef496be-c67e-44f7-a091-ac41c3caf515'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:57.733655 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd478375e18414ef0ba1eaece7fcb4b8e', 'request_id': 'req-9ef496be-c67e-44f7-a091-ac41c3caf515'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:57.740286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd478375e18414ef0ba1eaece7fcb4b8e', 'request_id': 'req-9ef496be-c67e-44f7-a091-ac41c3caf515'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:57.747561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7b426-a4b3-4a0d-a745-5a25aee5e2ef None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:57.758140 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] The token cache is being invalidate because project d478375e18414ef0ba1eaece7fcb4b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:57.758829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:57.759985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:57.763343 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 997/1982] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:57 2021] DELETE /identity/v3/projects/d478375e18414ef0ba1eaece7fcb4b8e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:57.768095 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:57.771290 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:57.817535 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72997bc3-e914-4376-b934-7a1b91d5b2ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:57.818480 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72997bc3-e914-4376-b934-7a1b91d5b2ec service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:57.818860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72997bc3-e914-4376-b934-7a1b91d5b2ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:57.819274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72997bc3-e914-4376-b934-7a1b91d5b2ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:57.822486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-72997bc3-e914-4376-b934-7a1b91d5b2ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:57.869511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef496be-c67e-44f7-a091-ac41c3caf515 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:57.877545 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac7222-404c-468d-8d43-78f8e9c6d6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:57.877901 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac7222-404c-468d-8d43-78f8e9c6d6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:57.878259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac7222-404c-468d-8d43-78f8e9c6d6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:57.878601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac7222-404c-468d-8d43-78f8e9c6d6c6 admin admin] PATH_INFO: `/v3/users/6dd95a6f162d4d0fb030ffc9feb18c3b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:57.880727 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac7222-404c-468d-8d43-78f8e9c6d6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dd95a6f162d4d0fb030ffc9feb18c3b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:57.883887 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac7222-404c-468d-8d43-78f8e9c6d6c6 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:57.915171 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72997bc3-e914-4376-b934-7a1b91d5b2ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:57.917739 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72997bc3-e914-4376-b934-7a1b91d5b2ec service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:57.936842 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 986/1983] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:01:57 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:01:57.976427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-94ac7222-404c-468d-8d43-78f8e9c6d6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dd95a6f162d4d0fb030ffc9feb18c3b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:57.980542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-94ac7222-404c-468d-8d43-78f8e9c6d6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dd95a6f162d4d0fb030ffc9feb18c3b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:58.000422 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-94ac7222-404c-468d-8d43-78f8e9c6d6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dd95a6f162d4d0fb030ffc9feb18c3b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:58.002570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-94ac7222-404c-468d-8d43-78f8e9c6d6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dd95a6f162d4d0fb030ffc9feb18c3b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:58.033477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-94ac7222-404c-468d-8d43-78f8e9c6d6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dd95a6f162d4d0fb030ffc9feb18c3b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:58.050201 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 998/1984] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:01:57 2021] DELETE /identity/v3/users/6dd95a6f162d4d0fb030ffc9feb18c3b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:58.516832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72997bc3-e914-4376-b934-7a1b91d5b2ec service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:58.530192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72997bc3-e914-4376-b934-7a1b91d5b2ec service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:58.596836 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067d483-9669-4302-9314-68d4f53346ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:58.597852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067d483-9669-4302-9314-68d4f53346ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:58.598494 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067d483-9669-4302-9314-68d4f53346ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:58.598494 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067d483-9669-4302-9314-68d4f53346ef admin admin] PATH_INFO: `/v3/projects/04ee181a0b58449fa0dacaba2ea416bf` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:58.599847 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067d483-9669-4302-9314-68d4f53346ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ee181a0b58449fa0dacaba2ea416bf)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:58.602527 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067d483-9669-4302-9314-68d4f53346ef admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:58.664163 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0067d483-9669-4302-9314-68d4f53346ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ee181a0b58449fa0dacaba2ea416bf', 'request_id': 'req-0067d483-9669-4302-9314-68d4f53346ef'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:58.672020 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0067d483-9669-4302-9314-68d4f53346ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ee181a0b58449fa0dacaba2ea416bf', 'request_id': 'req-0067d483-9669-4302-9314-68d4f53346ef'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:58.677589 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0067d483-9669-4302-9314-68d4f53346ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ee181a0b58449fa0dacaba2ea416bf', 'request_id': 'req-0067d483-9669-4302-9314-68d4f53346ef'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:58.690372 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0067d483-9669-4302-9314-68d4f53346ef admin admin] The token cache is being invalidate because project 04ee181a0b58449fa0dacaba2ea416bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:01:58.690710 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0067d483-9669-4302-9314-68d4f53346ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:58.691324 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0067d483-9669-4302-9314-68d4f53346ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:01:58.693181 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 987/1985] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:01:58 2021] DELETE /identity/v3/projects/04ee181a0b58449fa0dacaba2ea416bf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:58.699769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6fee-a8ef-4ded-b34c-d48d036e41d8 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:58.700000 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6fee-a8ef-4ded-b34c-d48d036e41d8 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:58.700278 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6fee-a8ef-4ded-b34c-d48d036e41d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:58.721807 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-444a6fee-a8ef-4ded-b34c-d48d036e41d8 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:58.723396 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-444a6fee-a8ef-4ded-b34c-d48d036e41d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:58.787154 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 999/1986] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:01:58.795522 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7aeb3-1db5-4a75-9972-9aa7e19b99d0 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:58.795808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7aeb3-1db5-4a75-9972-9aa7e19b99d0 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:58.796079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7aeb3-1db5-4a75-9972-9aa7e19b99d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:58.815960 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-f9f7aeb3-1db5-4a75-9972-9aa7e19b99d0 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:58.817183 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f9f7aeb3-1db5-4a75-9972-9aa7e19b99d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:58.827652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 988/1987] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:58.831697 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a6fee-a8ef-4ded-b34c-d48d036e41d8 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:58.842508 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a6fee-a8ef-4ded-b34c-d48d036e41d8 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:58.847438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0bbf5-b7cc-43fd-bb07-159404df7b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:58.848099 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0bbf5-b7cc-43fd-bb07-159404df7b07 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:58.848399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0bbf5-b7cc-43fd-bb07-159404df7b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:58.848674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0bbf5-b7cc-43fd-bb07-159404df7b07 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:58.849408 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0bbf5-b7cc-43fd-bb07-159404df7b07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:01:58.849738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0bbf5-b7cc-43fd-bb07-159404df7b07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:58.851334 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0bbf5-b7cc-43fd-bb07-159404df7b07 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:58.864498 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1000/1988] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:01:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:01:58.869160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7aeb3-1db5-4a75-9972-9aa7e19b99d0 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:58.878793 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7aeb3-1db5-4a75-9972-9aa7e19b99d0 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:58.883570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e5ca8-7452-486a-90c9-f2415e177ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:58.884237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5ca8-7452-486a-90c9-f2415e177ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:58.884518 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5ca8-7452-486a-90c9-f2415e177ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:58.884790 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5ca8-7452-486a-90c9-f2415e177ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:58.885517 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e5ca8-7452-486a-90c9-f2415e177ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:58.888068 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e5ca8-7452-486a-90c9-f2415e177ff1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:58.914379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 989/1989] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:58 2021] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:58.918272 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0bbf5-b7cc-43fd-bb07-159404df7b07 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:58.928525 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0bbf5-b7cc-43fd-bb07-159404df7b07 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:58.984393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a50ef-08ca-449d-a4ff-8b9a115a3838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:58.985066 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a50ef-08ca-449d-a4ff-8b9a115a3838 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:58.985348 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a50ef-08ca-449d-a4ff-8b9a115a3838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:58.985622 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a50ef-08ca-449d-a4ff-8b9a115a3838 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:58.986340 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a50ef-08ca-449d-a4ff-8b9a115a3838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:58.988295 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a50ef-08ca-449d-a4ff-8b9a115a3838 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:59.011959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1001/1990] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:58 2021] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:59.013614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e5ca8-7452-486a-90c9-f2415e177ff1 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:59.030115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e5ca8-7452-486a-90c9-f2415e177ff1 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:59.035590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23985d7e-e84a-4a12-a05d-1fb46bde3de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:59.036383 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23985d7e-e84a-4a12-a05d-1fb46bde3de7 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:59.036777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23985d7e-e84a-4a12-a05d-1fb46bde3de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:59.037251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23985d7e-e84a-4a12-a05d-1fb46bde3de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:59.038102 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23985d7e-e84a-4a12-a05d-1fb46bde3de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:59.040393 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23985d7e-e84a-4a12-a05d-1fb46bde3de7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:59.055345 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 990/1991] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:59 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:59.059957 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a50ef-08ca-449d-a4ff-8b9a115a3838 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:59.070280 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a50ef-08ca-449d-a4ff-8b9a115a3838 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:59.076111 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5e01b-e93e-4723-8c5a-b81e25a1d166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:59.076788 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5e01b-e93e-4723-8c5a-b81e25a1d166 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:59.077067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5e01b-e93e-4723-8c5a-b81e25a1d166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:59.077337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5e01b-e93e-4723-8c5a-b81e25a1d166 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:59.078584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5e01b-e93e-4723-8c5a-b81e25a1d166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:59.080404 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5e01b-e93e-4723-8c5a-b81e25a1d166 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:59.093470 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1002/1992] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:59 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:59.097325 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23985d7e-e84a-4a12-a05d-1fb46bde3de7 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:59.110066 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23985d7e-e84a-4a12-a05d-1fb46bde3de7 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:59.115957 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8e499-1350-4452-abf5-b01430eb5284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:59.116996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8e499-1350-4452-abf5-b01430eb5284 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:59.117371 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8e499-1350-4452-abf5-b01430eb5284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:59.117737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8e499-1350-4452-abf5-b01430eb5284 admin admin] PATH_INFO: `/v3/projects/d5d72222fd1148768d7d38c37eb0dff2/users/050bdd35b1c44c8ba10ed49a4a271ce2/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:59.134124 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8e499-1350-4452-abf5-b01430eb5284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d72222fd1148768d7d38c37eb0dff2, user_id=050bdd35b1c44c8ba10ed49a4a271ce2, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:59.137268 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8e499-1350-4452-abf5-b01430eb5284 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:59.152983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 991/1993] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:59 2021] PUT /identity/v3/projects/d5d72222fd1148768d7d38c37eb0dff2/users/050bdd35b1c44c8ba10ed49a4a271ce2/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:01:59.164783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa5ea2-b248-46c2-87e6-ee22fa7e2ee7 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:59.165064 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa5ea2-b248-46c2-87e6-ee22fa7e2ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:59.165341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa5ea2-b248-46c2-87e6-ee22fa7e2ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:59.198012 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-0faa5ea2-b248-46c2-87e6-ee22fa7e2ee7 None None] MFA Rules not processed for user `050bdd35b1c44c8ba10ed49a4a271ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:59.199394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0faa5ea2-b248-46c2-87e6-ee22fa7e2ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:59.273621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1003/1994] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:59 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:59.279057 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8e499-1350-4452-abf5-b01430eb5284 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:59.397002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8e499-1350-4452-abf5-b01430eb5284 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:59.404122 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8f5e3-2240-43f2-ad45-ee75d5937087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:59.405073 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8f5e3-2240-43f2-ad45-ee75d5937087 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:59.405406 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8f5e3-2240-43f2-ad45-ee75d5937087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:59.405685 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8f5e3-2240-43f2-ad45-ee75d5937087 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:59.406418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8f5e3-2240-43f2-ad45-ee75d5937087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:59.408570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8f5e3-2240-43f2-ad45-ee75d5937087 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:59.447700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 992/1995] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:59 2021] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:01:59.457028 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa5ea2-b248-46c2-87e6-ee22fa7e2ee7 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:59.480624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa5ea2-b248-46c2-87e6-ee22fa7e2ee7 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:59.551992 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58961e82-adfa-4589-aecf-1416655b58e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:59.552738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961e82-adfa-4589-aecf-1416655b58e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:59.558539 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961e82-adfa-4589-aecf-1416655b58e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:59.558539 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961e82-adfa-4589-aecf-1416655b58e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:59.558539 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58961e82-adfa-4589-aecf-1416655b58e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:59.558539 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58961e82-adfa-4589-aecf-1416655b58e5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:59.583532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1004/1996] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:01:59 2021] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:01:59.584932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8f5e3-2240-43f2-ad45-ee75d5937087 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:59.599843 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8f5e3-2240-43f2-ad45-ee75d5937087 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:59.605723 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4e990-ef95-4269-ac71-a098d2daecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:59.606485 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4e990-ef95-4269-ac71-a098d2daecea admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:59.606879 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4e990-ef95-4269-ac71-a098d2daecea admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:59.607331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4e990-ef95-4269-ac71-a098d2daecea admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:59.608194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4e990-ef95-4269-ac71-a098d2daecea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:59.610224 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4e990-ef95-4269-ac71-a098d2daecea admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:59.623087 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 993/1997] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:59 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:01:59.627563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58961e82-adfa-4589-aecf-1416655b58e5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:59.641147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58961e82-adfa-4589-aecf-1416655b58e5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:59.655499 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1662c-c015-445e-84cf-8db37d3bdea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:59.656369 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1662c-c015-445e-84cf-8db37d3bdea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:59.656852 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1662c-c015-445e-84cf-8db37d3bdea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:59.657247 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1662c-c015-445e-84cf-8db37d3bdea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:59.658086 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1662c-c015-445e-84cf-8db37d3bdea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:59.660209 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1662c-c015-445e-84cf-8db37d3bdea1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:59.675049 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1005/1998] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:01:59 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:01:59.679885 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4e990-ef95-4269-ac71-a098d2daecea admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:59.693634 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4e990-ef95-4269-ac71-a098d2daecea admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:59.715604 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b517a97-8ffd-41b3-9ed4-8fee5735cda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:59.717339 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b517a97-8ffd-41b3-9ed4-8fee5735cda0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:59.723523 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b517a97-8ffd-41b3-9ed4-8fee5735cda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:59.724112 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b517a97-8ffd-41b3-9ed4-8fee5735cda0 admin admin] PATH_INFO: `/v3/projects/63ec637af36e4409a4dfaa6a8b650be5/users/9072fda35fb0480c9fc0b071f7a628e4/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:59.771443 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b517a97-8ffd-41b3-9ed4-8fee5735cda0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ec637af36e4409a4dfaa6a8b650be5, user_id=9072fda35fb0480c9fc0b071f7a628e4, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:59.774265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b517a97-8ffd-41b3-9ed4-8fee5735cda0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:01:59.800784 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52338621-271b-4d32-a461-0194b4828008 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:59.801350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52338621-271b-4d32-a461-0194b4828008 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:59.801350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52338621-271b-4d32-a461-0194b4828008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:59.802870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 994/1999] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:01:59 2021] PUT /identity/v3/projects/63ec637af36e4409a4dfaa6a8b650be5/users/9072fda35fb0480c9fc0b071f7a628e4/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:01:59.841085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-52338621-271b-4d32-a461-0194b4828008 None None] MFA Rules not processed for user `9072fda35fb0480c9fc0b071f7a628e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:01:59.842333 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-52338621-271b-4d32-a461-0194b4828008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:01:59.913123 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1006/2000] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:01:59 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:01:59.917999 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b517a97-8ffd-41b3-9ed4-8fee5735cda0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:01:59.987974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b517a97-8ffd-41b3-9ed4-8fee5735cda0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:01:59.994307 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea03a4-de39-4561-bef7-da3dd05159d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:01:59.995460 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea03a4-de39-4561-bef7-da3dd05159d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:01:59.995630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea03a4-de39-4561-bef7-da3dd05159d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:01:59.995818 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea03a4-de39-4561-bef7-da3dd05159d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:01:59.996999 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea03a4-de39-4561-bef7-da3dd05159d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:01:59.999786 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea03a4-de39-4561-bef7-da3dd05159d6 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:00.033413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 995/2001] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:01:59 2021] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:02:00.038606 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52338621-271b-4d32-a461-0194b4828008 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:00.058744 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52338621-271b-4d32-a461-0194b4828008 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:00.127830 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b575f-50fd-40ab-972f-7f021b337f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:00.128596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b575f-50fd-40ab-972f-7f021b337f78 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:00.129089 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b575f-50fd-40ab-972f-7f021b337f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:00.129441 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b575f-50fd-40ab-972f-7f021b337f78 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:00.130351 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b575f-50fd-40ab-972f-7f021b337f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:00.132906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b575f-50fd-40ab-972f-7f021b337f78 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:00.156382 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1007/2002] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:02:00 2021] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:00.161054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea03a4-de39-4561-bef7-da3dd05159d6 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:00.173244 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea03a4-de39-4561-bef7-da3dd05159d6 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:00.177978 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49067fea-b3c5-4092-a554-0c665ee9e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:00.178667 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49067fea-b3c5-4092-a554-0c665ee9e462 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:00.178943 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49067fea-b3c5-4092-a554-0c665ee9e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:00.179248 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49067fea-b3c5-4092-a554-0c665ee9e462 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:00.180000 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49067fea-b3c5-4092-a554-0c665ee9e462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:00.181604 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49067fea-b3c5-4092-a554-0c665ee9e462 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:00.195453 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 996/2003] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:00 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:02:00.200433 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b575f-50fd-40ab-972f-7f021b337f78 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:00.214946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b575f-50fd-40ab-972f-7f021b337f78 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:00.219844 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76761a5a-0948-4c6e-8624-a3ab910f1616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:00.220902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76761a5a-0948-4c6e-8624-a3ab910f1616 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:00.221143 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76761a5a-0948-4c6e-8624-a3ab910f1616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:00.221602 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76761a5a-0948-4c6e-8624-a3ab910f1616 admin admin] PATH_INFO: `/v3/projects/87f85d871e5f46019fcfdc175c8847f7/users/ac0c96cd15bd466eaafc8e9fa33496bd/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:00.239536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76761a5a-0948-4c6e-8624-a3ab910f1616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f85d871e5f46019fcfdc175c8847f7, user_id=ac0c96cd15bd466eaafc8e9fa33496bd, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:00.242213 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76761a5a-0948-4c6e-8624-a3ab910f1616 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:00.263759 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1008/2004] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:02:00 2021] PUT /identity/v3/projects/87f85d871e5f46019fcfdc175c8847f7/users/ac0c96cd15bd466eaafc8e9fa33496bd/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:00.268080 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49067fea-b3c5-4092-a554-0c665ee9e462 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:00.278237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49067fea-b3c5-4092-a554-0c665ee9e462 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:00.332735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b5af8-4496-4ae4-b3ab-31e58beb3317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:00.333585 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b5af8-4496-4ae4-b3ab-31e58beb3317 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:00.334420 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b5af8-4496-4ae4-b3ab-31e58beb3317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:00.334551 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b5af8-4496-4ae4-b3ab-31e58beb3317 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:00.337019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b5af8-4496-4ae4-b3ab-31e58beb3317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:00.337370 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b5af8-4496-4ae4-b3ab-31e58beb3317 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:00.351598 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 997/2005] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:00 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:00.353415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76761a5a-0948-4c6e-8624-a3ab910f1616 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:00.364911 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76761a5a-0948-4c6e-8624-a3ab910f1616 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:00.371988 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab16f6-2da1-4f88-8837-c075882d6c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:00.372974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab16f6-2da1-4f88-8837-c075882d6c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:00.373283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab16f6-2da1-4f88-8837-c075882d6c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:00.373592 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab16f6-2da1-4f88-8837-c075882d6c23 admin admin] PATH_INFO: `/v3/projects/87f85d871e5f46019fcfdc175c8847f7/users/ac0c96cd15bd466eaafc8e9fa33496bd/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:00.376353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab16f6-2da1-4f88-8837-c075882d6c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f85d871e5f46019fcfdc175c8847f7, user_id=ac0c96cd15bd466eaafc8e9fa33496bd, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:00.379281 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab16f6-2da1-4f88-8837-c075882d6c23 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:00.393644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1009/2006] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:02:00 2021] PUT /identity/v3/projects/87f85d871e5f46019fcfdc175c8847f7/users/ac0c96cd15bd466eaafc8e9fa33496bd/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:00.405594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aae1dc-227c-47a8-b7d8-73fb3556c441 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:00.406475 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aae1dc-227c-47a8-b7d8-73fb3556c441 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:00.406808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aae1dc-227c-47a8-b7d8-73fb3556c441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:00.438963 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-39aae1dc-227c-47a8-b7d8-73fb3556c441 None None] MFA Rules not processed for user `ac0c96cd15bd466eaafc8e9fa33496bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:00.440430 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-39aae1dc-227c-47a8-b7d8-73fb3556c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:00.517593 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 998/2007] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:00 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:00.529349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab16f6-2da1-4f88-8837-c075882d6c23 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:00.531238 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c8ab16f6-2da1-4f88-8837-c075882d6c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:00.597167 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab16f6-2da1-4f88-8837-c075882d6c23 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:00.602424 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9541e-4a17-4eef-82d2-a65984f8e8b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:00.603239 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9541e-4a17-4eef-82d2-a65984f8e8b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:00.603873 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9541e-4a17-4eef-82d2-a65984f8e8b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:00.603873 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9541e-4a17-4eef-82d2-a65984f8e8b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:00.616010 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9541e-4a17-4eef-82d2-a65984f8e8b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:00.617752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9541e-4a17-4eef-82d2-a65984f8e8b9 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:00.629651 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1010/2008] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:00 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:00.678594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aae1dc-227c-47a8-b7d8-73fb3556c441 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:00.680678 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-39aae1dc-227c-47a8-b7d8-73fb3556c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:00.693338 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aae1dc-227c-47a8-b7d8-73fb3556c441 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:00.697195 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc770545-c707-4e5b-8051-7c875b66b13c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:00.697882 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc770545-c707-4e5b-8051-7c875b66b13c service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:00.698157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc770545-c707-4e5b-8051-7c875b66b13c service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:00.698430 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc770545-c707-4e5b-8051-7c875b66b13c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:00.758477 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc770545-c707-4e5b-8051-7c875b66b13c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:00.760049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc770545-c707-4e5b-8051-7c875b66b13c service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:00.772992 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 999/2009] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:00 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:00.796209 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9541e-4a17-4eef-82d2-a65984f8e8b9 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:00.797942 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-59f9541e-4a17-4eef-82d2-a65984f8e8b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:00.911486 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9541e-4a17-4eef-82d2-a65984f8e8b9 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:00.921123 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ae702-20e9-4b3d-b1fc-1990c2eb8c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:00.922368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ae702-20e9-4b3d-b1fc-1990c2eb8c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:00.922967 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ae702-20e9-4b3d-b1fc-1990c2eb8c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:00.923614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ae702-20e9-4b3d-b1fc-1990c2eb8c69 admin admin] PATH_INFO: `/v3/users/e8d5f91a1f704c0b954b15855eb10f03` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:00.928099 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ae702-20e9-4b3d-b1fc-1990c2eb8c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d5f91a1f704c0b954b15855eb10f03)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:00.933096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ae702-20e9-4b3d-b1fc-1990c2eb8c69 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:00.962033 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc770545-c707-4e5b-8051-7c875b66b13c service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:00.964328 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-dc770545-c707-4e5b-8051-7c875b66b13c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:00.993050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc770545-c707-4e5b-8051-7c875b66b13c service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:01.002543 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649998b-b183-4408-90d4-91e43aec66bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:01.004161 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649998b-b183-4408-90d4-91e43aec66bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:01.004608 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649998b-b183-4408-90d4-91e43aec66bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:01.005078 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649998b-b183-4408-90d4-91e43aec66bf admin admin] PATH_INFO: `/v3/users/5f5f171ce4d743a1b2cf603b81ca2dee` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:01.007170 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649998b-b183-4408-90d4-91e43aec66bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f5f171ce4d743a1b2cf603b81ca2dee)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:01.010762 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649998b-b183-4408-90d4-91e43aec66bf admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:01.029903 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f56ae702-20e9-4b3d-b1fc-1990c2eb8c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d5f91a1f704c0b954b15855eb10f03'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:01.030676 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f56ae702-20e9-4b3d-b1fc-1990c2eb8c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d5f91a1f704c0b954b15855eb10f03'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:01.044246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f56ae702-20e9-4b3d-b1fc-1990c2eb8c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d5f91a1f704c0b954b15855eb10f03'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:01.045279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f56ae702-20e9-4b3d-b1fc-1990c2eb8c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d5f91a1f704c0b954b15855eb10f03'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:01.066230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f56ae702-20e9-4b3d-b1fc-1990c2eb8c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d5f91a1f704c0b954b15855eb10f03'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:01.089542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1011/2010] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:00 2021] DELETE /identity/v3/users/e8d5f91a1f704c0b954b15855eb10f03 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:01.094672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d649998b-b183-4408-90d4-91e43aec66bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f5f171ce4d743a1b2cf603b81ca2dee'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:01.096469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d649998b-b183-4408-90d4-91e43aec66bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f5f171ce4d743a1b2cf603b81ca2dee'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:01.100136 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5d47-651a-4d5c-8c57-1aa34923ab88 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:01.100317 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5d47-651a-4d5c-8c57-1aa34923ab88 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:01.101390 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5d47-651a-4d5c-8c57-1aa34923ab88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:01.109253 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d649998b-b183-4408-90d4-91e43aec66bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f5f171ce4d743a1b2cf603b81ca2dee'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:01.110030 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d649998b-b183-4408-90d4-91e43aec66bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f5f171ce4d743a1b2cf603b81ca2dee'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:01.144830 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d649998b-b183-4408-90d4-91e43aec66bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f5f171ce4d743a1b2cf603b81ca2dee'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:01.145516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-647b5d47-651a-4d5c-8c57-1aa34923ab88 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:01.147993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-647b5d47-651a-4d5c-8c57-1aa34923ab88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:01.190260 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1000/2011] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:00 2021] DELETE /identity/v3/users/5f5f171ce4d743a1b2cf603b81ca2dee => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:02:01.196078 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafb270-2009-4f7a-959f-4dcb996e36f6 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:01.196551 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafb270-2009-4f7a-959f-4dcb996e36f6 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:01.197056 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafb270-2009-4f7a-959f-4dcb996e36f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:01.254079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-1eafb270-2009-4f7a-959f-4dcb996e36f6 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:01.255989 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1eafb270-2009-4f7a-959f-4dcb996e36f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:01.272198 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1012/2012] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:02:01.307437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b5d47-651a-4d5c-8c57-1aa34923ab88 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:01.310264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-647b5d47-651a-4d5c-8c57-1aa34923ab88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:01.409698 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1001/2013] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:01.423420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b5d47-651a-4d5c-8c57-1aa34923ab88 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:01.430956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafb270-2009-4f7a-959f-4dcb996e36f6 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:01.437790 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1eafb270-2009-4f7a-959f-4dcb996e36f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:01.524058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d039c-d8b7-4433-bbd5-eb7ec098703a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:01.524734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d039c-d8b7-4433-bbd5-eb7ec098703a service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:01.525012 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d039c-d8b7-4433-bbd5-eb7ec098703a service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:01.525279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d039c-d8b7-4433-bbd5-eb7ec098703a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:01.541692 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafb270-2009-4f7a-959f-4dcb996e36f6 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:01.546723 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d039c-d8b7-4433-bbd5-eb7ec098703a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:01.548570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d039c-d8b7-4433-bbd5-eb7ec098703a service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:01.559967 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f298e5f-493e-489d-9328-c161ea4562da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:01.560847 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f298e5f-493e-489d-9328-c161ea4562da service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:01.561223 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f298e5f-493e-489d-9328-c161ea4562da service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:01.561588 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f298e5f-493e-489d-9328-c161ea4562da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:01.562156 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1013/2014] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:02:01.575274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f298e5f-493e-489d-9328-c161ea4562da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:01.577160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f298e5f-493e-489d-9328-c161ea4562da service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:01.590321 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1002/2015] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:02:02.075490 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d039c-d8b7-4433-bbd5-eb7ec098703a service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:02.078108 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b71d039c-d8b7-4433-bbd5-eb7ec098703a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:02.101966 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d039c-d8b7-4433-bbd5-eb7ec098703a service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:02.108664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f07af-e484-43ac-a3c4-19f0c2de6dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:02.109642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f07af-e484-43ac-a3c4-19f0c2de6dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:02.109929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f07af-e484-43ac-a3c4-19f0c2de6dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:02.110200 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f07af-e484-43ac-a3c4-19f0c2de6dbc admin admin] PATH_INFO: `/v3/users/6a6a49ae146b44a4b8e52ce52c128bd3` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:02.112308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f07af-e484-43ac-a3c4-19f0c2de6dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6a49ae146b44a4b8e52ce52c128bd3)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:02.114640 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f07af-e484-43ac-a3c4-19f0c2de6dbc admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:02.182774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-998f07af-e484-43ac-a3c4-19f0c2de6dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6a49ae146b44a4b8e52ce52c128bd3'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.183449 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-998f07af-e484-43ac-a3c4-19f0c2de6dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6a49ae146b44a4b8e52ce52c128bd3'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.191512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-998f07af-e484-43ac-a3c4-19f0c2de6dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6a49ae146b44a4b8e52ce52c128bd3'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.192213 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-998f07af-e484-43ac-a3c4-19f0c2de6dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6a49ae146b44a4b8e52ce52c128bd3'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.212520 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-998f07af-e484-43ac-a3c4-19f0c2de6dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6a49ae146b44a4b8e52ce52c128bd3'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.226352 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1014/2016] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:02 2021] DELETE /identity/v3/users/6a6a49ae146b44a4b8e52ce52c128bd3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:02.431275 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f298e5f-493e-489d-9328-c161ea4562da service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:02.443576 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f298e5f-493e-489d-9328-c161ea4562da service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:02.511541 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:02.513715 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:02.514193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:02.514482 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] PATH_INFO: `/v3/projects/1f99847b246e49c89c0a30cec88804ac` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:02.516320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f99847b246e49c89c0a30cec88804ac)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:02.518489 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:02.583745 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f99847b246e49c89c0a30cec88804ac', 'request_id': 'req-0061aef7-eee9-47f4-a874-e75cdd7a472a'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.590835 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f99847b246e49c89c0a30cec88804ac', 'request_id': 'req-0061aef7-eee9-47f4-a874-e75cdd7a472a'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.604258 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f99847b246e49c89c0a30cec88804ac', 'request_id': 'req-0061aef7-eee9-47f4-a874-e75cdd7a472a'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.623780 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] The token cache is being invalidate because project 1f99847b246e49c89c0a30cec88804ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:02.624148 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.624727 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.629854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1003/2017] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:02 2021] DELETE /identity/v3/projects/1f99847b246e49c89c0a30cec88804ac => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:02:02.638526 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f07af-e484-43ac-a3c4-19f0c2de6dbc admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:02.640099 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-998f07af-e484-43ac-a3c4-19f0c2de6dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:02.655579 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f07af-e484-43ac-a3c4-19f0c2de6dbc admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:02.740493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fa163-2b93-48f9-b904-8a14a6f988ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:02.741631 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fa163-2b93-48f9-b904-8a14a6f988ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:02.743159 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fa163-2b93-48f9-b904-8a14a6f988ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:02.743845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fa163-2b93-48f9-b904-8a14a6f988ee admin admin] PATH_INFO: `/v3/users/d5c94046d9dc49bfbccf421c6661a88d` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:02.748491 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fa163-2b93-48f9-b904-8a14a6f988ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c94046d9dc49bfbccf421c6661a88d)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:02.751060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fa163-2b93-48f9-b904-8a14a6f988ee admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:02.809401 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:02.811398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:02.825585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-378fa163-2b93-48f9-b904-8a14a6f988ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c94046d9dc49bfbccf421c6661a88d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.827072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-378fa163-2b93-48f9-b904-8a14a6f988ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c94046d9dc49bfbccf421c6661a88d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.836964 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061aef7-eee9-47f4-a874-e75cdd7a472a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:02.838188 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-378fa163-2b93-48f9-b904-8a14a6f988ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c94046d9dc49bfbccf421c6661a88d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.839105 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-378fa163-2b93-48f9-b904-8a14a6f988ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c94046d9dc49bfbccf421c6661a88d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.848344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:02.849720 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:02.850790 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:02.851457 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] PATH_INFO: `/v3/projects/71e562d4835248e7ade84335e4a1da15` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:02.861570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e562d4835248e7ade84335e4a1da15)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:02.864452 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:02.892613 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-378fa163-2b93-48f9-b904-8a14a6f988ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c94046d9dc49bfbccf421c6661a88d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.943791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1015/2018] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:02 2021] DELETE /identity/v3/users/d5c94046d9dc49bfbccf421c6661a88d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:02.979486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e562d4835248e7ade84335e4a1da15', 'request_id': 'req-bd38c996-1aeb-47bc-9e80-02b719f71ccc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:02.998629 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fa163-2b93-48f9-b904-8a14a6f988ee admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:03.000535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-378fa163-2b93-48f9-b904-8a14a6f988ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:03.003623 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e562d4835248e7ade84335e4a1da15', 'request_id': 'req-bd38c996-1aeb-47bc-9e80-02b719f71ccc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.021904 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e562d4835248e7ade84335e4a1da15', 'request_id': 'req-bd38c996-1aeb-47bc-9e80-02b719f71ccc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.051484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] The token cache is being invalidate because project 71e562d4835248e7ade84335e4a1da15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:03.051885 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.055346 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.058764 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1004/2019] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:02 2021] DELETE /identity/v3/projects/71e562d4835248e7ade84335e4a1da15 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:03.062885 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:03.066957 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:03.155287 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fa163-2b93-48f9-b904-8a14a6f988ee admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:03.215314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38c996-1aeb-47bc-9e80-02b719f71ccc admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:03.226456 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b1b7b-28d6-4197-b1a4-1494b2bd1a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:03.229672 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:03.231082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:03.231752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:03.232246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] PATH_INFO: `/v3/projects/90a772dfbfc046f294fb88e9a815aec2` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:03.234101 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a772dfbfc046f294fb88e9a815aec2)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:03.234298 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b1b7b-28d6-4197-b1a4-1494b2bd1a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:03.234682 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b1b7b-28d6-4197-b1a4-1494b2bd1a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:03.235106 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b1b7b-28d6-4197-b1a4-1494b2bd1a9c admin admin] PATH_INFO: `/v3/users/26bc9f0686264fa0b1e9d63ee227f4b4` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:03.236899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b1b7b-28d6-4197-b1a4-1494b2bd1a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bc9f0686264fa0b1e9d63ee227f4b4)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:03.237549 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:03.239820 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b1b7b-28d6-4197-b1a4-1494b2bd1a9c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:03.307671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a772dfbfc046f294fb88e9a815aec2', 'request_id': 'req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.314814 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a772dfbfc046f294fb88e9a815aec2', 'request_id': 'req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.323327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a772dfbfc046f294fb88e9a815aec2', 'request_id': 'req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.344746 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-aa7b1b7b-28d6-4197-b1a4-1494b2bd1a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bc9f0686264fa0b1e9d63ee227f4b4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.346006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-aa7b1b7b-28d6-4197-b1a4-1494b2bd1a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bc9f0686264fa0b1e9d63ee227f4b4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.359025 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-aa7b1b7b-28d6-4197-b1a4-1494b2bd1a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bc9f0686264fa0b1e9d63ee227f4b4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.360004 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-aa7b1b7b-28d6-4197-b1a4-1494b2bd1a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bc9f0686264fa0b1e9d63ee227f4b4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.370401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] The token cache is being invalidate because project 90a772dfbfc046f294fb88e9a815aec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:03.372315 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.373783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.382453 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-aa7b1b7b-28d6-4197-b1a4-1494b2bd1a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bc9f0686264fa0b1e9d63ee227f4b4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.383080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1016/2020] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:02 2021] DELETE /identity/v3/projects/90a772dfbfc046f294fb88e9a815aec2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:03.384265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:03.389037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:03.414867 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1005/2021] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:03 2021] DELETE /identity/v3/users/26bc9f0686264fa0b1e9d63ee227f4b4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:02:03.416779 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bddb9-7f82-49b4-b13f-39a02c3710ec None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:03.417327 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bddb9-7f82-49b4-b13f-39a02c3710ec None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:03.417982 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bddb9-7f82-49b4-b13f-39a02c3710ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:03.442447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-f45bddb9-7f82-49b4-b13f-39a02c3710ec None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:03.443765 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f45bddb9-7f82-49b4-b13f-39a02c3710ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:03.540554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1006/2022] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:03.551525 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a959e-32ed-4eb7-82e3-2c02e4af5034 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:03.551856 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a959e-32ed-4eb7-82e3-2c02e4af5034 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:03.552095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a959e-32ed-4eb7-82e3-2c02e4af5034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:03.581612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7256f9a-c8fc-4d3d-bd88-2b93676c1a48 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:03.585528 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-518a959e-32ed-4eb7-82e3-2c02e4af5034 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:03.586892 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-518a959e-32ed-4eb7-82e3-2c02e4af5034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:03.590270 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:03.592411 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:03.593035 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:03.594031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e admin admin] PATH_INFO: `/v3/projects/a40ff217ebe54f969ade1960574286ca` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:03.596478 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40ff217ebe54f969ade1960574286ca)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:03.598959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:03.602445 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1007/2023] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:03.603735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a959e-32ed-4eb7-82e3-2c02e4af5034 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:03.616851 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a959e-32ed-4eb7-82e3-2c02e4af5034 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:03.624877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223e328-c15e-4504-a655-9e6f0af9f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:03.625836 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223e328-c15e-4504-a655-9e6f0af9f1ba admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:03.626658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223e328-c15e-4504-a655-9e6f0af9f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:03.626815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223e328-c15e-4504-a655-9e6f0af9f1ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:03.627867 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223e328-c15e-4504-a655-9e6f0af9f1ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:02:03.628299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223e328-c15e-4504-a655-9e6f0af9f1ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:03.630687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223e328-c15e-4504-a655-9e6f0af9f1ba admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:03.673749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1008/2024] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:02:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:02:03.680114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223e328-c15e-4504-a655-9e6f0af9f1ba admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:03.700836 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223e328-c15e-4504-a655-9e6f0af9f1ba admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:03.726703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40ff217ebe54f969ade1960574286ca', 'request_id': 'req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.735158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40ff217ebe54f969ade1960574286ca', 'request_id': 'req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.745080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40ff217ebe54f969ade1960574286ca', 'request_id': 'req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.780398 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e admin admin] The token cache is being invalidate because project a40ff217ebe54f969ade1960574286ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:03.780984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.782293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-3d9c84bd-c720-4fe4-90f5-a1c44eb1bf6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:03.786655 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1017/2025] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:03 2021] DELETE /identity/v3/projects/a40ff217ebe54f969ade1960574286ca => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:03.795659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db6e2f-035b-4ae3-86e0-1422354cbe71 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:03.796060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db6e2f-035b-4ae3-86e0-1422354cbe71 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:03.796436 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db6e2f-035b-4ae3-86e0-1422354cbe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:03.843661 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-85db6e2f-035b-4ae3-86e0-1422354cbe71 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:03.845024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-85db6e2f-035b-4ae3-86e0-1422354cbe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:03.854946 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e0050-f58a-4377-9a38-0a5d6cf99f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:03.856225 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e0050-f58a-4377-9a38-0a5d6cf99f20 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:03.856613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e0050-f58a-4377-9a38-0a5d6cf99f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:03.856983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e0050-f58a-4377-9a38-0a5d6cf99f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:03.858267 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e0050-f58a-4377-9a38-0a5d6cf99f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:03.861088 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e0050-f58a-4377-9a38-0a5d6cf99f20 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:03.868068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1018/2026] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:03.885142 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffed06-bf10-494d-8de8-d20537fd9132 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:03.885480 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffed06-bf10-494d-8de8-d20537fd9132 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:03.885944 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffed06-bf10-494d-8de8-d20537fd9132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:03.915800 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1009/2027] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:02:03 2021] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:03.920827 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e0050-f58a-4377-9a38-0a5d6cf99f20 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:03.925159 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-384e0050-f58a-4377-9a38-0a5d6cf99f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:03.925920 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-d7ffed06-bf10-494d-8de8-d20537fd9132 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:03.927164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d7ffed06-bf10-494d-8de8-d20537fd9132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:04.052589 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e0050-f58a-4377-9a38-0a5d6cf99f20 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:04.059544 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1019/2028] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:02:04.059544 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffed06-bf10-494d-8de8-d20537fd9132 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:04.059544 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d7ffed06-bf10-494d-8de8-d20537fd9132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:04.069665 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:04.070571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:04.071927 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:04.072242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] PATH_INFO: `/v3/projects/098f28e2e77b4521afb6d03646c820ae` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:04.074508 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=098f28e2e77b4521afb6d03646c820ae)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:04.082787 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:04.094214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffed06-bf10-494d-8de8-d20537fd9132 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:04.102240 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd619f-3239-4eb8-b009-2b7e018bd5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:04.103286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd619f-3239-4eb8-b009-2b7e018bd5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:04.107474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd619f-3239-4eb8-b009-2b7e018bd5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:04.107991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd619f-3239-4eb8-b009-2b7e018bd5a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:04.112439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd619f-3239-4eb8-b009-2b7e018bd5a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:04.115639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd619f-3239-4eb8-b009-2b7e018bd5a7 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:04.148232 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1020/2029] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:02:04 2021] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:04.149696 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd619f-3239-4eb8-b009-2b7e018bd5a7 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:04.185119 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd619f-3239-4eb8-b009-2b7e018bd5a7 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:04.205146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098f28e2e77b4521afb6d03646c820ae', 'request_id': 'req-60331ef6-6bee-4ac6-8518-866114a8bd66'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.214035 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098f28e2e77b4521afb6d03646c820ae', 'request_id': 'req-60331ef6-6bee-4ac6-8518-866114a8bd66'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.223752 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098f28e2e77b4521afb6d03646c820ae', 'request_id': 'req-60331ef6-6bee-4ac6-8518-866114a8bd66'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.240262 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] The token cache is being invalidate because project 098f28e2e77b4521afb6d03646c820ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:04.240537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.241383 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.243458 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1010/2030] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:03 2021] DELETE /identity/v3/projects/098f28e2e77b4521afb6d03646c820ae => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:04.245003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:04.246714 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:04.288594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cf74e-5c6c-4921-88fd-eec87cb3a47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:04.289482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cf74e-5c6c-4921-88fd-eec87cb3a47f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:04.289859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cf74e-5c6c-4921-88fd-eec87cb3a47f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:04.290244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cf74e-5c6c-4921-88fd-eec87cb3a47f admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:04.291090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cf74e-5c6c-4921-88fd-eec87cb3a47f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:02:04.291520 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cf74e-5c6c-4921-88fd-eec87cb3a47f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:04.293535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cf74e-5c6c-4921-88fd-eec87cb3a47f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:04.312850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1021/2031] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:02:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:02:04.313904 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cf74e-5c6c-4921-88fd-eec87cb3a47f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:04.318275 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-953cf74e-5c6c-4921-88fd-eec87cb3a47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:04.327551 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60331ef6-6bee-4ac6-8518-866114a8bd66 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:04.334520 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9072c3a-88d9-4c73-9422-595b1dc343e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:04.335787 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9072c3a-88d9-4c73-9422-595b1dc343e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:04.336419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9072c3a-88d9-4c73-9422-595b1dc343e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:04.337053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9072c3a-88d9-4c73-9422-595b1dc343e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:04.338073 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9072c3a-88d9-4c73-9422-595b1dc343e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:04.344317 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cf74e-5c6c-4921-88fd-eec87cb3a47f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:04.349236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d4b2b-87d8-48e6-9045-bb884aa721c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:04.350129 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4b2b-87d8-48e6-9045-bb884aa721c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:04.350403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4b2b-87d8-48e6-9045-bb884aa721c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:04.350709 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4b2b-87d8-48e6-9045-bb884aa721c0 admin admin] PATH_INFO: `/v3/users/050bdd35b1c44c8ba10ed49a4a271ce2` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:04.352594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d4b2b-87d8-48e6-9045-bb884aa721c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=050bdd35b1c44c8ba10ed49a4a271ce2)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:04.353802 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9072c3a-88d9-4c73-9422-595b1dc343e8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:04.355350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d4b2b-87d8-48e6-9045-bb884aa721c0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:04.380748 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1011/2032] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:04 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:04.381974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9072c3a-88d9-4c73-9422-595b1dc343e8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:04.388462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f9072c3a-88d9-4c73-9422-595b1dc343e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:04.419434 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9072c3a-88d9-4c73-9422-595b1dc343e8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:04.428724 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-cc6d4b2b-87d8-48e6-9045-bb884aa721c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '050bdd35b1c44c8ba10ed49a4a271ce2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.428963 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341fb4f-0c3e-40db-8750-8455a329649f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:04.429416 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-cc6d4b2b-87d8-48e6-9045-bb884aa721c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '050bdd35b1c44c8ba10ed49a4a271ce2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.429808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341fb4f-0c3e-40db-8750-8455a329649f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:04.430088 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341fb4f-0c3e-40db-8750-8455a329649f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:04.430358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341fb4f-0c3e-40db-8750-8455a329649f admin admin] PATH_INFO: `/v3/users/d3af8f08c572488284a1d0d1c15b7300` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:04.431786 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341fb4f-0c3e-40db-8750-8455a329649f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3af8f08c572488284a1d0d1c15b7300)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:04.435067 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341fb4f-0c3e-40db-8750-8455a329649f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:04.440181 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-cc6d4b2b-87d8-48e6-9045-bb884aa721c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '050bdd35b1c44c8ba10ed49a4a271ce2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.441929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-cc6d4b2b-87d8-48e6-9045-bb884aa721c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '050bdd35b1c44c8ba10ed49a4a271ce2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.458789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-cc6d4b2b-87d8-48e6-9045-bb884aa721c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '050bdd35b1c44c8ba10ed49a4a271ce2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.477397 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1022/2033] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:04 2021] DELETE /identity/v3/users/050bdd35b1c44c8ba10ed49a4a271ce2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:04.478650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d4b2b-87d8-48e6-9045-bb884aa721c0 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:04.480475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-cc6d4b2b-87d8-48e6-9045-bb884aa721c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:04.515811 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a341fb4f-0c3e-40db-8750-8455a329649f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3af8f08c572488284a1d0d1c15b7300'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.516525 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a341fb4f-0c3e-40db-8750-8455a329649f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3af8f08c572488284a1d0d1c15b7300'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.528840 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a341fb4f-0c3e-40db-8750-8455a329649f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3af8f08c572488284a1d0d1c15b7300'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.531342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a341fb4f-0c3e-40db-8750-8455a329649f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3af8f08c572488284a1d0d1c15b7300'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.543596 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a341fb4f-0c3e-40db-8750-8455a329649f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3af8f08c572488284a1d0d1c15b7300'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:04.563803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d4b2b-87d8-48e6-9045-bb884aa721c0 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:04.570459 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288f653-9132-4f96-aa1b-5a8e818d8098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:04.571245 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f653-9132-4f96-aa1b-5a8e818d8098 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:04.571730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f653-9132-4f96-aa1b-5a8e818d8098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:04.572076 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f653-9132-4f96-aa1b-5a8e818d8098 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:04.572902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288f653-9132-4f96-aa1b-5a8e818d8098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:04.575162 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288f653-9132-4f96-aa1b-5a8e818d8098 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:04.578165 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1012/2034] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:04 2021] DELETE /identity/v3/users/d3af8f08c572488284a1d0d1c15b7300 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:04.578449 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341fb4f-0c3e-40db-8750-8455a329649f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:04.581432 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-a341fb4f-0c3e-40db-8750-8455a329649f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:04.610374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1023/2035] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:02:04 2021] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:04.612003 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a10e9-89fb-46bf-868c-21e60d7d3dcd None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:04.612437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a10e9-89fb-46bf-868c-21e60d7d3dcd None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:04.613372 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a10e9-89fb-46bf-868c-21e60d7d3dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:04.636218 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-9b6a10e9-89fb-46bf-868c-21e60d7d3dcd None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:04.637961 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9b6a10e9-89fb-46bf-868c-21e60d7d3dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:04.744866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1024/2036] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:04.745734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a10e9-89fb-46bf-868c-21e60d7d3dcd None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:04.747246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9b6a10e9-89fb-46bf-868c-21e60d7d3dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:04.750810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341fb4f-0c3e-40db-8750-8455a329649f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:04.756103 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4994516-11cb-4b84-8f60-405d8a42d57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:04.756811 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4994516-11cb-4b84-8f60-405d8a42d57e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:04.757156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4994516-11cb-4b84-8f60-405d8a42d57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:04.757436 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4994516-11cb-4b84-8f60-405d8a42d57e admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:04.758374 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4994516-11cb-4b84-8f60-405d8a42d57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:04.760138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4994516-11cb-4b84-8f60-405d8a42d57e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:04.761399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a10e9-89fb-46bf-868c-21e60d7d3dcd None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:04.767175 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee643ee-ad1f-4efa-9df7-67bc72de91b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:04.768089 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee643ee-ad1f-4efa-9df7-67bc72de91b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:04.768524 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee643ee-ad1f-4efa-9df7-67bc72de91b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:04.768797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee643ee-ad1f-4efa-9df7-67bc72de91b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:04.769570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee643ee-ad1f-4efa-9df7-67bc72de91b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:04.771914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1013/2037] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:04 2021] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:04.772284 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee643ee-ad1f-4efa-9df7-67bc72de91b5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:04.772608 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4994516-11cb-4b84-8f60-405d8a42d57e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:04.774334 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c4994516-11cb-4b84-8f60-405d8a42d57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:04.798420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1025/2038] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:02:04 2021] POST /identity/v3/users => generated 287 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:04.799305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee643ee-ad1f-4efa-9df7-67bc72de91b5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:04.819731 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee643ee-ad1f-4efa-9df7-67bc72de91b5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:04.824895 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75fad0-73af-4f84-a5d6-1767b5f032e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:04.826387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75fad0-73af-4f84-a5d6-1767b5f032e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:04.826679 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75fad0-73af-4f84-a5d6-1767b5f032e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:04.826979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75fad0-73af-4f84-a5d6-1767b5f032e4 admin admin] PATH_INFO: `/v3/projects/998452870a9845a79555423148e1a6f2/users/81641466bd8b421495665588a62faad3/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:04.849566 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75fad0-73af-4f84-a5d6-1767b5f032e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=998452870a9845a79555423148e1a6f2, user_id=81641466bd8b421495665588a62faad3, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:04.853875 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75fad0-73af-4f84-a5d6-1767b5f032e4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:04.860173 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4994516-11cb-4b84-8f60-405d8a42d57e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:04.866396 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b6fcb-911a-4e8e-abd6-1e2db7a76672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:04.867098 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b6fcb-911a-4e8e-abd6-1e2db7a76672 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:04.867403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b6fcb-911a-4e8e-abd6-1e2db7a76672 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:04.867987 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b6fcb-911a-4e8e-abd6-1e2db7a76672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:04.871187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1026/2039] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:02:04 2021] PUT /identity/v3/projects/998452870a9845a79555423148e1a6f2/users/81641466bd8b421495665588a62faad3/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:04.878754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b6fcb-911a-4e8e-abd6-1e2db7a76672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:04.880359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b6fcb-911a-4e8e-abd6-1e2db7a76672 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:04.881002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75fad0-73af-4f84-a5d6-1767b5f032e4 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:04.893415 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1014/2040] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:04.895115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c7f1-00ff-4c9b-aee8-189fc79384d5 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:04.895420 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c7f1-00ff-4c9b-aee8-189fc79384d5 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:04.895695 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c7f1-00ff-4c9b-aee8-189fc79384d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:04.926119 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-7748c7f1-00ff-4c9b-aee8-189fc79384d5 None None] MFA Rules not processed for user `81641466bd8b421495665588a62faad3`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:04.927675 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-7748c7f1-00ff-4c9b-aee8-189fc79384d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:04.963948 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75fad0-73af-4f84-a5d6-1767b5f032e4 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:04.969328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77f9fe-27b6-4043-a2d5-3ee33010ce68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:04.970021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77f9fe-27b6-4043-a2d5-3ee33010ce68 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:04.970305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77f9fe-27b6-4043-a2d5-3ee33010ce68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:04.970583 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77f9fe-27b6-4043-a2d5-3ee33010ce68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:04.971385 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77f9fe-27b6-4043-a2d5-3ee33010ce68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:04.973032 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77f9fe-27b6-4043-a2d5-3ee33010ce68 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:04.988230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1027/2041] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:04 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:04.992655 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77f9fe-27b6-4043-a2d5-3ee33010ce68 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:05.003955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77f9fe-27b6-4043-a2d5-3ee33010ce68 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:05.010182 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cb945-8720-437c-8e7d-b95c877fd6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:05.011611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cb945-8720-437c-8e7d-b95c877fd6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:05.011900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cb945-8720-437c-8e7d-b95c877fd6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:05.012233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cb945-8720-437c-8e7d-b95c877fd6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:05.013632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cb945-8720-437c-8e7d-b95c877fd6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:05.015849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cb945-8720-437c-8e7d-b95c877fd6e7 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:05.019232 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1015/2042] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:04 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:05.030898 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c7f1-00ff-4c9b-aee8-189fc79384d5 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:05.033639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-7748c7f1-00ff-4c9b-aee8-189fc79384d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:05.033770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1028/2043] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:04 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:05.038756 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cb945-8720-437c-8e7d-b95c877fd6e7 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:05.055255 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cb945-8720-437c-8e7d-b95c877fd6e7 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:05.065810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d39d09-d6c2-4a52-a654-b9c72e2dcc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:05.067955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39d09-d6c2-4a52-a654-b9c72e2dcc77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:05.068392 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39d09-d6c2-4a52-a654-b9c72e2dcc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:05.068860 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39d09-d6c2-4a52-a654-b9c72e2dcc77 admin admin] PATH_INFO: `/v3/projects/559f6c89a0b6468f8deb3f6b963230e2/users/153e0591ae6a4ababa62cacc69fc7989/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:05.099912 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d39d09-d6c2-4a52-a654-b9c72e2dcc77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559f6c89a0b6468f8deb3f6b963230e2, user_id=153e0591ae6a4ababa62cacc69fc7989, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:05.106838 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d39d09-d6c2-4a52-a654-b9c72e2dcc77 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:05.124314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c7f1-00ff-4c9b-aee8-189fc79384d5 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:05.126556 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1029/2044] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:02:05 2021] PUT /identity/v3/projects/559f6c89a0b6468f8deb3f6b963230e2/users/153e0591ae6a4ababa62cacc69fc7989/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:05.136837 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97fd8-2e7e-49ab-8c49-e3f48e033bb5 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:05.138824 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97fd8-2e7e-49ab-8c49-e3f48e033bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:05.138824 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97fd8-2e7e-49ab-8c49-e3f48e033bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:05.205071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-20b97fd8-2e7e-49ab-8c49-e3f48e033bb5 None None] MFA Rules not processed for user `153e0591ae6a4ababa62cacc69fc7989`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:05.207918 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-20b97fd8-2e7e-49ab-8c49-e3f48e033bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:05.210850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b259ff5-5945-4664-ba74-c421e8c9eea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:05.211624 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b259ff5-5945-4664-ba74-c421e8c9eea0 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:05.211875 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b259ff5-5945-4664-ba74-c421e8c9eea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:05.212113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b259ff5-5945-4664-ba74-c421e8c9eea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:05.290573 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b259ff5-5945-4664-ba74-c421e8c9eea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:05.290785 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1030/2045] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:05 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:02:05.292478 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b259ff5-5945-4664-ba74-c421e8c9eea0 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:05.295857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b97fd8-2e7e-49ab-8c49-e3f48e033bb5 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:05.297350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-20b97fd8-2e7e-49ab-8c49-e3f48e033bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:05.306434 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1016/2046] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:05 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:02:05.317180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b259ff5-5945-4664-ba74-c421e8c9eea0 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:05.321947 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2b259ff5-5945-4664-ba74-c421e8c9eea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:05.339055 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b259ff5-5945-4664-ba74-c421e8c9eea0 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:05.343431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aa7f8-39cf-46c8-af1b-bed75ba062e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:05.344305 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aa7f8-39cf-46c8-af1b-bed75ba062e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:05.344749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aa7f8-39cf-46c8-af1b-bed75ba062e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:05.345052 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aa7f8-39cf-46c8-af1b-bed75ba062e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:05.364256 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8aa7f8-39cf-46c8-af1b-bed75ba062e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:05.366310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8aa7f8-39cf-46c8-af1b-bed75ba062e9 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:05.379744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1017/2047] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:05 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:05.392626 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aa7f8-39cf-46c8-af1b-bed75ba062e9 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:05.409069 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aa7f8-39cf-46c8-af1b-bed75ba062e9 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:05.413776 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97985631-fd21-4ad1-891b-4ba904697da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:05.414668 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97985631-fd21-4ad1-891b-4ba904697da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:05.414949 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97985631-fd21-4ad1-891b-4ba904697da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:05.415378 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97985631-fd21-4ad1-891b-4ba904697da9 admin admin] PATH_INFO: `/v3/users/81641466bd8b421495665588a62faad3` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:05.416615 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97985631-fd21-4ad1-891b-4ba904697da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81641466bd8b421495665588a62faad3)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:05.418721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97985631-fd21-4ad1-891b-4ba904697da9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:05.418855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b97fd8-2e7e-49ab-8c49-e3f48e033bb5 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:05.424720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:05.425793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:05.426171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:05.426573 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] PATH_INFO: `/v3/projects/5851a21c907b4e698bf0e7b46c65b843` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:05.428071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5851a21c907b4e698bf0e7b46c65b843)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:05.430323 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:05.524491 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-97985631-fd21-4ad1-891b-4ba904697da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81641466bd8b421495665588a62faad3'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.525609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-97985631-fd21-4ad1-891b-4ba904697da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81641466bd8b421495665588a62faad3'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.541013 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5851a21c907b4e698bf0e7b46c65b843', 'request_id': 'req-f0eabfba-4c35-47b8-958b-e4ed084ef99a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.547189 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-97985631-fd21-4ad1-891b-4ba904697da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81641466bd8b421495665588a62faad3'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.548177 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-97985631-fd21-4ad1-891b-4ba904697da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81641466bd8b421495665588a62faad3'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.551015 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5851a21c907b4e698bf0e7b46c65b843', 'request_id': 'req-f0eabfba-4c35-47b8-958b-e4ed084ef99a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.558320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-97985631-fd21-4ad1-891b-4ba904697da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81641466bd8b421495665588a62faad3'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.559460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5851a21c907b4e698bf0e7b46c65b843', 'request_id': 'req-f0eabfba-4c35-47b8-958b-e4ed084ef99a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.575820 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] The token cache is being invalidate because project 5851a21c907b4e698bf0e7b46c65b843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:05.576215 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.577026 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.579059 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1031/2049] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:05 2021] DELETE /identity/v3/projects/5851a21c907b4e698bf0e7b46c65b843 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:05.579777 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:05.581227 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:05.585786 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1018/2049] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:05 2021] DELETE /identity/v3/users/81641466bd8b421495665588a62faad3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:05.586957 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97985631-fd21-4ad1-891b-4ba904697da9 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:05.588543 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-97985631-fd21-4ad1-891b-4ba904697da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:05.673655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97985631-fd21-4ad1-891b-4ba904697da9 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:05.678724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d153403-ff03-4fdd-9ce4-ff063a408cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:05.679899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d153403-ff03-4fdd-9ce4-ff063a408cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:05.680183 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d153403-ff03-4fdd-9ce4-ff063a408cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:05.680457 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d153403-ff03-4fdd-9ce4-ff063a408cee admin admin] PATH_INFO: `/v3/projects/d5d72222fd1148768d7d38c37eb0dff2` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:05.681219 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eabfba-4c35-47b8-958b-e4ed084ef99a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:05.681708 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d153403-ff03-4fdd-9ce4-ff063a408cee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d72222fd1148768d7d38c37eb0dff2)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:05.684089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d153403-ff03-4fdd-9ce4-ff063a408cee admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:05.687316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f2c87-975c-4f98-b0a9-411a3757ae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:05.688250 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f2c87-975c-4f98-b0a9-411a3757ae9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:05.688531 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f2c87-975c-4f98-b0a9-411a3757ae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:05.688825 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f2c87-975c-4f98-b0a9-411a3757ae9a admin admin] PATH_INFO: `/v3/users/153e0591ae6a4ababa62cacc69fc7989` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:05.690045 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f2c87-975c-4f98-b0a9-411a3757ae9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=153e0591ae6a4ababa62cacc69fc7989)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:05.693153 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f2c87-975c-4f98-b0a9-411a3757ae9a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:05.736204 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6d153403-ff03-4fdd-9ce4-ff063a408cee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d72222fd1148768d7d38c37eb0dff2', 'request_id': 'req-6d153403-ff03-4fdd-9ce4-ff063a408cee'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.743611 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6d153403-ff03-4fdd-9ce4-ff063a408cee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d72222fd1148768d7d38c37eb0dff2', 'request_id': 'req-6d153403-ff03-4fdd-9ce4-ff063a408cee'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.756962 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bc5f2c87-975c-4f98-b0a9-411a3757ae9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '153e0591ae6a4ababa62cacc69fc7989'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.757707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bc5f2c87-975c-4f98-b0a9-411a3757ae9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '153e0591ae6a4ababa62cacc69fc7989'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.762760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6d153403-ff03-4fdd-9ce4-ff063a408cee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d72222fd1148768d7d38c37eb0dff2', 'request_id': 'req-6d153403-ff03-4fdd-9ce4-ff063a408cee'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.768692 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bc5f2c87-975c-4f98-b0a9-411a3757ae9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '153e0591ae6a4ababa62cacc69fc7989'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.770348 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bc5f2c87-975c-4f98-b0a9-411a3757ae9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '153e0591ae6a4ababa62cacc69fc7989'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.779257 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6d153403-ff03-4fdd-9ce4-ff063a408cee admin admin] The token cache is being invalidate because project d5d72222fd1148768d7d38c37eb0dff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:05.779601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6d153403-ff03-4fdd-9ce4-ff063a408cee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.780343 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6d153403-ff03-4fdd-9ce4-ff063a408cee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.782140 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1019/2050] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:05 2021] DELETE /identity/v3/projects/d5d72222fd1148768d7d38c37eb0dff2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:05.783696 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cc67d-95d0-46a5-bd0a-6f67dbadaa76 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:05.784146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cc67d-95d0-46a5-bd0a-6f67dbadaa76 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:05.784536 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cc67d-95d0-46a5-bd0a-6f67dbadaa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:05.787514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bc5f2c87-975c-4f98-b0a9-411a3757ae9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '153e0591ae6a4ababa62cacc69fc7989'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.806313 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1032/2051] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:05 2021] DELETE /identity/v3/users/153e0591ae6a4ababa62cacc69fc7989 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:05.808009 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe2859-9a10-4a8b-94b4-62576b4852a4 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:05.809159 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-cc4cc67d-95d0-46a5-bd0a-6f67dbadaa76 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:05.809304 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe2859-9a10-4a8b-94b4-62576b4852a4 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:05.809630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe2859-9a10-4a8b-94b4-62576b4852a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:05.811150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-cc4cc67d-95d0-46a5-bd0a-6f67dbadaa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:05.830598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-27fe2859-9a10-4a8b-94b4-62576b4852a4 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:05.831844 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-27fe2859-9a10-4a8b-94b4-62576b4852a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:05.888837 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1020/2052] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:05.889780 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cc67d-95d0-46a5-bd0a-6f67dbadaa76 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:05.891067 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-cc4cc67d-95d0-46a5-bd0a-6f67dbadaa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:05.903177 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cc67d-95d0-46a5-bd0a-6f67dbadaa76 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:05.907949 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd958e-d403-4b9d-b693-0e0ffc32ff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:05.908837 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd958e-d403-4b9d-b693-0e0ffc32ff10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:05.909116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd958e-d403-4b9d-b693-0e0ffc32ff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:05.909387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd958e-d403-4b9d-b693-0e0ffc32ff10 admin admin] PATH_INFO: `/v3/users/9072fda35fb0480c9fc0b071f7a628e4` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:05.910625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd958e-d403-4b9d-b693-0e0ffc32ff10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9072fda35fb0480c9fc0b071f7a628e4)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:05.912619 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd958e-d403-4b9d-b693-0e0ffc32ff10 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:05.919047 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1033/2053] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:05.920943 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41a34f-5c24-4aad-84e6-a02bdb6540e7 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:05.921341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41a34f-5c24-4aad-84e6-a02bdb6540e7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:05.921729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41a34f-5c24-4aad-84e6-a02bdb6540e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:05.941640 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-5d41a34f-5c24-4aad-84e6-a02bdb6540e7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:05.943211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-5d41a34f-5c24-4aad-84e6-a02bdb6540e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:05.952093 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1034/2054] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:05.953626 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f129e-e10f-4006-a24e-fa67d24a51ff None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:05.953914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f129e-e10f-4006-a24e-fa67d24a51ff None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:05.954184 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f129e-e10f-4006-a24e-fa67d24a51ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:05.975628 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-03fd958e-d403-4b9d-b693-0e0ffc32ff10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9072fda35fb0480c9fc0b071f7a628e4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.976674 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-03fd958e-d403-4b9d-b693-0e0ffc32ff10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9072fda35fb0480c9fc0b071f7a628e4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.980109 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-9c4f129e-e10f-4006-a24e-fa67d24a51ff None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:05.981478 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9c4f129e-e10f-4006-a24e-fa67d24a51ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:05.987049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-03fd958e-d403-4b9d-b693-0e0ffc32ff10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9072fda35fb0480c9fc0b071f7a628e4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.987854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-03fd958e-d403-4b9d-b693-0e0ffc32ff10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9072fda35fb0480c9fc0b071f7a628e4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:05.991389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1035/2055] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:05.992453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f129e-e10f-4006-a24e-fa67d24a51ff None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:05.993720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9c4f129e-e10f-4006-a24e-fa67d24a51ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:06.004691 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-03fd958e-d403-4b9d-b693-0e0ffc32ff10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9072fda35fb0480c9fc0b071f7a628e4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:06.024385 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1021/2056] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:05 2021] DELETE /identity/v3/users/9072fda35fb0480c9fc0b071f7a628e4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:06.025332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd958e-d403-4b9d-b693-0e0ffc32ff10 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:06.026860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-03fd958e-d403-4b9d-b693-0e0ffc32ff10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:06.055594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f129e-e10f-4006-a24e-fa67d24a51ff None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:06.099468 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd958e-d403-4b9d-b693-0e0ffc32ff10 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:06.105613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b93653-c4d7-4979-8bb7-87d5c4039aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:06.106180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b93653-c4d7-4979-8bb7-87d5c4039aaf service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:06.106553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b93653-c4d7-4979-8bb7-87d5c4039aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:06.106856 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b93653-c4d7-4979-8bb7-87d5c4039aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:06.109423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-07b93653-c4d7-4979-8bb7-87d5c4039aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:06.115173 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ede48-0755-4415-aeaf-17c590f97c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:06.116155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ede48-0755-4415-aeaf-17c590f97c0a service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:06.116438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ede48-0755-4415-aeaf-17c590f97c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:06.116717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ede48-0755-4415-aeaf-17c590f97c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:06.118590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ac1ede48-0755-4415-aeaf-17c590f97c0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:06.179799 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b93653-c4d7-4979-8bb7-87d5c4039aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:06.184255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b93653-c4d7-4979-8bb7-87d5c4039aaf service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:06.188962 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ede48-0755-4415-aeaf-17c590f97c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:06.190550 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ede48-0755-4415-aeaf-17c590f97c0a service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:06.201547 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1036/2057] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:06.201780 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1022/2058] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:06.202364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ede48-0755-4415-aeaf-17c590f97c0a service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:06.206702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ac1ede48-0755-4415-aeaf-17c590f97c0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:06.221209 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ede48-0755-4415-aeaf-17c590f97c0a service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:06.226014 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8832f1e-555e-4e4f-b451-de7f90bccfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:06.226698 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8832f1e-555e-4e4f-b451-de7f90bccfb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:06.226978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8832f1e-555e-4e4f-b451-de7f90bccfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:06.227297 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8832f1e-555e-4e4f-b451-de7f90bccfb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:06.228060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8832f1e-555e-4e4f-b451-de7f90bccfb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:02:06.228366 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8832f1e-555e-4e4f-b451-de7f90bccfb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:06.230076 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8832f1e-555e-4e4f-b451-de7f90bccfb2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:06.242519 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1037/2059] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:02:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:02:06.247114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b93653-c4d7-4979-8bb7-87d5c4039aaf service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:06.257070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b93653-c4d7-4979-8bb7-87d5c4039aaf service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:06.262188 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979c285-436c-4bea-8d48-501fe37bfd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:06.263263 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979c285-436c-4bea-8d48-501fe37bfd19 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:06.263567 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979c285-436c-4bea-8d48-501fe37bfd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:06.263843 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979c285-436c-4bea-8d48-501fe37bfd19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:06.264707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979c285-436c-4bea-8d48-501fe37bfd19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:06.266505 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979c285-436c-4bea-8d48-501fe37bfd19 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:06.302186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1023/2060] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:02:06 2021] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:02:06.303887 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8832f1e-555e-4e4f-b451-de7f90bccfb2 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:06.315942 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8832f1e-555e-4e4f-b451-de7f90bccfb2 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:06.347782 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979c285-436c-4bea-8d48-501fe37bfd19 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:06.349941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-a979c285-436c-4bea-8d48-501fe37bfd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:06.407829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44faa27-3d68-42c2-9253-885aece3a7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:06.408519 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44faa27-3d68-42c2-9253-885aece3a7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:06.408799 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44faa27-3d68-42c2-9253-885aece3a7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:06.409074 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44faa27-3d68-42c2-9253-885aece3a7e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:06.409943 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44faa27-3d68-42c2-9253-885aece3a7e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:06.411944 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44faa27-3d68-42c2-9253-885aece3a7e3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:06.442035 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1038/2061] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:02:06 2021] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:06.447545 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44faa27-3d68-42c2-9253-885aece3a7e3 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:06.456497 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979c285-436c-4bea-8d48-501fe37bfd19 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:06.467241 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44faa27-3d68-42c2-9253-885aece3a7e3 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:06.471845 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:06.473010 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:06.473666 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:06.474143 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] PATH_INFO: `/v3/projects/63ec637af36e4409a4dfaa6a8b650be5` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:06.475761 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ec637af36e4409a4dfaa6a8b650be5)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:06.477285 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e273c-22ef-4468-a03f-5d3cbd3462fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:06.478121 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e273c-22ef-4468-a03f-5d3cbd3462fc admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:06.478495 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e273c-22ef-4468-a03f-5d3cbd3462fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:06.478747 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:06.478847 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e273c-22ef-4468-a03f-5d3cbd3462fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:06.479990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e273c-22ef-4468-a03f-5d3cbd3462fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:06.483075 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e273c-22ef-4468-a03f-5d3cbd3462fc admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:06.496539 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1039/2062] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:06 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:06.503497 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e273c-22ef-4468-a03f-5d3cbd3462fc admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:06.517996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e273c-22ef-4468-a03f-5d3cbd3462fc admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:06.525008 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb8fca-69b5-4747-9015-decf065547e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:06.526008 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb8fca-69b5-4747-9015-decf065547e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:06.526461 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb8fca-69b5-4747-9015-decf065547e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:06.526839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb8fca-69b5-4747-9015-decf065547e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:06.527816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb8fca-69b5-4747-9015-decf065547e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:06.530653 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb8fca-69b5-4747-9015-decf065547e1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:06.548601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1040/2063] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:06 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:06.553379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb8fca-69b5-4747-9015-decf065547e1 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:06.564953 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ec637af36e4409a4dfaa6a8b650be5', 'request_id': 'req-79303e00-a547-4d6e-9aa9-4476cf45de1b'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:06.565687 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb8fca-69b5-4747-9015-decf065547e1 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:06.576359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ec637af36e4409a4dfaa6a8b650be5', 'request_id': 'req-79303e00-a547-4d6e-9aa9-4476cf45de1b'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:06.583836 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ec637af36e4409a4dfaa6a8b650be5', 'request_id': 'req-79303e00-a547-4d6e-9aa9-4476cf45de1b'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:06.599716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] The token cache is being invalidate because project 63ec637af36e4409a4dfaa6a8b650be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:06.600010 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:06.601231 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:06.603716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1024/2064] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:06 2021] DELETE /identity/v3/projects/63ec637af36e4409a4dfaa6a8b650be5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:02:06.617621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:06.625194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:06.692061 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d88bb-0b26-4ff4-8559-e04bc2462ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:06.693871 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d88bb-0b26-4ff4-8559-e04bc2462ade admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:06.693871 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d88bb-0b26-4ff4-8559-e04bc2462ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:06.693871 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d88bb-0b26-4ff4-8559-e04bc2462ade admin admin] PATH_INFO: `/v3/projects/9a9af6bfe3c74fb99cd38a50c1d44960/users/10c03ea3efc0409b9df725a7f9e19b42/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:06.719640 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d88bb-0b26-4ff4-8559-e04bc2462ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9af6bfe3c74fb99cd38a50c1d44960, user_id=10c03ea3efc0409b9df725a7f9e19b42, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:06.731819 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d88bb-0b26-4ff4-8559-e04bc2462ade admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:06.750377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1041/2065] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:02:06 2021] PUT /identity/v3/projects/9a9af6bfe3c74fb99cd38a50c1d44960/users/10c03ea3efc0409b9df725a7f9e19b42/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:06.753955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d88bb-0b26-4ff4-8559-e04bc2462ade admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:06.753955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-335d88bb-0b26-4ff4-8559-e04bc2462ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:06.761608 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79303e00-a547-4d6e-9aa9-4476cf45de1b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:06.828962 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e38ef-276e-4472-8b1a-9d33abb38201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:06.829857 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e38ef-276e-4472-8b1a-9d33abb38201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:06.830204 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e38ef-276e-4472-8b1a-9d33abb38201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:06.830396 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e38ef-276e-4472-8b1a-9d33abb38201 admin admin] PATH_INFO: `/v3/users/ac0c96cd15bd466eaafc8e9fa33496bd` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:06.830495 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d88bb-0b26-4ff4-8559-e04bc2462ade admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:06.831865 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e38ef-276e-4472-8b1a-9d33abb38201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac0c96cd15bd466eaafc8e9fa33496bd)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:06.833824 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e38ef-276e-4472-8b1a-9d33abb38201 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:06.836655 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:06.837905 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:06.838526 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:06.839164 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] PATH_INFO: `/v3/projects/998452870a9845a79555423148e1a6f2` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:06.844142 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=998452870a9845a79555423148e1a6f2)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:06.846587 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:06.895882 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c63e38ef-276e-4472-8b1a-9d33abb38201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac0c96cd15bd466eaafc8e9fa33496bd'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:06.896664 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c63e38ef-276e-4472-8b1a-9d33abb38201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac0c96cd15bd466eaafc8e9fa33496bd'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:06.916030 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c63e38ef-276e-4472-8b1a-9d33abb38201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac0c96cd15bd466eaafc8e9fa33496bd'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:06.918743 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c63e38ef-276e-4472-8b1a-9d33abb38201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac0c96cd15bd466eaafc8e9fa33496bd'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:06.930549 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c63e38ef-276e-4472-8b1a-9d33abb38201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac0c96cd15bd466eaafc8e9fa33496bd'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:06.955424 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1025/2066] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:06 2021] DELETE /identity/v3/users/ac0c96cd15bd466eaafc8e9fa33496bd => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:02:06.957012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0bfc0-0bea-4a76-b327-6e7d547ae8bd None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:06.957365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0bfc0-0bea-4a76-b327-6e7d547ae8bd None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:06.957688 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0bfc0-0bea-4a76-b327-6e7d547ae8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:06.966039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998452870a9845a79555423148e1a6f2', 'request_id': 'req-31364ccb-4d93-4677-91eb-ffc1bf51f26c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:06.972968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998452870a9845a79555423148e1a6f2', 'request_id': 'req-31364ccb-4d93-4677-91eb-ffc1bf51f26c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:06.979526 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998452870a9845a79555423148e1a6f2', 'request_id': 'req-31364ccb-4d93-4677-91eb-ffc1bf51f26c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:06.986205 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-52f0bfc0-0bea-4a76-b327-6e7d547ae8bd None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:06.987852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-52f0bfc0-0bea-4a76-b327-6e7d547ae8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:07.007488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] The token cache is being invalidate because project 998452870a9845a79555423148e1a6f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:07.007841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:07.012264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:07.018372 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1042/2067] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:06 2021] DELETE /identity/v3/projects/998452870a9845a79555423148e1a6f2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:07.019562 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:07.027044 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:07.083562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1026/2068] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:07.088371 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c38a1-7596-4f29-9c29-a050950d3347 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.088760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c38a1-7596-4f29-9c29-a050950d3347 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.089116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c38a1-7596-4f29-9c29-a050950d3347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.113096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-2a7c38a1-7596-4f29-9c29-a050950d3347 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:07.115618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2a7c38a1-7596-4f29-9c29-a050950d3347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:07.128410 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1027/2069] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:07.129413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c38a1-7596-4f29-9c29-a050950d3347 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:07.132940 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2a7c38a1-7596-4f29-9c29-a050950d3347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:07.169271 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31364ccb-4d93-4677-91eb-ffc1bf51f26c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:07.176017 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe4f73-bc62-4975-8832-c80497b48322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:07.176997 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe4f73-bc62-4975-8832-c80497b48322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.177715 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe4f73-bc62-4975-8832-c80497b48322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.178008 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe4f73-bc62-4975-8832-c80497b48322 admin admin] PATH_INFO: `/v3/projects/559f6c89a0b6468f8deb3f6b963230e2` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.179658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe4f73-bc62-4975-8832-c80497b48322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=559f6c89a0b6468f8deb3f6b963230e2)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:07.181877 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe4f73-bc62-4975-8832-c80497b48322 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:07.234012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c38a1-7596-4f29-9c29-a050950d3347 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:07.238669 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8e46a-bbc0-4863-907e-0d9d0c01c394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:07.239240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8e46a-bbc0-4863-907e-0d9d0c01c394 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.239703 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8e46a-bbc0-4863-907e-0d9d0c01c394 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.239867 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8e46a-bbc0-4863-907e-0d9d0c01c394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.253539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8e46a-bbc0-4863-907e-0d9d0c01c394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:07.255193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8e46a-bbc0-4863-907e-0d9d0c01c394 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:07.275370 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e7fe4f73-bc62-4975-8832-c80497b48322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559f6c89a0b6468f8deb3f6b963230e2', 'request_id': 'req-e7fe4f73-bc62-4975-8832-c80497b48322'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:07.287172 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e7fe4f73-bc62-4975-8832-c80497b48322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559f6c89a0b6468f8deb3f6b963230e2', 'request_id': 'req-e7fe4f73-bc62-4975-8832-c80497b48322'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:07.287975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1028/2070] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:07.289380 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9821a0-f93f-46e8-9712-529e8a017283 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.289654 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9821a0-f93f-46e8-9712-529e8a017283 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.289933 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9821a0-f93f-46e8-9712-529e8a017283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.298198 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e7fe4f73-bc62-4975-8832-c80497b48322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559f6c89a0b6468f8deb3f6b963230e2', 'request_id': 'req-e7fe4f73-bc62-4975-8832-c80497b48322'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:07.313915 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-3a9821a0-f93f-46e8-9712-529e8a017283 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:07.315715 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3a9821a0-f93f-46e8-9712-529e8a017283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:07.321558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e7fe4f73-bc62-4975-8832-c80497b48322 admin admin] The token cache is being invalidate because project 559f6c89a0b6468f8deb3f6b963230e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:07.321984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e7fe4f73-bc62-4975-8832-c80497b48322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:07.323171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e7fe4f73-bc62-4975-8832-c80497b48322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:07.330981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1043/2071] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:07 2021] DELETE /identity/v3/projects/559f6c89a0b6468f8deb3f6b963230e2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:07.332311 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5228ca-283b-44bc-b1a3-aa286aaba38d None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.332811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5228ca-283b-44bc-b1a3-aa286aaba38d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.333161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5228ca-283b-44bc-b1a3-aa286aaba38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.361692 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-9b5228ca-283b-44bc-b1a3-aa286aaba38d None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:07.362669 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9b5228ca-283b-44bc-b1a3-aa286aaba38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:07.409619 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1029/2072] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:07.410633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9821a0-f93f-46e8-9712-529e8a017283 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:07.421944 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9821a0-f93f-46e8-9712-529e8a017283 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:07.442598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1044/2073] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:07.442903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03efdc-c311-4ec9-9dbf-36857235c1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:07.442903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03efdc-c311-4ec9-9dbf-36857235c1cc admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.442903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03efdc-c311-4ec9-9dbf-36857235c1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.443558 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03efdc-c311-4ec9-9dbf-36857235c1cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.443899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03efdc-c311-4ec9-9dbf-36857235c1cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:02:07.444253 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03efdc-c311-4ec9-9dbf-36857235c1cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:07.444947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924748-5639-4337-9d38-58d36e86ea9b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.445587 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924748-5639-4337-9d38-58d36e86ea9b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.445952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0924748-5639-4337-9d38-58d36e86ea9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.460577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03efdc-c311-4ec9-9dbf-36857235c1cc admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:07.477138 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-d0924748-5639-4337-9d38-58d36e86ea9b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:07.478402 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d0924748-5639-4337-9d38-58d36e86ea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:07.485063 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1030/2074] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:02:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:02:07.490526 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03efdc-c311-4ec9-9dbf-36857235c1cc admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:07.492279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1045/2075] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:07.496484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8b03efdc-c311-4ec9-9dbf-36857235c1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:07.496622 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0924748-5639-4337-9d38-58d36e86ea9b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:07.508755 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0924748-5639-4337-9d38-58d36e86ea9b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:07.510796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03efdc-c311-4ec9-9dbf-36857235c1cc admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:07.515977 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311bb66-45df-4538-bb53-5ff478d7cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:07.516899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311bb66-45df-4538-bb53-5ff478d7cc5b admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.517277 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311bb66-45df-4538-bb53-5ff478d7cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.517670 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311bb66-45df-4538-bb53-5ff478d7cc5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.518995 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311bb66-45df-4538-bb53-5ff478d7cc5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:07.519273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:07.520667 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.521178 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.522576 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] PATH_INFO: `/v3/projects/87f85d871e5f46019fcfdc175c8847f7` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.522686 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311bb66-45df-4538-bb53-5ff478d7cc5b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:07.524021 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f85d871e5f46019fcfdc175c8847f7)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:07.526791 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:07.564181 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1046/2076] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:02:07 2021] POST /identity/v3/projects => generated 399 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:07.565247 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311bb66-45df-4538-bb53-5ff478d7cc5b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:07.598798 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f85d871e5f46019fcfdc175c8847f7', 'request_id': 'req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:07.609090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f85d871e5f46019fcfdc175c8847f7', 'request_id': 'req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:07.616417 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f85d871e5f46019fcfdc175c8847f7', 'request_id': 'req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:07.631685 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] The token cache is being invalidate because project 87f85d871e5f46019fcfdc175c8847f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:07.632093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:07.632913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:07.634845 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1031/2077] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:07 2021] DELETE /identity/v3/projects/87f85d871e5f46019fcfdc175c8847f7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:07.641526 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:07.642887 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:07.659287 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311bb66-45df-4538-bb53-5ff478d7cc5b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:07.747022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6272497-d7c1-4f31-9d4c-4b5d0fabaf28 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:07.749066 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45a308-09b1-4a3a-8cd1-ee624cbb994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:07.750147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45a308-09b1-4a3a-8cd1-ee624cbb994c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.750622 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45a308-09b1-4a3a-8cd1-ee624cbb994c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.751080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45a308-09b1-4a3a-8cd1-ee624cbb994c admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.752087 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45a308-09b1-4a3a-8cd1-ee624cbb994c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:02:07.752519 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45a308-09b1-4a3a-8cd1-ee624cbb994c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:07.753119 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1924ac-826d-430a-9bbe-521199a7d0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:07.753987 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1924ac-826d-430a-9bbe-521199a7d0db admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.754271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1924ac-826d-430a-9bbe-521199a7d0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.754539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1924ac-826d-430a-9bbe-521199a7d0db admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.754896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45a308-09b1-4a3a-8cd1-ee624cbb994c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:07.755292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1924ac-826d-430a-9bbe-521199a7d0db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:07.757305 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1924ac-826d-430a-9bbe-521199a7d0db admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:07.773162 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1047/2078] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:02:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:02:07.775283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0c44b-9949-4beb-bd9d-fc14db21afbd None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.775837 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0c44b-9949-4beb-bd9d-fc14db21afbd None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.776517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0c44b-9949-4beb-bd9d-fc14db21afbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.784779 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1032/2079] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:02:07 2021] POST /identity/v3/users => generated 300 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:07.786075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1924ac-826d-430a-9bbe-521199a7d0db admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:07.787985 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9e1924ac-826d-430a-9bbe-521199a7d0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:07.802973 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1924ac-826d-430a-9bbe-521199a7d0db admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:07.804591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-a5a0c44b-9949-4beb-bd9d-fc14db21afbd None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:07.806120 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a5a0c44b-9949-4beb-bd9d-fc14db21afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:07.809103 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b02d50-80c4-4a4e-8e29-43b5c7785fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:07.809803 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b02d50-80c4-4a4e-8e29-43b5c7785fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.810084 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b02d50-80c4-4a4e-8e29-43b5c7785fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.810357 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b02d50-80c4-4a4e-8e29-43b5c7785fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.811210 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b02d50-80c4-4a4e-8e29-43b5c7785fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:07.813497 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b02d50-80c4-4a4e-8e29-43b5c7785fd8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:07.815449 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1048/2080] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:07.816477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0c44b-9949-4beb-bd9d-fc14db21afbd None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:07.829155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0c44b-9949-4beb-bd9d-fc14db21afbd None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:07.836296 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aeaae-e0c6-4dd4-b018-15f68f7187f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:07.837477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aeaae-e0c6-4dd4-b018-15f68f7187f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.837926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aeaae-e0c6-4dd4-b018-15f68f7187f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.838296 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aeaae-e0c6-4dd4-b018-15f68f7187f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.839429 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6aeaae-e0c6-4dd4-b018-15f68f7187f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:07.841937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6aeaae-e0c6-4dd4-b018-15f68f7187f7 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:07.858332 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1049/2081] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:07 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:07.858552 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1033/2082] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:02:07 2021] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:07.860463 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b02d50-80c4-4a4e-8e29-43b5c7785fd8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:07.861107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d6a71-773c-429d-96cf-8bff22a3482f None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.861351 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d6a71-773c-429d-96cf-8bff22a3482f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.861726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d6a71-773c-429d-96cf-8bff22a3482f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.883876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-813d6a71-773c-429d-96cf-8bff22a3482f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:07.885120 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-813d6a71-773c-429d-96cf-8bff22a3482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:07.949778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b02d50-80c4-4a4e-8e29-43b5c7785fd8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:07.953048 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1050/2083] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:07.953048 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d6a71-773c-429d-96cf-8bff22a3482f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:07.959614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c5e13-3014-428b-ba41-2f5073b13c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:07.960355 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c5e13-3014-428b-ba41-2f5073b13c10 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.961050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c5e13-3014-428b-ba41-2f5073b13c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.961050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c5e13-3014-428b-ba41-2f5073b13c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.962162 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c5e13-3014-428b-ba41-2f5073b13c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:07.964072 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c5e13-3014-428b-ba41-2f5073b13c10 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:07.967031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d6a71-773c-429d-96cf-8bff22a3482f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:07.972517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2c8cc-f612-44f8-9e74-519ffe8a6749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:07.973334 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2c8cc-f612-44f8-9e74-519ffe8a6749 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.973770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2c8cc-f612-44f8-9e74-519ffe8a6749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.974089 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2c8cc-f612-44f8-9e74-519ffe8a6749 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.974909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2c8cc-f612-44f8-9e74-519ffe8a6749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:07.976529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1034/2084] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:07 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:07.977113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2c8cc-f612-44f8-9e74-519ffe8a6749 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:07.977394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c5e13-3014-428b-ba41-2f5073b13c10 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:07.989035 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c5e13-3014-428b-ba41-2f5073b13c10 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:07.996093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8ce44-f463-45c6-a70b-e00f7d081ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:07.996840 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8ce44-f463-45c6-a70b-e00f7d081ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:07.997122 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8ce44-f463-45c6-a70b-e00f7d081ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:07.997396 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8ce44-f463-45c6-a70b-e00f7d081ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:07.998156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8ce44-f463-45c6-a70b-e00f7d081ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:02:07.998466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8ce44-f463-45c6-a70b-e00f7d081ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:08.000209 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8ce44-f463-45c6-a70b-e00f7d081ba3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:08.005162 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1051/2085] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:02:07 2021] POST /identity/v3/users => generated 284 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:08.006351 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2c8cc-f612-44f8-9e74-519ffe8a6749 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:08.021073 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2c8cc-f612-44f8-9e74-519ffe8a6749 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:08.027342 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc394cb-e89f-4e1c-b12a-c999f45f4300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:08.029036 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc394cb-e89f-4e1c-b12a-c999f45f4300 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:08.029036 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc394cb-e89f-4e1c-b12a-c999f45f4300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:08.029452 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc394cb-e89f-4e1c-b12a-c999f45f4300 admin admin] PATH_INFO: `/v3/projects/3efd676d5db84440814ebe609832fc3e/users/79f3a31c8fa04c90a98b41091d2dca9d/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:08.038851 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1035/2086] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:02:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:02:08.041179 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8ce44-f463-45c6-a70b-e00f7d081ba3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:08.049160 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc394cb-e89f-4e1c-b12a-c999f45f4300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efd676d5db84440814ebe609832fc3e, user_id=79f3a31c8fa04c90a98b41091d2dca9d, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:08.052769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc394cb-e89f-4e1c-b12a-c999f45f4300 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:08.065087 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8ce44-f463-45c6-a70b-e00f7d081ba3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:08.073262 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1052/2087] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:02:08 2021] PUT /identity/v3/projects/3efd676d5db84440814ebe609832fc3e/users/79f3a31c8fa04c90a98b41091d2dca9d/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:08.074434 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc394cb-e89f-4e1c-b12a-c999f45f4300 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:08.146201 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dab054-c1c7-49d5-b34c-f343c5c23bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:08.147187 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dab054-c1c7-49d5-b34c-f343c5c23bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:08.147850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dab054-c1c7-49d5-b34c-f343c5c23bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:08.148308 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dab054-c1c7-49d5-b34c-f343c5c23bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:08.149271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dab054-c1c7-49d5-b34c-f343c5c23bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:08.151357 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dab054-c1c7-49d5-b34c-f343c5c23bc0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:08.166045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1036/2088] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:08 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:08.166045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3937dc-5d55-4e39-ac1d-6f771147f071 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:08.166045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3937dc-5d55-4e39-ac1d-6f771147f071 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:08.166045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3937dc-5d55-4e39-ac1d-6f771147f071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:08.171218 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc394cb-e89f-4e1c-b12a-c999f45f4300 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:08.176585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58981f58-e076-4e47-a82a-1ab990f15d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:08.177261 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58981f58-e076-4e47-a82a-1ab990f15d44 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:08.177551 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58981f58-e076-4e47-a82a-1ab990f15d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:08.177824 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58981f58-e076-4e47-a82a-1ab990f15d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:08.178730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58981f58-e076-4e47-a82a-1ab990f15d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:08.180729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58981f58-e076-4e47-a82a-1ab990f15d44 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:08.198727 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-ab3937dc-5d55-4e39-ac1d-6f771147f071 None None] MFA Rules not processed for user `79f3a31c8fa04c90a98b41091d2dca9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:08.200199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-ab3937dc-5d55-4e39-ac1d-6f771147f071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:08.216265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1053/2089] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:02:08 2021] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:08.217195 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58981f58-e076-4e47-a82a-1ab990f15d44 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:08.279043 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1037/2090] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:08 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:08.280205 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3937dc-5d55-4e39-ac1d-6f771147f071 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:08.295489 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3937dc-5d55-4e39-ac1d-6f771147f071 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:08.301155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58981f58-e076-4e47-a82a-1ab990f15d44 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:08.303964 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f59ef-836b-406e-8edf-e276a06b393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:08.304695 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f59ef-836b-406e-8edf-e276a06b393f admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:08.304978 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f59ef-836b-406e-8edf-e276a06b393f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:08.305253 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f59ef-836b-406e-8edf-e276a06b393f admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:08.305977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f59ef-836b-406e-8edf-e276a06b393f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:08.306321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332bb44-73c0-4b67-910a-06891a3cebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:08.307053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332bb44-73c0-4b67-910a-06891a3cebbb admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:08.307481 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332bb44-73c0-4b67-910a-06891a3cebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:08.307785 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332bb44-73c0-4b67-910a-06891a3cebbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:08.308242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f59ef-836b-406e-8edf-e276a06b393f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:08.308614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332bb44-73c0-4b67-910a-06891a3cebbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:08.310740 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332bb44-73c0-4b67-910a-06891a3cebbb admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:08.326632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1054/2091] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:08 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:08.328248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332bb44-73c0-4b67-910a-06891a3cebbb admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:08.331440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8332bb44-73c0-4b67-910a-06891a3cebbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:08.360750 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1038/2092] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:02:08 2021] POST /identity/v3/users => generated 284 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:08.361775 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f59ef-836b-406e-8edf-e276a06b393f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:08.377380 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f59ef-836b-406e-8edf-e276a06b393f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:08.383945 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78cec6-0cc4-44ce-9c5e-a9fe12107eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:08.384791 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78cec6-0cc4-44ce-9c5e-a9fe12107eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:08.385367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78cec6-0cc4-44ce-9c5e-a9fe12107eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:08.385672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78cec6-0cc4-44ce-9c5e-a9fe12107eaf admin admin] PATH_INFO: `/v3/projects/f1db85b3058641de87a3b6f0d13fd935/users/b746139131424a7a874e60e14c07325a/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:08.412740 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78cec6-0cc4-44ce-9c5e-a9fe12107eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1db85b3058641de87a3b6f0d13fd935, user_id=b746139131424a7a874e60e14c07325a, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:08.416041 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78cec6-0cc4-44ce-9c5e-a9fe12107eaf admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:08.442516 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1039/2093] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:02:08 2021] PUT /identity/v3/projects/f1db85b3058641de87a3b6f0d13fd935/users/b746139131424a7a874e60e14c07325a/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:08.443572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78cec6-0cc4-44ce-9c5e-a9fe12107eaf admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:08.444745 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332bb44-73c0-4b67-910a-06891a3cebbb admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:08.525859 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78cec6-0cc4-44ce-9c5e-a9fe12107eaf admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:08.534026 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95feb2-afcc-4884-9612-0474e0caf5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:08.535022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95feb2-afcc-4884-9612-0474e0caf5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:08.535656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95feb2-afcc-4884-9612-0474e0caf5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:08.536077 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95feb2-afcc-4884-9612-0474e0caf5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:08.537330 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95feb2-afcc-4884-9612-0474e0caf5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:08.539942 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95feb2-afcc-4884-9612-0474e0caf5c4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:08.544408 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241cf47-822d-40af-b192-c228c058d34d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:08.545454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241cf47-822d-40af-b192-c228c058d34d service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:08.545976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241cf47-822d-40af-b192-c228c058d34d service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:08.546423 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241cf47-822d-40af-b192-c228c058d34d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:08.556208 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1040/2094] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:08 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:08.556208 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca5a90-d3c5-41ba-b29e-a2c68a3fad68 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:08.556495 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca5a90-d3c5-41ba-b29e-a2c68a3fad68 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:08.556854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca5a90-d3c5-41ba-b29e-a2c68a3fad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:08.611539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-9cca5a90-d3c5-41ba-b29e-a2c68a3fad68 None None] MFA Rules not processed for user `b746139131424a7a874e60e14c07325a`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:08.615235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9cca5a90-d3c5-41ba-b29e-a2c68a3fad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:08.658055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241cf47-822d-40af-b192-c228c058d34d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:08.659634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241cf47-822d-40af-b192-c228c058d34d service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:08.678357 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1055/2095] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:08 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:08.681450 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241cf47-822d-40af-b192-c228c058d34d service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:08.708182 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241cf47-822d-40af-b192-c228c058d34d service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:08.723984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c6c00-65a0-4be1-a48d-03a2032693db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:08.723984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6c00-65a0-4be1-a48d-03a2032693db admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:08.723984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6c00-65a0-4be1-a48d-03a2032693db admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:08.723984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6c00-65a0-4be1-a48d-03a2032693db admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:08.724503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c6c00-65a0-4be1-a48d-03a2032693db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:08.726521 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c6c00-65a0-4be1-a48d-03a2032693db admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:08.735952 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1041/2096] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:08 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:08.751874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca5a90-d3c5-41ba-b29e-a2c68a3fad68 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:08.758403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9cca5a90-d3c5-41ba-b29e-a2c68a3fad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:08.763350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1056/2097] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:08 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:08.768359 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c6c00-65a0-4be1-a48d-03a2032693db admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:08.784638 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c6c00-65a0-4be1-a48d-03a2032693db admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:08.791437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5693fa8-7e71-4b37-a34a-97c06d6beb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:08.792903 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5693fa8-7e71-4b37-a34a-97c06d6beb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:08.793686 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5693fa8-7e71-4b37-a34a-97c06d6beb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:08.793975 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5693fa8-7e71-4b37-a34a-97c06d6beb73 admin admin] PATH_INFO: `/v3/projects/f49cc86001de432b9d35a70b03bc0799/users/90d054c4d0304519a3d5998a8300c752/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:08.823224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5693fa8-7e71-4b37-a34a-97c06d6beb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f49cc86001de432b9d35a70b03bc0799, user_id=90d054c4d0304519a3d5998a8300c752, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:08.827184 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5693fa8-7e71-4b37-a34a-97c06d6beb73 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:08.850966 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1057/2098] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:02:08 2021] PUT /identity/v3/projects/f49cc86001de432b9d35a70b03bc0799/users/90d054c4d0304519a3d5998a8300c752/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:08.853210 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3769c84-c3b8-4760-b3fc-99f7d6af9ec5 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:08.853490 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3769c84-c3b8-4760-b3fc-99f7d6af9ec5 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:08.853765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3769c84-c3b8-4760-b3fc-99f7d6af9ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:08.871424 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca5a90-d3c5-41ba-b29e-a2c68a3fad68 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:08.886679 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-d3769c84-c3b8-4760-b3fc-99f7d6af9ec5 None None] MFA Rules not processed for user `10c03ea3efc0409b9df725a7f9e19b42`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:08.888154 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d3769c84-c3b8-4760-b3fc-99f7d6af9ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:08.956380 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6d958-cd5e-4828-b58c-0b25105f38e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a71b8adef243049d3b055e66566a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:08.957086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6d958-cd5e-4828-b58c-0b25105f38e4 service glance] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:08.957540 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6d958-cd5e-4828-b58c-0b25105f38e4 service glance] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:08.957823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6d958-cd5e-4828-b58c-0b25105f38e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:09.029699 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6d958-cd5e-4828-b58c-0b25105f38e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:09.031519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6d958-cd5e-4828-b58c-0b25105f38e4 service glance] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:09.040874 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1058/2099] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:08 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:09.042912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1042/2100] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:08 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:02:09.049551 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23932a7-826c-4164-a3a2-fb201c79a09d None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:09.049925 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23932a7-826c-4164-a3a2-fb201c79a09d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:09.050276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23932a7-826c-4164-a3a2-fb201c79a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:09.053243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6d958-cd5e-4828-b58c-0b25105f38e4 service glance] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:09.084342 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-a23932a7-826c-4164-a3a2-fb201c79a09d None None] MFA Rules not processed for user `90d054c4d0304519a3d5998a8300c752`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:09.085211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a23932a7-826c-4164-a3a2-fb201c79a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:09.119578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6d958-cd5e-4828-b58c-0b25105f38e4 service glance] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:09.124357 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434791de-9b79-4b3d-8683-655c919dce72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:09.125019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434791de-9b79-4b3d-8683-655c919dce72 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:09.125297 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434791de-9b79-4b3d-8683-655c919dce72 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:09.125575 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434791de-9b79-4b3d-8683-655c919dce72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:09.140872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434791de-9b79-4b3d-8683-655c919dce72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:09.144276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434791de-9b79-4b3d-8683-655c919dce72 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:09.159240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1043/2101] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:09 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:09.164762 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434791de-9b79-4b3d-8683-655c919dce72 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:09.167168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1059/2102] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:09 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:09.252070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434791de-9b79-4b3d-8683-655c919dce72 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:09.258103 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a5c73-ff47-4570-ab08-c8bdfd10fe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:09.259019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a5c73-ff47-4570-ab08-c8bdfd10fe53 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:09.259476 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a5c73-ff47-4570-ab08-c8bdfd10fe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:09.259745 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a5c73-ff47-4570-ab08-c8bdfd10fe53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:09.260558 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a5c73-ff47-4570-ab08-c8bdfd10fe53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:09.262927 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a5c73-ff47-4570-ab08-c8bdfd10fe53 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:09.295086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1044/2103] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:02:09 2021] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:09.298740 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23932a7-826c-4164-a3a2-fb201c79a09d None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:09.319755 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23932a7-826c-4164-a3a2-fb201c79a09d None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:09.410919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36802fde-0729-4c70-8258-3b1a75fe4fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:09.411926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36802fde-0729-4c70-8258-3b1a75fe4fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:09.412624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36802fde-0729-4c70-8258-3b1a75fe4fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:09.412985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36802fde-0729-4c70-8258-3b1a75fe4fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:09.414045 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36802fde-0729-4c70-8258-3b1a75fe4fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:09.416913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36802fde-0729-4c70-8258-3b1a75fe4fb5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:09.451013 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a5c73-ff47-4570-ab08-c8bdfd10fe53 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:09.469332 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1060/2104] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:02:09 2021] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:09.475446 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a5c73-ff47-4570-ab08-c8bdfd10fe53 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:09.488004 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7dabe-d882-4822-890a-248254a9b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:09.488945 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7dabe-d882-4822-890a-248254a9b2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:09.489318 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7dabe-d882-4822-890a-248254a9b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:09.489789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7dabe-d882-4822-890a-248254a9b2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:09.490744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7dabe-d882-4822-890a-248254a9b2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:09.492475 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7dabe-d882-4822-890a-248254a9b2a2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:09.508894 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1045/2105] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:09 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:09.515042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36802fde-0729-4c70-8258-3b1a75fe4fb5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:09.528158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36802fde-0729-4c70-8258-3b1a75fe4fb5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:09.533814 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a7641-27b7-495a-9208-9742fd5dfe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:09.535109 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a7641-27b7-495a-9208-9742fd5dfe71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:09.535581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a7641-27b7-495a-9208-9742fd5dfe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:09.536197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a7641-27b7-495a-9208-9742fd5dfe71 admin admin] PATH_INFO: `/v3/projects/7fbd3601e64443d78aa3ec5e25b37c4f/users/a3fd6711a4164a57bc410c344e3540d7/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:09.555279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a7641-27b7-495a-9208-9742fd5dfe71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fbd3601e64443d78aa3ec5e25b37c4f, user_id=a3fd6711a4164a57bc410c344e3540d7, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:09.559066 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a7641-27b7-495a-9208-9742fd5dfe71 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:09.592038 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1061/2106] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:02:09 2021] PUT /identity/v3/projects/7fbd3601e64443d78aa3ec5e25b37c4f/users/a3fd6711a4164a57bc410c344e3540d7/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:09.594951 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7dabe-d882-4822-890a-248254a9b2a2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:09.610763 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7dabe-d882-4822-890a-248254a9b2a2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:09.699367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051b75a-8426-42d2-8a30-20fa97c1d6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:09.700107 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051b75a-8426-42d2-8a30-20fa97c1d6fa admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:09.700392 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051b75a-8426-42d2-8a30-20fa97c1d6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:09.701003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051b75a-8426-42d2-8a30-20fa97c1d6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:09.701466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051b75a-8426-42d2-8a30-20fa97c1d6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:09.703191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051b75a-8426-42d2-8a30-20fa97c1d6fa admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:09.715578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1046/2107] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:09 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:09.724495 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a7641-27b7-495a-9208-9742fd5dfe71 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:09.737257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a7641-27b7-495a-9208-9742fd5dfe71 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:09.744795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42316731-b897-46c0-99f5-3f80d2130c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:09.745948 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42316731-b897-46c0-99f5-3f80d2130c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:09.746419 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42316731-b897-46c0-99f5-3f80d2130c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:09.746798 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42316731-b897-46c0-99f5-3f80d2130c41 admin admin] PATH_INFO: `/v3/projects/7fbd3601e64443d78aa3ec5e25b37c4f/users/a3fd6711a4164a57bc410c344e3540d7/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:09.749987 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42316731-b897-46c0-99f5-3f80d2130c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fbd3601e64443d78aa3ec5e25b37c4f, user_id=a3fd6711a4164a57bc410c344e3540d7, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:09.753028 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42316731-b897-46c0-99f5-3f80d2130c41 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:09.769821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1062/2108] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:02:09 2021] PUT /identity/v3/projects/7fbd3601e64443d78aa3ec5e25b37c4f/users/a3fd6711a4164a57bc410c344e3540d7/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:09.790292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf498f-1165-4e6d-bb4d-27d59f1c3ae8 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:09.790701 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf498f-1165-4e6d-bb4d-27d59f1c3ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:09.791318 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf498f-1165-4e6d-bb4d-27d59f1c3ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:09.832727 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-afdf498f-1165-4e6d-bb4d-27d59f1c3ae8 None None] MFA Rules not processed for user `a3fd6711a4164a57bc410c344e3540d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:09.834122 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-afdf498f-1165-4e6d-bb4d-27d59f1c3ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:09.939344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1047/2109] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:09 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:09.951368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42316731-b897-46c0-99f5-3f80d2130c41 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:09.953459 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-42316731-b897-46c0-99f5-3f80d2130c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:10.011873 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42316731-b897-46c0-99f5-3f80d2130c41 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:10.016330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126909df-aaac-4f29-b2a8-5851df66c515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:10.017015 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126909df-aaac-4f29-b2a8-5851df66c515 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:10.017295 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126909df-aaac-4f29-b2a8-5851df66c515 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:10.017561 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126909df-aaac-4f29-b2a8-5851df66c515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:10.027376 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126909df-aaac-4f29-b2a8-5851df66c515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:10.028906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126909df-aaac-4f29-b2a8-5851df66c515 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:10.039971 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1063/2110] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:09 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:02:10.140329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf498f-1165-4e6d-bb4d-27d59f1c3ae8 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:10.150496 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf498f-1165-4e6d-bb4d-27d59f1c3ae8 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:10.154389 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d958e48-6c22-49ee-97dc-9e1b89e6cb39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:10.155030 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d958e48-6c22-49ee-97dc-9e1b89e6cb39 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:10.155341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d958e48-6c22-49ee-97dc-9e1b89e6cb39 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:10.155614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d958e48-6c22-49ee-97dc-9e1b89e6cb39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:10.214382 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d958e48-6c22-49ee-97dc-9e1b89e6cb39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:10.215975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d958e48-6c22-49ee-97dc-9e1b89e6cb39 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:10.225893 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1048/2111] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:10 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:02:10.686626 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82f52a-0d40-4c93-a4c7-7f79f98b91a4 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:10.687217 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82f52a-0d40-4c93-a4c7-7f79f98b91a4 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:10.687742 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82f52a-0d40-4c93-a4c7-7f79f98b91a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:10.710965 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-7b82f52a-0d40-4c93-a4c7-7f79f98b91a4 None None] MFA Rules not processed for user `10c03ea3efc0409b9df725a7f9e19b42`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:10.712591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7b82f52a-0d40-4c93-a4c7-7f79f98b91a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:10.808190 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1064/2112] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:10 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:11.660913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d958e48-6c22-49ee-97dc-9e1b89e6cb39 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:11.662387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1d958e48-6c22-49ee-97dc-9e1b89e6cb39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:11.757037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d958e48-6c22-49ee-97dc-9e1b89e6cb39 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:11.769137 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347baffc-be8e-43ff-b943-3b213e4834bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:11.769927 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347baffc-be8e-43ff-b943-3b213e4834bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:11.770295 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347baffc-be8e-43ff-b943-3b213e4834bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:11.770649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347baffc-be8e-43ff-b943-3b213e4834bd admin admin] PATH_INFO: `/v3/users/4f95dd5d1b47415e830d6fa518d56766` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:11.771994 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347baffc-be8e-43ff-b943-3b213e4834bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f95dd5d1b47415e830d6fa518d56766)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:11.774058 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347baffc-be8e-43ff-b943-3b213e4834bd admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:11.857195 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-347baffc-be8e-43ff-b943-3b213e4834bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f95dd5d1b47415e830d6fa518d56766'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:11.857890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-347baffc-be8e-43ff-b943-3b213e4834bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f95dd5d1b47415e830d6fa518d56766'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:11.865752 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-347baffc-be8e-43ff-b943-3b213e4834bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f95dd5d1b47415e830d6fa518d56766'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:11.866552 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-347baffc-be8e-43ff-b943-3b213e4834bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f95dd5d1b47415e830d6fa518d56766'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:11.874412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-347baffc-be8e-43ff-b943-3b213e4834bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f95dd5d1b47415e830d6fa518d56766'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:11.893274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1049/2113] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:11 2021] DELETE /identity/v3/users/4f95dd5d1b47415e830d6fa518d56766 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:12.085707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82f52a-0d40-4c93-a4c7-7f79f98b91a4 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:12.099356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82f52a-0d40-4c93-a4c7-7f79f98b91a4 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:12.164839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4ab05-413f-431c-bd68-82eeaeba2bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:12.165716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4ab05-413f-431c-bd68-82eeaeba2bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:12.165999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4ab05-413f-431c-bd68-82eeaeba2bab admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:12.166309 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4ab05-413f-431c-bd68-82eeaeba2bab admin admin] PATH_INFO: `/v3/projects/513edfe04394445eac9fba7e014af92f` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:12.167760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4ab05-413f-431c-bd68-82eeaeba2bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=513edfe04394445eac9fba7e014af92f)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:12.169829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4ab05-413f-431c-bd68-82eeaeba2bab admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:12.218533 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-aeb4ab05-413f-431c-bd68-82eeaeba2bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513edfe04394445eac9fba7e014af92f', 'request_id': 'req-aeb4ab05-413f-431c-bd68-82eeaeba2bab'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:12.224810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-aeb4ab05-413f-431c-bd68-82eeaeba2bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513edfe04394445eac9fba7e014af92f', 'request_id': 'req-aeb4ab05-413f-431c-bd68-82eeaeba2bab'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:12.231608 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-aeb4ab05-413f-431c-bd68-82eeaeba2bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513edfe04394445eac9fba7e014af92f', 'request_id': 'req-aeb4ab05-413f-431c-bd68-82eeaeba2bab'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:12.246542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-aeb4ab05-413f-431c-bd68-82eeaeba2bab admin admin] The token cache is being invalidate because project 513edfe04394445eac9fba7e014af92f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:12.246866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-aeb4ab05-413f-431c-bd68-82eeaeba2bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:12.248467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-aeb4ab05-413f-431c-bd68-82eeaeba2bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:12.250285 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1065/2114] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:12 2021] DELETE /identity/v3/projects/513edfe04394445eac9fba7e014af92f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:12.256529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc5772-ff3d-4fdc-8690-c81a72ca96eb None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:12.256847 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc5772-ff3d-4fdc-8690-c81a72ca96eb None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:12.257154 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc5772-ff3d-4fdc-8690-c81a72ca96eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:12.277214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-7afc5772-ff3d-4fdc-8690-c81a72ca96eb None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:12.278476 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-7afc5772-ff3d-4fdc-8690-c81a72ca96eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:12.348008 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1050/2115] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:02:12.356284 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aba10a-ed35-4dc0-9267-286ed6cbbed8 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:12.356570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aba10a-ed35-4dc0-9267-286ed6cbbed8 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:12.356843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aba10a-ed35-4dc0-9267-286ed6cbbed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:12.375677 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-67aba10a-ed35-4dc0-9267-286ed6cbbed8 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:12.376907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-67aba10a-ed35-4dc0-9267-286ed6cbbed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:12.385152 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1066/2116] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:12.390371 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc5772-ff3d-4fdc-8690-c81a72ca96eb None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:12.401665 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc5772-ff3d-4fdc-8690-c81a72ca96eb None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:12.407959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef4965-fec9-4a7e-88df-87c4c10ae592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:12.408639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef4965-fec9-4a7e-88df-87c4c10ae592 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:12.408916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef4965-fec9-4a7e-88df-87c4c10ae592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:12.409213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef4965-fec9-4a7e-88df-87c4c10ae592 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:12.409974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef4965-fec9-4a7e-88df-87c4c10ae592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:02:12.410291 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef4965-fec9-4a7e-88df-87c4c10ae592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:12.412195 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef4965-fec9-4a7e-88df-87c4c10ae592 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:12.426312 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1051/2117] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:02:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:02:12.430700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aba10a-ed35-4dc0-9267-286ed6cbbed8 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:12.440266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aba10a-ed35-4dc0-9267-286ed6cbbed8 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:12.445630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0f8bd-8d75-4d2a-ae4c-f7ae8f43e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:12.446301 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0f8bd-8d75-4d2a-ae4c-f7ae8f43e052 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:12.446569 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0f8bd-8d75-4d2a-ae4c-f7ae8f43e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:12.446840 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0f8bd-8d75-4d2a-ae4c-f7ae8f43e052 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:12.447601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0f8bd-8d75-4d2a-ae4c-f7ae8f43e052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:12.449636 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0f8bd-8d75-4d2a-ae4c-f7ae8f43e052 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:12.481402 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1067/2118] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:02:12 2021] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:12.486078 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef4965-fec9-4a7e-88df-87c4c10ae592 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:12.499066 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef4965-fec9-4a7e-88df-87c4c10ae592 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:12.571467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb491451-6234-44c0-9f37-d755ca84063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:12.572165 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb491451-6234-44c0-9f37-d755ca84063a admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:12.572442 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb491451-6234-44c0-9f37-d755ca84063a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:12.572823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb491451-6234-44c0-9f37-d755ca84063a admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:12.573859 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb491451-6234-44c0-9f37-d755ca84063a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:12.575911 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb491451-6234-44c0-9f37-d755ca84063a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:12.600206 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1052/2119] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:02:12 2021] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:12.604937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0f8bd-8d75-4d2a-ae4c-f7ae8f43e052 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:12.616998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0f8bd-8d75-4d2a-ae4c-f7ae8f43e052 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:12.623772 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66283f57-49a6-4596-8266-49e36353c114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:12.624497 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66283f57-49a6-4596-8266-49e36353c114 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:12.624799 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66283f57-49a6-4596-8266-49e36353c114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:12.625093 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66283f57-49a6-4596-8266-49e36353c114 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:12.625899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66283f57-49a6-4596-8266-49e36353c114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:12.627688 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66283f57-49a6-4596-8266-49e36353c114 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:12.640403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1068/2120] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:12 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:12.644962 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb491451-6234-44c0-9f37-d755ca84063a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:12.656871 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb491451-6234-44c0-9f37-d755ca84063a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:12.663647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17cf9e-8773-4e62-b713-150ca08e8add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:12.664586 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17cf9e-8773-4e62-b713-150ca08e8add admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:12.664898 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17cf9e-8773-4e62-b713-150ca08e8add admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:12.665435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17cf9e-8773-4e62-b713-150ca08e8add admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:12.666412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17cf9e-8773-4e62-b713-150ca08e8add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:12.668647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17cf9e-8773-4e62-b713-150ca08e8add admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:12.686067 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1053/2121] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:12 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:12.691430 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66283f57-49a6-4596-8266-49e36353c114 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:12.703064 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66283f57-49a6-4596-8266-49e36353c114 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:12.708917 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cffe42-036a-4f6d-bc35-4002479f4081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:12.709806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cffe42-036a-4f6d-bc35-4002479f4081 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:12.710087 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cffe42-036a-4f6d-bc35-4002479f4081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:12.710412 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cffe42-036a-4f6d-bc35-4002479f4081 admin admin] PATH_INFO: `/v3/projects/be28da99be9a462fa89a87973f93a733/users/f163d3e6c712494abb9527c42922763b/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:12.726766 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cffe42-036a-4f6d-bc35-4002479f4081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be28da99be9a462fa89a87973f93a733, user_id=f163d3e6c712494abb9527c42922763b, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:12.729563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cffe42-036a-4f6d-bc35-4002479f4081 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:12.745317 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1069/2122] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:02:12 2021] PUT /identity/v3/projects/be28da99be9a462fa89a87973f93a733/users/f163d3e6c712494abb9527c42922763b/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:12.750871 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcab1b-b648-4c70-be99-866642df0ff5 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:12.751184 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcab1b-b648-4c70-be99-866642df0ff5 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:12.751466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcab1b-b648-4c70-be99-866642df0ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:12.770813 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-7cfcab1b-b648-4c70-be99-866642df0ff5 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:12.772048 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-7cfcab1b-b648-4c70-be99-866642df0ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:12.833239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1054/2123] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:12.843580 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cffe42-036a-4f6d-bc35-4002479f4081 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:12.845509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-85cffe42-036a-4f6d-bc35-4002479f4081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:12.913661 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cffe42-036a-4f6d-bc35-4002479f4081 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:12.919387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831bbf3-7b93-42ac-b35d-08cb7e2a8477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:12.919953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831bbf3-7b93-42ac-b35d-08cb7e2a8477 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:12.920131 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831bbf3-7b93-42ac-b35d-08cb7e2a8477 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:12.920460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831bbf3-7b93-42ac-b35d-08cb7e2a8477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:12.933486 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831bbf3-7b93-42ac-b35d-08cb7e2a8477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:12.935113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831bbf3-7b93-42ac-b35d-08cb7e2a8477 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:12.946536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1070/2124] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:13.636983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3982f4a-8f53-4c2c-825a-a9f2b522ea35 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:13.637843 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3982f4a-8f53-4c2c-825a-a9f2b522ea35 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:13.638325 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3982f4a-8f53-4c2c-825a-a9f2b522ea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:13.676129 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-f3982f4a-8f53-4c2c-825a-a9f2b522ea35 None None] MFA Rules not processed for user `f163d3e6c712494abb9527c42922763b`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:13.677363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f3982f4a-8f53-4c2c-825a-a9f2b522ea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:13.756691 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1055/2125] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:13 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:13.772997 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb00f1b-37f4-491b-90ff-0b8f33c07743 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:13.773574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb00f1b-37f4-491b-90ff-0b8f33c07743 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:13.773757 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb00f1b-37f4-491b-90ff-0b8f33c07743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:13.797283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-acb00f1b-37f4-491b-90ff-0b8f33c07743 None None] MFA Rules not processed for user `f163d3e6c712494abb9527c42922763b`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:13.797528 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-acb00f1b-37f4-491b-90ff-0b8f33c07743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:13.809510 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1071/2126] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:13 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:14.263100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3982f4a-8f53-4c2c-825a-a9f2b522ea35 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:14.264744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f3982f4a-8f53-4c2c-825a-a9f2b522ea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:14.364115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3982f4a-8f53-4c2c-825a-a9f2b522ea35 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:14.370139 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d07353-e30d-48a0-9592-4809c8b5b5bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:14.370830 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d07353-e30d-48a0-9592-4809c8b5b5bb service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:14.371114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d07353-e30d-48a0-9592-4809c8b5b5bb service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:14.371447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d07353-e30d-48a0-9592-4809c8b5b5bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:14.382363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d07353-e30d-48a0-9592-4809c8b5b5bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:14.384120 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d07353-e30d-48a0-9592-4809c8b5b5bb service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:14.396390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1056/2127] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:14 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:15.107605 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb00f1b-37f4-491b-90ff-0b8f33c07743 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:15.109973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-acb00f1b-37f4-491b-90ff-0b8f33c07743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:15.133145 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb00f1b-37f4-491b-90ff-0b8f33c07743 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:15.140630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a706f-f040-42c9-b664-bfc093cc0340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:15.142147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a706f-f040-42c9-b664-bfc093cc0340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:15.142501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a706f-f040-42c9-b664-bfc093cc0340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:15.142868 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a706f-f040-42c9-b664-bfc093cc0340 admin admin] PATH_INFO: `/v3/users/90d054c4d0304519a3d5998a8300c752` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:15.144224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a706f-f040-42c9-b664-bfc093cc0340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d054c4d0304519a3d5998a8300c752)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:15.146295 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a706f-f040-42c9-b664-bfc093cc0340 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:15.250923 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e45a706f-f040-42c9-b664-bfc093cc0340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d054c4d0304519a3d5998a8300c752'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:15.251956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e45a706f-f040-42c9-b664-bfc093cc0340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d054c4d0304519a3d5998a8300c752'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:15.268353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e45a706f-f040-42c9-b664-bfc093cc0340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d054c4d0304519a3d5998a8300c752'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:15.269173 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e45a706f-f040-42c9-b664-bfc093cc0340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d054c4d0304519a3d5998a8300c752'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:15.295020 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e45a706f-f040-42c9-b664-bfc093cc0340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d054c4d0304519a3d5998a8300c752'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:15.313135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1072/2128] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:15 2021] DELETE /identity/v3/users/90d054c4d0304519a3d5998a8300c752 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:15.316563 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae74b09-deff-4a8e-b828-52cf8b797db5 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:15.317036 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae74b09-deff-4a8e-b828-52cf8b797db5 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:15.317261 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae74b09-deff-4a8e-b828-52cf8b797db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:15.351350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8ae74b09-deff-4a8e-b828-52cf8b797db5 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:15.354898 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8ae74b09-deff-4a8e-b828-52cf8b797db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:15.505793 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1057/2129] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:15.515388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a706f-f040-42c9-b664-bfc093cc0340 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:15.518327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e45a706f-f040-42c9-b664-bfc093cc0340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:15.609409 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a706f-f040-42c9-b664-bfc093cc0340 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:15.615007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bb9fc-a85e-4b13-b9b5-d266fd2d56eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:15.615999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bb9fc-a85e-4b13-b9b5-d266fd2d56eb service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:15.616804 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bb9fc-a85e-4b13-b9b5-d266fd2d56eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:15.616804 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bb9fc-a85e-4b13-b9b5-d266fd2d56eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:15.632122 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bb9fc-a85e-4b13-b9b5-d266fd2d56eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:15.635052 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bb9fc-a85e-4b13-b9b5-d266fd2d56eb service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:15.649221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1073/2130] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:16.117747 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae74b09-deff-4a8e-b828-52cf8b797db5 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:16.119591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8ae74b09-deff-4a8e-b828-52cf8b797db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:16.132918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae74b09-deff-4a8e-b828-52cf8b797db5 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:16.138558 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:16.139961 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:16.140436 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:16.140903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] PATH_INFO: `/v3/projects/f49cc86001de432b9d35a70b03bc0799` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:16.142524 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f49cc86001de432b9d35a70b03bc0799)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:16.144688 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:16.206528 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f49cc86001de432b9d35a70b03bc0799', 'request_id': 'req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:16.214802 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f49cc86001de432b9d35a70b03bc0799', 'request_id': 'req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:16.230140 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f49cc86001de432b9d35a70b03bc0799', 'request_id': 'req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:16.255976 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] The token cache is being invalidate because project f49cc86001de432b9d35a70b03bc0799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:16.256272 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:16.259663 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:16.264185 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1058/2131] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:16 2021] DELETE /identity/v3/projects/f49cc86001de432b9d35a70b03bc0799 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:16.267974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bb9fc-a85e-4b13-b9b5-d266fd2d56eb service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:16.281806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bb9fc-a85e-4b13-b9b5-d266fd2d56eb service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:16.347774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e2030-a9d0-49cf-a61b-af5dd675b350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:16.348662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2030-a9d0-49cf-a61b-af5dd675b350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:16.348955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2030-a9d0-49cf-a61b-af5dd675b350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:16.349229 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2030-a9d0-49cf-a61b-af5dd675b350 admin admin] PATH_INFO: `/v3/users/a3fd6711a4164a57bc410c344e3540d7` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:16.350776 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e2030-a9d0-49cf-a61b-af5dd675b350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3fd6711a4164a57bc410c344e3540d7)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:16.352657 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e2030-a9d0-49cf-a61b-af5dd675b350 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:16.438072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-746e2030-a9d0-49cf-a61b-af5dd675b350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3fd6711a4164a57bc410c344e3540d7'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:16.438931 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-746e2030-a9d0-49cf-a61b-af5dd675b350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3fd6711a4164a57bc410c344e3540d7'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:16.448562 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-746e2030-a9d0-49cf-a61b-af5dd675b350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3fd6711a4164a57bc410c344e3540d7'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:16.449793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-746e2030-a9d0-49cf-a61b-af5dd675b350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3fd6711a4164a57bc410c344e3540d7'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:16.477497 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-746e2030-a9d0-49cf-a61b-af5dd675b350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3fd6711a4164a57bc410c344e3540d7'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:16.491271 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1074/2132] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:16 2021] DELETE /identity/v3/users/a3fd6711a4164a57bc410c344e3540d7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:02:16.913835 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:16.915619 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:16.949489 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df8fe6-1904-4b84-8a0b-84f3ebb25115 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:17.020976 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c92077-1e8c-44fc-bc19-a905657a9a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:17.021871 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c92077-1e8c-44fc-bc19-a905657a9a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:17.022181 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c92077-1e8c-44fc-bc19-a905657a9a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:17.022683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c92077-1e8c-44fc-bc19-a905657a9a97 admin admin] PATH_INFO: `/v3/projects/7fbd3601e64443d78aa3ec5e25b37c4f` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:17.023818 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c92077-1e8c-44fc-bc19-a905657a9a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fbd3601e64443d78aa3ec5e25b37c4f)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:17.025986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c92077-1e8c-44fc-bc19-a905657a9a97 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:17.080142 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-52c92077-1e8c-44fc-bc19-a905657a9a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fbd3601e64443d78aa3ec5e25b37c4f', 'request_id': 'req-52c92077-1e8c-44fc-bc19-a905657a9a97'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:17.090780 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-52c92077-1e8c-44fc-bc19-a905657a9a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fbd3601e64443d78aa3ec5e25b37c4f', 'request_id': 'req-52c92077-1e8c-44fc-bc19-a905657a9a97'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:17.096999 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-52c92077-1e8c-44fc-bc19-a905657a9a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fbd3601e64443d78aa3ec5e25b37c4f', 'request_id': 'req-52c92077-1e8c-44fc-bc19-a905657a9a97'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:17.110601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-52c92077-1e8c-44fc-bc19-a905657a9a97 admin admin] The token cache is being invalidate because project 7fbd3601e64443d78aa3ec5e25b37c4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:17.110890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-52c92077-1e8c-44fc-bc19-a905657a9a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:17.111980 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-52c92077-1e8c-44fc-bc19-a905657a9a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:17.113811 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1059/2133] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:16 2021] DELETE /identity/v3/projects/7fbd3601e64443d78aa3ec5e25b37c4f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:17.339977 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e2030-a9d0-49cf-a61b-af5dd675b350 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:17.342349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-746e2030-a9d0-49cf-a61b-af5dd675b350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:17.355857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e2030-a9d0-49cf-a61b-af5dd675b350 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:17.433269 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af494de-7415-48b2-85d3-cee20d9d0624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:17.434536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af494de-7415-48b2-85d3-cee20d9d0624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:17.434866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af494de-7415-48b2-85d3-cee20d9d0624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:17.435438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af494de-7415-48b2-85d3-cee20d9d0624 admin admin] PATH_INFO: `/v3/users/79f3a31c8fa04c90a98b41091d2dca9d` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:17.437232 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af494de-7415-48b2-85d3-cee20d9d0624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f3a31c8fa04c90a98b41091d2dca9d)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:17.440845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af494de-7415-48b2-85d3-cee20d9d0624 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:17.518770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6af494de-7415-48b2-85d3-cee20d9d0624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f3a31c8fa04c90a98b41091d2dca9d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:17.519462 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6af494de-7415-48b2-85d3-cee20d9d0624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f3a31c8fa04c90a98b41091d2dca9d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:17.530540 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6af494de-7415-48b2-85d3-cee20d9d0624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f3a31c8fa04c90a98b41091d2dca9d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:17.531861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6af494de-7415-48b2-85d3-cee20d9d0624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f3a31c8fa04c90a98b41091d2dca9d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:17.551846 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6af494de-7415-48b2-85d3-cee20d9d0624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f3a31c8fa04c90a98b41091d2dca9d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:17.564217 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1075/2134] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:17 2021] DELETE /identity/v3/users/79f3a31c8fa04c90a98b41091d2dca9d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:17.569693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04f75f-4585-4cda-bff8-ffadfacf668b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:17.570587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04f75f-4585-4cda-bff8-ffadfacf668b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:17.570698 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04f75f-4585-4cda-bff8-ffadfacf668b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:17.608224 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-4a04f75f-4585-4cda-bff8-ffadfacf668b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:17.610139 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-4a04f75f-4585-4cda-bff8-ffadfacf668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:17.687299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1060/2135] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:17.697137 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af494de-7415-48b2-85d3-cee20d9d0624 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:17.699732 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6af494de-7415-48b2-85d3-cee20d9d0624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:17.768441 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af494de-7415-48b2-85d3-cee20d9d0624 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:17.772729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb05f38-6d4e-4338-99fd-38970b023904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:17.773457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05f38-6d4e-4338-99fd-38970b023904 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:17.773778 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05f38-6d4e-4338-99fd-38970b023904 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:17.774053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05f38-6d4e-4338-99fd-38970b023904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:17.784861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb05f38-6d4e-4338-99fd-38970b023904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:17.786318 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb05f38-6d4e-4338-99fd-38970b023904 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:17.797674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1076/2136] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:18.763781 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04f75f-4585-4cda-bff8-ffadfacf668b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:18.766472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-4a04f75f-4585-4cda-bff8-ffadfacf668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:18.803268 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04f75f-4585-4cda-bff8-ffadfacf668b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:18.819808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1f25f-2126-4fd7-a824-c978b786390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:18.821243 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1f25f-2126-4fd7-a824-c978b786390b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:18.821554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1f25f-2126-4fd7-a824-c978b786390b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:18.821877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1f25f-2126-4fd7-a824-c978b786390b admin admin] PATH_INFO: `/v3/projects/3efd676d5db84440814ebe609832fc3e` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:18.823360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1f25f-2126-4fd7-a824-c978b786390b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efd676d5db84440814ebe609832fc3e)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:18.826869 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1f25f-2126-4fd7-a824-c978b786390b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:18.884012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5cf1f25f-2126-4fd7-a824-c978b786390b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efd676d5db84440814ebe609832fc3e', 'request_id': 'req-5cf1f25f-2126-4fd7-a824-c978b786390b'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:18.891008 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5cf1f25f-2126-4fd7-a824-c978b786390b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efd676d5db84440814ebe609832fc3e', 'request_id': 'req-5cf1f25f-2126-4fd7-a824-c978b786390b'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:18.896617 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5cf1f25f-2126-4fd7-a824-c978b786390b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efd676d5db84440814ebe609832fc3e', 'request_id': 'req-5cf1f25f-2126-4fd7-a824-c978b786390b'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:18.909136 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5cf1f25f-2126-4fd7-a824-c978b786390b admin admin] The token cache is being invalidate because project 3efd676d5db84440814ebe609832fc3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:18.909867 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5cf1f25f-2126-4fd7-a824-c978b786390b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:18.910056 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5cf1f25f-2126-4fd7-a824-c978b786390b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:18.911883 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1061/2137] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:18 2021] DELETE /identity/v3/projects/3efd676d5db84440814ebe609832fc3e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:31.564908 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f472207-7695-4bf5-9d0d-f66436c6ed15 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:31.565437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f472207-7695-4bf5-9d0d-f66436c6ed15 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:31.565437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f472207-7695-4bf5-9d0d-f66436c6ed15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:31.584880 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-7f472207-7695-4bf5-9d0d-f66436c6ed15 None None] MFA Rules not processed for user `10c03ea3efc0409b9df725a7f9e19b42`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:31.586103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7f472207-7695-4bf5-9d0d-f66436c6ed15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:31.645738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1077/2138] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:31 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:02:38.235233 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45946493-cce5-4a64-a411-56c5a1f85c80 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:38.235747 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45946493-cce5-4a64-a411-56c5a1f85c80 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:38.235895 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45946493-cce5-4a64-a411-56c5a1f85c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:38.256889 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-45946493-cce5-4a64-a411-56c5a1f85c80 None None] MFA Rules not processed for user `f163d3e6c712494abb9527c42922763b`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:38.258250 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-45946493-cce5-4a64-a411-56c5a1f85c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:38.318152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1062/2139] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:38 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:48.205241 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f472207-7695-4bf5-9d0d-f66436c6ed15 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:48.206787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7f472207-7695-4bf5-9d0d-f66436c6ed15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:48.274091 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f472207-7695-4bf5-9d0d-f66436c6ed15 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:48.279213 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c990edc-a3f8-4770-9a59-5d458237f1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:48.280083 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c990edc-a3f8-4770-9a59-5d458237f1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:48.280364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c990edc-a3f8-4770-9a59-5d458237f1da admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:48.280636 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c990edc-a3f8-4770-9a59-5d458237f1da admin admin] PATH_INFO: `/v3/users/b746139131424a7a874e60e14c07325a` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:48.281869 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c990edc-a3f8-4770-9a59-5d458237f1da admin admin] RBAC: Authorizing `identity:delete_user(user_id=b746139131424a7a874e60e14c07325a)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:48.283860 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c990edc-a3f8-4770-9a59-5d458237f1da admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:48.330528 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-0c990edc-a3f8-4770-9a59-5d458237f1da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b746139131424a7a874e60e14c07325a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:48.331265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-0c990edc-a3f8-4770-9a59-5d458237f1da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b746139131424a7a874e60e14c07325a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:48.339075 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-0c990edc-a3f8-4770-9a59-5d458237f1da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b746139131424a7a874e60e14c07325a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:48.339848 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-0c990edc-a3f8-4770-9a59-5d458237f1da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b746139131424a7a874e60e14c07325a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:48.353409 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-0c990edc-a3f8-4770-9a59-5d458237f1da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b746139131424a7a874e60e14c07325a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:48.369066 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1078/2140] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:02:48 2021] DELETE /identity/v3/users/b746139131424a7a874e60e14c07325a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:48.373685 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29d3ba-8b17-4efb-8c13-dd017bb386eb None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:48.374066 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29d3ba-8b17-4efb-8c13-dd017bb386eb None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:48.374276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29d3ba-8b17-4efb-8c13-dd017bb386eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:48.393015 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-bd29d3ba-8b17-4efb-8c13-dd017bb386eb None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:48.394462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-bd29d3ba-8b17-4efb-8c13-dd017bb386eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:48.457100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1063/2141] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:48.470476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c990edc-a3f8-4770-9a59-5d458237f1da admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:48.472392 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0c990edc-a3f8-4770-9a59-5d458237f1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:48.548260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c990edc-a3f8-4770-9a59-5d458237f1da admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:48.553682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c48aa-6b0a-4772-9943-20bb28612d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:48.554480 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c48aa-6b0a-4772-9943-20bb28612d45 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:48.555013 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c48aa-6b0a-4772-9943-20bb28612d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:48.555414 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c48aa-6b0a-4772-9943-20bb28612d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:48.567037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c48aa-6b0a-4772-9943-20bb28612d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:48.568599 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c48aa-6b0a-4772-9943-20bb28612d45 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:48.580828 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1079/2142] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:48.869722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29d3ba-8b17-4efb-8c13-dd017bb386eb None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:48.872116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-bd29d3ba-8b17-4efb-8c13-dd017bb386eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:48.884718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29d3ba-8b17-4efb-8c13-dd017bb386eb None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:48.890230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cfef3-345c-4578-97db-2972f8887cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:48.891154 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cfef3-345c-4578-97db-2972f8887cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:48.891429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cfef3-345c-4578-97db-2972f8887cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:48.891704 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cfef3-345c-4578-97db-2972f8887cb4 admin admin] PATH_INFO: `/v3/projects/f1db85b3058641de87a3b6f0d13fd935` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:48.892951 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cfef3-345c-4578-97db-2972f8887cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1db85b3058641de87a3b6f0d13fd935)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:48.894887 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cfef3-345c-4578-97db-2972f8887cb4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:48.943761 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-426cfef3-345c-4578-97db-2972f8887cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1db85b3058641de87a3b6f0d13fd935', 'request_id': 'req-426cfef3-345c-4578-97db-2972f8887cb4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:48.950086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-426cfef3-345c-4578-97db-2972f8887cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1db85b3058641de87a3b6f0d13fd935', 'request_id': 'req-426cfef3-345c-4578-97db-2972f8887cb4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:48.955576 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-426cfef3-345c-4578-97db-2972f8887cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1db85b3058641de87a3b6f0d13fd935', 'request_id': 'req-426cfef3-345c-4578-97db-2972f8887cb4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:48.968836 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-426cfef3-345c-4578-97db-2972f8887cb4 admin admin] The token cache is being invalidate because project f1db85b3058641de87a3b6f0d13fd935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:02:48.969091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-426cfef3-345c-4578-97db-2972f8887cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:48.969711 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-426cfef3-345c-4578-97db-2972f8887cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:02:48.971313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1064/2143] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:02:48 2021] DELETE /identity/v3/projects/f1db85b3058641de87a3b6f0d13fd935 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:02:48.977236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ef84a-0d66-4b72-bd5f-e971ff60210f None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:48.977516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ef84a-0d66-4b72-bd5f-e971ff60210f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:48.977788 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ef84a-0d66-4b72-bd5f-e971ff60210f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:49.000485 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-9e0ef84a-0d66-4b72-bd5f-e971ff60210f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:49.002128 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9e0ef84a-0d66-4b72-bd5f-e971ff60210f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:49.078651 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1080/2144] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:49.087221 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a3fd9-26ca-4e53-86fb-f433fffdad62 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:49.087818 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a3fd9-26ca-4e53-86fb-f433fffdad62 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:49.088279 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a3fd9-26ca-4e53-86fb-f433fffdad62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:49.107658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-fe7a3fd9-26ca-4e53-86fb-f433fffdad62 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:49.108991 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-fe7a3fd9-26ca-4e53-86fb-f433fffdad62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:49.116971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1065/2145] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:49.121612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ef84a-0d66-4b72-bd5f-e971ff60210f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:49.131563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ef84a-0d66-4b72-bd5f-e971ff60210f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:49.136651 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e7bc0-9b3f-436a-927c-c43ad157b4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:49.137701 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e7bc0-9b3f-436a-927c-c43ad157b4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:49.137978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e7bc0-9b3f-436a-927c-c43ad157b4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:49.138246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e7bc0-9b3f-436a-927c-c43ad157b4c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:49.138999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e7bc0-9b3f-436a-927c-c43ad157b4c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:02:49.139337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e7bc0-9b3f-436a-927c-c43ad157b4c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:49.140961 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e7bc0-9b3f-436a-927c-c43ad157b4c4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:49.154456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1081/2146] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:02:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:02:49.159012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a3fd9-26ca-4e53-86fb-f433fffdad62 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:49.169348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a3fd9-26ca-4e53-86fb-f433fffdad62 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:49.174139 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af8bb5-9d1c-468f-8608-1d8815b9ca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:49.174825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af8bb5-9d1c-468f-8608-1d8815b9ca4f admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:49.175149 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af8bb5-9d1c-468f-8608-1d8815b9ca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:49.175406 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af8bb5-9d1c-468f-8608-1d8815b9ca4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:49.176121 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af8bb5-9d1c-468f-8608-1d8815b9ca4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:49.178054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af8bb5-9d1c-468f-8608-1d8815b9ca4f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:49.206474 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1066/2147] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:02:49 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:49.211592 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e7bc0-9b3f-436a-927c-c43ad157b4c4 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:49.223705 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e7bc0-9b3f-436a-927c-c43ad157b4c4 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:49.284471 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f12120-d555-4763-a245-5ca64c7da87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:49.285207 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12120-d555-4763-a245-5ca64c7da87b admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:49.285447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12120-d555-4763-a245-5ca64c7da87b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:49.285703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12120-d555-4763-a245-5ca64c7da87b admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:49.286442 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f12120-d555-4763-a245-5ca64c7da87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:49.288402 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f12120-d555-4763-a245-5ca64c7da87b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:49.313532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1082/2148] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:02:49 2021] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:02:49.317828 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af8bb5-9d1c-468f-8608-1d8815b9ca4f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:49.328874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af8bb5-9d1c-468f-8608-1d8815b9ca4f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:49.334053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c0138-cfa6-40ac-a72b-1afdc584d87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:49.334736 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c0138-cfa6-40ac-a72b-1afdc584d87a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:49.335014 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c0138-cfa6-40ac-a72b-1afdc584d87a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:49.335316 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c0138-cfa6-40ac-a72b-1afdc584d87a admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:49.336057 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c0138-cfa6-40ac-a72b-1afdc584d87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:49.337845 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c0138-cfa6-40ac-a72b-1afdc584d87a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:49.348956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1067/2149] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:49.353057 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f12120-d555-4763-a245-5ca64c7da87b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:49.363078 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f12120-d555-4763-a245-5ca64c7da87b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:49.367988 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db133ca-feda-4c31-a13e-69c933890f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:49.369270 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db133ca-feda-4c31-a13e-69c933890f1b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:49.369270 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db133ca-feda-4c31-a13e-69c933890f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:49.369270 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db133ca-feda-4c31-a13e-69c933890f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:49.369994 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db133ca-feda-4c31-a13e-69c933890f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:49.371662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db133ca-feda-4c31-a13e-69c933890f1b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:49.382126 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1083/2150] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:02:49 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:02:49.387569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c0138-cfa6-40ac-a72b-1afdc584d87a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:49.397807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c0138-cfa6-40ac-a72b-1afdc584d87a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:49.402898 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f71f-10fe-4410-8ab1-6397ccb7779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:49.403821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f71f-10fe-4410-8ab1-6397ccb7779a admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:49.404100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f71f-10fe-4410-8ab1-6397ccb7779a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:49.404363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f71f-10fe-4410-8ab1-6397ccb7779a admin admin] PATH_INFO: `/v3/projects/7f7ffc6f553b4b428ef6b753c522b13b/users/d499414c037d4d239f72606da43b3457/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:49.420110 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29f71f-10fe-4410-8ab1-6397ccb7779a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7ffc6f553b4b428ef6b753c522b13b, user_id=d499414c037d4d239f72606da43b3457, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:49.422766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29f71f-10fe-4410-8ab1-6397ccb7779a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:49.437490 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1068/2151] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:02:49 2021] PUT /identity/v3/projects/7f7ffc6f553b4b428ef6b753c522b13b/users/d499414c037d4d239f72606da43b3457/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:02:49.448287 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e10e83-2b3b-4ba0-8331-df482e141576 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:49.448667 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e10e83-2b3b-4ba0-8331-df482e141576 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:49.449042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e10e83-2b3b-4ba0-8331-df482e141576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:49.478461 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-d0e10e83-2b3b-4ba0-8331-df482e141576 None None] MFA Rules not processed for user `d499414c037d4d239f72606da43b3457`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:49.480002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d0e10e83-2b3b-4ba0-8331-df482e141576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:49.551898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1084/2152] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:02:49 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:49.562126 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f71f-10fe-4410-8ab1-6397ccb7779a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:49.563934 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6f29f71f-10fe-4410-8ab1-6397ccb7779a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:49.624755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f71f-10fe-4410-8ab1-6397ccb7779a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:49.628975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685fd6b-34f5-43e7-917e-62132747bb70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:49.629628 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685fd6b-34f5-43e7-917e-62132747bb70 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:49.629906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685fd6b-34f5-43e7-917e-62132747bb70 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:49.630178 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685fd6b-34f5-43e7-917e-62132747bb70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:49.640001 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685fd6b-34f5-43e7-917e-62132747bb70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:49.641461 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685fd6b-34f5-43e7-917e-62132747bb70 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:49.651087 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1069/2153] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:02:49 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:02:58.338991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e6753-d28d-41df-bd0f-a10fd923a690 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:58.339541 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e6753-d28d-41df-bd0f-a10fd923a690 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:58.339623 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e6753-d28d-41df-bd0f-a10fd923a690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:58.357795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-ab3e6753-d28d-41df-bd0f-a10fd923a690 None None] MFA Rules not processed for user `f9fc539f38364a648b9a4c25d3dbea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:02:58.358988 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ab3e6753-d28d-41df-bd0f-a10fd923a690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:58.414413 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1085/2154] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Nov 8 11:02:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:02:58.457725 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685fd6b-34f5-43e7-917e-62132747bb70 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:02:58.459279 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d685fd6b-34f5-43e7-917e-62132747bb70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:02:58.534012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685fd6b-34f5-43e7-917e-62132747bb70 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:02:58.547850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bd242-dc74-45ce-86a1-eb0d574eb921 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '029506cc966a44c9bbe83eb084ac6feb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:02:58.548529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bd242-dc74-45ce-86a1-eb0d574eb921 service swift] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:02:58.548807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bd242-dc74-45ce-86a1-eb0d574eb921 service swift] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:02:58.549080 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bd242-dc74-45ce-86a1-eb0d574eb921 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:02:58.559610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bd242-dc74-45ce-86a1-eb0d574eb921 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:02:58.561667 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bd242-dc74-45ce-86a1-eb0d574eb921 service swift] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:02:58.571015 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1070/2155] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Nov 8 11:02:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 11:03:00.829711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036f1c-f593-4e45-92ff-974166b8fbbb None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:00.830402 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036f1c-f593-4e45-92ff-974166b8fbbb None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:00.830511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036f1c-f593-4e45-92ff-974166b8fbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:00.852974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-e8036f1c-f593-4e45-92ff-974166b8fbbb None None] MFA Rules not processed for user `f163d3e6c712494abb9527c42922763b`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:03:00.854617 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e8036f1c-f593-4e45-92ff-974166b8fbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:00.902617 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bd242-dc74-45ce-86a1-eb0d574eb921 service swift] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:00.926758 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1086/2156] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:03:00 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:03:01.031810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bd242-dc74-45ce-86a1-eb0d574eb921 service swift] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:01.040567 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc3221-8489-4a05-b7f9-af07b4d71775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:01.041683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc3221-8489-4a05-b7f9-af07b4d71775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:01.042093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc3221-8489-4a05-b7f9-af07b4d71775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:01.042537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc3221-8489-4a05-b7f9-af07b4d71775 admin admin] PATH_INFO: `/v3/users/d499414c037d4d239f72606da43b3457` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:01.045015 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc3221-8489-4a05-b7f9-af07b4d71775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d499414c037d4d239f72606da43b3457)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:01.047211 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc3221-8489-4a05-b7f9-af07b4d71775 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:01.275301 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-41dc3221-8489-4a05-b7f9-af07b4d71775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd499414c037d4d239f72606da43b3457'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:01.276315 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-41dc3221-8489-4a05-b7f9-af07b4d71775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd499414c037d4d239f72606da43b3457'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:01.307877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-41dc3221-8489-4a05-b7f9-af07b4d71775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd499414c037d4d239f72606da43b3457'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:01.308886 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-41dc3221-8489-4a05-b7f9-af07b4d71775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd499414c037d4d239f72606da43b3457'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:01.323295 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-41dc3221-8489-4a05-b7f9-af07b4d71775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd499414c037d4d239f72606da43b3457'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:01.357853 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1071/2157] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:03:00 2021] DELETE /identity/v3/users/d499414c037d4d239f72606da43b3457 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:03:01.360237 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb26b7-150b-4ddf-a8ef-cf7ee92457a1 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:01.360558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb26b7-150b-4ddf-a8ef-cf7ee92457a1 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:01.360964 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb26b7-150b-4ddf-a8ef-cf7ee92457a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:01.386757 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-b8fb26b7-150b-4ddf-a8ef-cf7ee92457a1 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:03:01.389132 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b8fb26b7-150b-4ddf-a8ef-cf7ee92457a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:01.563960 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1087/2158] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:03:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:03:01.565046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc3221-8489-4a05-b7f9-af07b4d71775 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:01.567033 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-41dc3221-8489-4a05-b7f9-af07b4d71775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:01.664879 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc3221-8489-4a05-b7f9-af07b4d71775 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:01.670089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a755a11-f9de-492d-8341-d8b74e30ac42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:01.670899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a755a11-f9de-492d-8341-d8b74e30ac42 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:01.671749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a755a11-f9de-492d-8341-d8b74e30ac42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:01.671749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a755a11-f9de-492d-8341-d8b74e30ac42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:01.685262 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a755a11-f9de-492d-8341-d8b74e30ac42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:01.686750 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a755a11-f9de-492d-8341-d8b74e30ac42 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:01.723968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1072/2159] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:03:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:03:02.103185 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb26b7-150b-4ddf-a8ef-cf7ee92457a1 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:02.105861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b8fb26b7-150b-4ddf-a8ef-cf7ee92457a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:02.123828 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb26b7-150b-4ddf-a8ef-cf7ee92457a1 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:02.130018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b534032-7859-44b0-9de5-58e8a3f1fc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:02.131193 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534032-7859-44b0-9de5-58e8a3f1fc5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:02.131668 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534032-7859-44b0-9de5-58e8a3f1fc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:02.131950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534032-7859-44b0-9de5-58e8a3f1fc5f admin admin] PATH_INFO: `/v3/projects/7f7ffc6f553b4b428ef6b753c522b13b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:02.133501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b534032-7859-44b0-9de5-58e8a3f1fc5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7ffc6f553b4b428ef6b753c522b13b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:02.136730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b534032-7859-44b0-9de5-58e8a3f1fc5f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:02.206612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6b534032-7859-44b0-9de5-58e8a3f1fc5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7ffc6f553b4b428ef6b753c522b13b', 'request_id': 'req-6b534032-7859-44b0-9de5-58e8a3f1fc5f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:02.221195 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6b534032-7859-44b0-9de5-58e8a3f1fc5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7ffc6f553b4b428ef6b753c522b13b', 'request_id': 'req-6b534032-7859-44b0-9de5-58e8a3f1fc5f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:02.229417 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6b534032-7859-44b0-9de5-58e8a3f1fc5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7ffc6f553b4b428ef6b753c522b13b', 'request_id': 'req-6b534032-7859-44b0-9de5-58e8a3f1fc5f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:02.255674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6b534032-7859-44b0-9de5-58e8a3f1fc5f admin admin] The token cache is being invalidate because project 7f7ffc6f553b4b428ef6b753c522b13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:03:02.256209 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6b534032-7859-44b0-9de5-58e8a3f1fc5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:02.260724 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6b534032-7859-44b0-9de5-58e8a3f1fc5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:02.263336 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1088/2160] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:03:02 2021] DELETE /identity/v3/projects/7f7ffc6f553b4b428ef6b753c522b13b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:03:17.482950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115d3b8-72a6-4584-9a62-80b12495b72e None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:17.483665 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115d3b8-72a6-4584-9a62-80b12495b72e None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:17.483665 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115d3b8-72a6-4584-9a62-80b12495b72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:17.511760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-4115d3b8-72a6-4584-9a62-80b12495b72e None None] MFA Rules not processed for user `f9fc539f38364a648b9a4c25d3dbea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:03:17.515288 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-4115d3b8-72a6-4584-9a62-80b12495b72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:17.580134 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f7d83-9278-4be3-a4ff-81b37f4647b6 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:17.580702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f7d83-9278-4be3-a4ff-81b37f4647b6 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:17.580702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f7d83-9278-4be3-a4ff-81b37f4647b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:17.595106 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1073/2161] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Nov 8 11:03:17 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:03:17.607920 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-c65f7d83-9278-4be3-a4ff-81b37f4647b6 None None] MFA Rules not processed for user `f9fc539f38364a648b9a4c25d3dbea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:03:17.609174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c65f7d83-9278-4be3-a4ff-81b37f4647b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:17.611451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115d3b8-72a6-4584-9a62-80b12495b72e None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:17.614187 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-4115d3b8-72a6-4584-9a62-80b12495b72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:17.619037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1089/2162] 10.222.0.20 () {58 vars in 967 bytes} [Mon Nov 8 11:03:17 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:03:17.646010 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f7d83-9278-4be3-a4ff-81b37f4647b6 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:17.647469 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c65f7d83-9278-4be3-a4ff-81b37f4647b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:17.734125 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115d3b8-72a6-4584-9a62-80b12495b72e None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:17.743137 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87377f9c-a4f0-4c4a-9e37-451ac5b9f3ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '029506cc966a44c9bbe83eb084ac6feb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:17.744310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87377f9c-a4f0-4c4a-9e37-451ac5b9f3ab service swift] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:17.744798 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87377f9c-a4f0-4c4a-9e37-451ac5b9f3ab service swift] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:17.745296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87377f9c-a4f0-4c4a-9e37-451ac5b9f3ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:17.750183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f7d83-9278-4be3-a4ff-81b37f4647b6 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:17.758207 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed01344-1b38-46ca-b69c-a68238b5adc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '029506cc966a44c9bbe83eb084ac6feb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:17.759777 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed01344-1b38-46ca-b69c-a68238b5adc4 service swift] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:17.760281 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed01344-1b38-46ca-b69c-a68238b5adc4 service swift] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:17.760627 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed01344-1b38-46ca-b69c-a68238b5adc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:17.762261 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87377f9c-a4f0-4c4a-9e37-451ac5b9f3ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:17.765778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87377f9c-a4f0-4c4a-9e37-451ac5b9f3ab service swift] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:17.771991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed01344-1b38-46ca-b69c-a68238b5adc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:17.775134 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed01344-1b38-46ca-b69c-a68238b5adc4 service swift] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:17.783589 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1074/2163] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Nov 8 11:03:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 11:03:17.786453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1090/2164] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Nov 8 11:03:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 11:03:20.282110 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87377f9c-a4f0-4c4a-9e37-451ac5b9f3ab service swift] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:20.284450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-87377f9c-a4f0-4c4a-9e37-451ac5b9f3ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:20.373850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87377f9c-a4f0-4c4a-9e37-451ac5b9f3ab service swift] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:20.378725 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e817452-9f50-4eb5-9184-20e7bfa435c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:20.379714 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e817452-9f50-4eb5-9184-20e7bfa435c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:20.379996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e817452-9f50-4eb5-9184-20e7bfa435c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:20.380314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e817452-9f50-4eb5-9184-20e7bfa435c7 admin admin] PATH_INFO: `/v3/users/10c03ea3efc0409b9df725a7f9e19b42` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:20.381649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e817452-9f50-4eb5-9184-20e7bfa435c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c03ea3efc0409b9df725a7f9e19b42)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:20.384242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e817452-9f50-4eb5-9184-20e7bfa435c7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:20.489125 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0e817452-9f50-4eb5-9184-20e7bfa435c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c03ea3efc0409b9df725a7f9e19b42'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:20.495555 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0e817452-9f50-4eb5-9184-20e7bfa435c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c03ea3efc0409b9df725a7f9e19b42'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:20.542009 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0e817452-9f50-4eb5-9184-20e7bfa435c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c03ea3efc0409b9df725a7f9e19b42'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:20.542852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0e817452-9f50-4eb5-9184-20e7bfa435c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c03ea3efc0409b9df725a7f9e19b42'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:20.559858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0e817452-9f50-4eb5-9184-20e7bfa435c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c03ea3efc0409b9df725a7f9e19b42'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:20.619081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1075/2165] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:03:20 2021] DELETE /identity/v3/users/10c03ea3efc0409b9df725a7f9e19b42 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:03:20.913607 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed01344-1b38-46ca-b69c-a68238b5adc4 service swift] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:20.925094 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed01344-1b38-46ca-b69c-a68238b5adc4 service swift] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:21.012964 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:21.013849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:21.014136 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:21.014403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5 admin admin] PATH_INFO: `/v3/projects/9a9af6bfe3c74fb99cd38a50c1d44960` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:21.018991 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9af6bfe3c74fb99cd38a50c1d44960)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:21.020959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:21.082893 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9af6bfe3c74fb99cd38a50c1d44960', 'request_id': 'req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:21.090783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9af6bfe3c74fb99cd38a50c1d44960', 'request_id': 'req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:21.097092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9af6bfe3c74fb99cd38a50c1d44960', 'request_id': 'req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:21.112975 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5 admin admin] The token cache is being invalidate because project 9a9af6bfe3c74fb99cd38a50c1d44960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:03:21.113313 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:21.113966 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f797e6d4-b5aa-4e83-aa16-e87ada6962a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:03:21.116047 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1091/2166] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:03:20 2021] DELETE /identity/v3/projects/9a9af6bfe3c74fb99cd38a50c1d44960 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:03:21.122194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4de96d-09ab-48ad-9544-589a821ecac9 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:21.122481 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4de96d-09ab-48ad-9544-589a821ecac9 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:21.122757 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4de96d-09ab-48ad-9544-589a821ecac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:21.143852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-1d4de96d-09ab-48ad-9544-589a821ecac9 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:03:21.145090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1d4de96d-09ab-48ad-9544-589a821ecac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:21.225060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1076/2167] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:03:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:03:21.233590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b80864-0455-4c58-b72d-9a37537f1617 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:21.234128 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b80864-0455-4c58-b72d-9a37537f1617 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:21.234590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b80864-0455-4c58-b72d-9a37537f1617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:21.253867 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-97b80864-0455-4c58-b72d-9a37537f1617 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:03:21.255294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-97b80864-0455-4c58-b72d-9a37537f1617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:21.264908 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1092/2168] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:03:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:03:21.268833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4de96d-09ab-48ad-9544-589a821ecac9 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:21.278850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4de96d-09ab-48ad-9544-589a821ecac9 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:21.283760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea905e-597c-48ca-8059-4f5bfe8684a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:21.284428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea905e-597c-48ca-8059-4f5bfe8684a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:21.284702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea905e-597c-48ca-8059-4f5bfe8684a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:21.284973 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea905e-597c-48ca-8059-4f5bfe8684a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:21.285721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea905e-597c-48ca-8059-4f5bfe8684a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:03:21.286027 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea905e-597c-48ca-8059-4f5bfe8684a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:21.287697 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea905e-597c-48ca-8059-4f5bfe8684a5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:21.303533 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1077/2169] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:03:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:03:21.304563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b80864-0455-4c58-b72d-9a37537f1617 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:21.315600 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b80864-0455-4c58-b72d-9a37537f1617 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:21.324965 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb5273-ad40-4d61-ba66-b40d19867a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:21.325724 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb5273-ad40-4d61-ba66-b40d19867a1e admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:21.326070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb5273-ad40-4d61-ba66-b40d19867a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:21.326414 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb5273-ad40-4d61-ba66-b40d19867a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:21.327263 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb5273-ad40-4d61-ba66-b40d19867a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:21.329318 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb5273-ad40-4d61-ba66-b40d19867a1e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:21.367987 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1093/2170] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:03:21 2021] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:03:21.368982 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea905e-597c-48ca-8059-4f5bfe8684a5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:21.381389 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea905e-597c-48ca-8059-4f5bfe8684a5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:21.453685 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f6c98-8c5e-4b89-bd0b-a101cafe006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:21.454899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6c98-8c5e-4b89-bd0b-a101cafe006f admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:21.456047 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6c98-8c5e-4b89-bd0b-a101cafe006f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:21.457482 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6c98-8c5e-4b89-bd0b-a101cafe006f admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:21.459313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f6c98-8c5e-4b89-bd0b-a101cafe006f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:21.462099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f6c98-8c5e-4b89-bd0b-a101cafe006f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:21.496829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1078/2171] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:03:21 2021] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:03:21.501853 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb5273-ad40-4d61-ba66-b40d19867a1e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:21.534534 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb5273-ad40-4d61-ba66-b40d19867a1e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:21.548358 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f440193-d42d-4138-b38a-a04dfe1de1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:21.549628 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440193-d42d-4138-b38a-a04dfe1de1cd admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:21.550042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440193-d42d-4138-b38a-a04dfe1de1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:21.550557 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440193-d42d-4138-b38a-a04dfe1de1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:21.551867 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f440193-d42d-4138-b38a-a04dfe1de1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:21.555582 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f440193-d42d-4138-b38a-a04dfe1de1cd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:21.577252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1094/2172] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:03:21 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:03:21.581807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f6c98-8c5e-4b89-bd0b-a101cafe006f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:21.598686 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f6c98-8c5e-4b89-bd0b-a101cafe006f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:21.603838 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53513c-e0f6-4667-ae4e-25e001a82e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:21.604625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53513c-e0f6-4667-ae4e-25e001a82e00 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:21.604912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53513c-e0f6-4667-ae4e-25e001a82e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:21.605184 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53513c-e0f6-4667-ae4e-25e001a82e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:21.605935 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53513c-e0f6-4667-ae4e-25e001a82e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:21.607589 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53513c-e0f6-4667-ae4e-25e001a82e00 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:21.627469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1079/2173] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:03:21 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:03:21.628770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f440193-d42d-4138-b38a-a04dfe1de1cd admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:21.641223 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f440193-d42d-4138-b38a-a04dfe1de1cd admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:21.654506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007e409-bd5e-44bc-96d0-cdc0e8341398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:21.655451 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007e409-bd5e-44bc-96d0-cdc0e8341398 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:21.655889 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007e409-bd5e-44bc-96d0-cdc0e8341398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:21.656187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007e409-bd5e-44bc-96d0-cdc0e8341398 admin admin] PATH_INFO: `/v3/projects/1cdbc9d0ca85418cbf8cdf6ff34e8cd0/users/2e336e1a35de4e5780c3c460d9a4ddd0/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:21.677983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007e409-bd5e-44bc-96d0-cdc0e8341398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cdbc9d0ca85418cbf8cdf6ff34e8cd0, user_id=2e336e1a35de4e5780c3c460d9a4ddd0, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:21.680881 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007e409-bd5e-44bc-96d0-cdc0e8341398 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:21.705343 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1095/2174] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:03:21 2021] PUT /identity/v3/projects/1cdbc9d0ca85418cbf8cdf6ff34e8cd0/users/2e336e1a35de4e5780c3c460d9a4ddd0/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:03:21.711910 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dcd9b-9a49-4afc-8323-0f7a50b394cc None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:21.711910 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dcd9b-9a49-4afc-8323-0f7a50b394cc None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:21.711910 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dcd9b-9a49-4afc-8323-0f7a50b394cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:21.737976 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-b34dcd9b-9a49-4afc-8323-0f7a50b394cc None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:03:21.739239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b34dcd9b-9a49-4afc-8323-0f7a50b394cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:21.826533 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1080/2175] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:03:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:03:21.837908 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007e409-bd5e-44bc-96d0-cdc0e8341398 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:21.839778 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9007e409-bd5e-44bc-96d0-cdc0e8341398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:21.912565 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007e409-bd5e-44bc-96d0-cdc0e8341398 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:21.917532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0075b96-9696-4ce8-84f3-fb5d88641f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:21.919283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0075b96-9696-4ce8-84f3-fb5d88641f81 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:21.919760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0075b96-9696-4ce8-84f3-fb5d88641f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:21.920354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0075b96-9696-4ce8-84f3-fb5d88641f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:21.931304 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0075b96-9696-4ce8-84f3-fb5d88641f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:21.932893 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0075b96-9696-4ce8-84f3-fb5d88641f81 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:21.944539 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1096/2176] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:03:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:03:22.860457 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d816f-d95f-47a5-8c76-ed134ad13bb9 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:22.861350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d816f-d95f-47a5-8c76-ed134ad13bb9 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:22.861798 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d816f-d95f-47a5-8c76-ed134ad13bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:22.900807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-249d816f-d95f-47a5-8c76-ed134ad13bb9 None None] MFA Rules not processed for user `2e336e1a35de4e5780c3c460d9a4ddd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:03:22.902108 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-249d816f-d95f-47a5-8c76-ed134ad13bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:22.984971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1081/2177] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:03:22 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:03:22.995555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0075b96-9696-4ce8-84f3-fb5d88641f81 service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:22.997668 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e0075b96-9696-4ce8-84f3-fb5d88641f81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:23.093072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0075b96-9696-4ce8-84f3-fb5d88641f81 service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:23.099684 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ab28b-60e0-4b91-a50e-732dac8e799c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:23.100743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab28b-60e0-4b91-a50e-732dac8e799c service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:23.101251 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab28b-60e0-4b91-a50e-732dac8e799c service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:23.101718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab28b-60e0-4b91-a50e-732dac8e799c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:23.114040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ab28b-60e0-4b91-a50e-732dac8e799c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:23.115990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ab28b-60e0-4b91-a50e-732dac8e799c service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:23.144135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1097/2178] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:03:22 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:03:24.654773 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead3cd7-0fc2-470c-8b01-569cd6f94898 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:24.659465 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead3cd7-0fc2-470c-8b01-569cd6f94898 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:24.660405 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead3cd7-0fc2-470c-8b01-569cd6f94898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:24.710715 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-3ead3cd7-0fc2-470c-8b01-569cd6f94898 None None] MFA Rules not processed for user `2e336e1a35de4e5780c3c460d9a4ddd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:03:24.712181 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3ead3cd7-0fc2-470c-8b01-569cd6f94898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:24.743898 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1082/2179] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:03:24 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:03:33.397445 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4de82-8f41-4431-a71d-ea5202b5cba8 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:33.397969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4de82-8f41-4431-a71d-ea5202b5cba8 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:33.398046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4de82-8f41-4431-a71d-ea5202b5cba8 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:33.400322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1098/2180] 10.222.0.20 () {54 vars in 921 bytes} [Mon Nov 8 11:03:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 11:03:33.410465 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2de8e-87f5-45f5-bb7d-3063df175751 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:33.410996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2de8e-87f5-45f5-bb7d-3063df175751 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:33.410996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2de8e-87f5-45f5-bb7d-3063df175751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:33.441301 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-77f2de8e-87f5-45f5-bb7d-3063df175751 None None] MFA Rules not processed for user `d3421cf1bbb24423a2f24c4667adfdda`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:03:33.444049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-77f2de8e-87f5-45f5-bb7d-3063df175751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:33.564544 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d895544-89d7-44d6-a2a6-a06532fda647 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:33.571290 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d895544-89d7-44d6-a2a6-a06532fda647 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:33.571290 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d895544-89d7-44d6-a2a6-a06532fda647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:33.588692 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-4d895544-89d7-44d6-a2a6-a06532fda647 None None] MFA Rules not processed for user `f163d3e6c712494abb9527c42922763b`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:03:33.590082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4d895544-89d7-44d6-a2a6-a06532fda647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:33.613635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1083/2181] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Nov 8 11:03:33 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:03:33.631414 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2de8e-87f5-45f5-bb7d-3063df175751 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:33.633954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-77f2de8e-87f5-45f5-bb7d-3063df175751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:33.671543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1099/2182] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:03:33 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:03:33.715479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2de8e-87f5-45f5-bb7d-3063df175751 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:33.719830 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7deffb-85ef-4ac3-bbe6-20751318ed46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a71b8adef243049d3b055e66566a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:33.720717 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7deffb-85ef-4ac3-bbe6-20751318ed46 service glance] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:33.721000 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7deffb-85ef-4ac3-bbe6-20751318ed46 service glance] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:33.721278 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7deffb-85ef-4ac3-bbe6-20751318ed46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:33.740263 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7deffb-85ef-4ac3-bbe6-20751318ed46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:33.742054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7deffb-85ef-4ac3-bbe6-20751318ed46 service glance] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:33.754623 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1084/2183] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:03:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:03:33.827923 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56177b29-ae00-4a3a-8bdf-31a275615ff2 None None] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:33.828300 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56177b29-ae00-4a3a-8bdf-31a275615ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:33.828643 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56177b29-ae00-4a3a-8bdf-31a275615ff2 None None] PATH_INFO: `/` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:33.830688 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1100/2184] 10.222.0.20 () {54 vars in 921 bytes} [Mon Nov 8 11:03:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 08 11:03:33.836758 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ea89a-9804-4430-ad89-418001e3ba08 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:33.837089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ea89a-9804-4430-ad89-418001e3ba08 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:33.837433 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ea89a-9804-4430-ad89-418001e3ba08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:33.872788 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-465ea89a-9804-4430-ad89-418001e3ba08 None None] MFA Rules not processed for user `0e134083351e4493b2a05bea95233f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:03:33.874166 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-465ea89a-9804-4430-ad89-418001e3ba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:33.899687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1085/2185] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Nov 8 11:03:33 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:03:33.913918 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56177b29-ae00-4a3a-8bdf-31a275615ff2 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:33.925211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56177b29-ae00-4a3a-8bdf-31a275615ff2 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:33.930125 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9b972-135b-4101-8b39-006bcab26b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:33.930813 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9b972-135b-4101-8b39-006bcab26b4d service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:33.931318 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9b972-135b-4101-8b39-006bcab26b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:33.931595 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9b972-135b-4101-8b39-006bcab26b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:33.939411 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9b972-135b-4101-8b39-006bcab26b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:33.940940 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9b972-135b-4101-8b39-006bcab26b4d service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:33.949570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1101/2186] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:03:33 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:03:38.029649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe75461-6886-47e8-a45e-03d1669e7537 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:38.030190 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe75461-6886-47e8-a45e-03d1669e7537 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:38.030636 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe75461-6886-47e8-a45e-03d1669e7537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:38.063546 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-3fe75461-6886-47e8-a45e-03d1669e7537 None None] MFA Rules not processed for user `f9fc539f38364a648b9a4c25d3dbea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:03:38.065505 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3fe75461-6886-47e8-a45e-03d1669e7537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:38.135785 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1086/2187] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Nov 8 11:03:38 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:03:38.149591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9b972-135b-4101-8b39-006bcab26b4d service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:03:38.151204 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4ae9b972-135b-4101-8b39-006bcab26b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:03:38.232549 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9b972-135b-4101-8b39-006bcab26b4d service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:03:38.239152 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca5ab9-05be-4a4f-8923-8ccef56ccf96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '029506cc966a44c9bbe83eb084ac6feb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:03:38.239630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca5ab9-05be-4a4f-8923-8ccef56ccf96 service swift] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:03:38.239918 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca5ab9-05be-4a4f-8923-8ccef56ccf96 service swift] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:03:38.240188 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca5ab9-05be-4a4f-8923-8ccef56ccf96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:03:38.249392 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca5ab9-05be-4a4f-8923-8ccef56ccf96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:03:38.250984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca5ab9-05be-4a4f-8923-8ccef56ccf96 service swift] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:03:38.259673 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1102/2188] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Nov 8 11:03:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 08 11:04:08.460210 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df26bf0-6ee0-4fad-86d4-0929f6982120 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:08.460774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df26bf0-6ee0-4fad-86d4-0929f6982120 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:08.461120 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df26bf0-6ee0-4fad-86d4-0929f6982120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:08.497794 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8df26bf0-6ee0-4fad-86d4-0929f6982120 None None] MFA Rules not processed for user `f9fc539f38364a648b9a4c25d3dbea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:08.499155 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8df26bf0-6ee0-4fad-86d4-0929f6982120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:08.515684 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1087/2189] 10.222.0.20 () {58 vars in 967 bytes} [Mon Nov 8 11:04:08 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:08.540017 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca5ab9-05be-4a4f-8923-8ccef56ccf96 service swift] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:08.551856 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca5ab9-05be-4a4f-8923-8ccef56ccf96 service swift] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:08.558542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2c17-30a6-4756-ba7b-5a0c20e936e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '029506cc966a44c9bbe83eb084ac6feb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:08.559265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2c17-30a6-4756-ba7b-5a0c20e936e4 service swift] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:08.559544 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2c17-30a6-4756-ba7b-5a0c20e936e4 service swift] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:08.559813 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2c17-30a6-4756-ba7b-5a0c20e936e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:08.570788 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e2c17-30a6-4756-ba7b-5a0c20e936e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:08.572552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e2c17-30a6-4756-ba7b-5a0c20e936e4 service swift] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:08.594028 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1103/2190] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Nov 8 11:04:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 11:04:16.814503 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df26bf0-6ee0-4fad-86d4-0929f6982120 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:16.816249 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8df26bf0-6ee0-4fad-86d4-0929f6982120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:16.923913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df26bf0-6ee0-4fad-86d4-0929f6982120 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:16.929101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc22285-8e03-4851-8c6f-af3f4e1b561f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '642c2b97ece34d69bacd821b108bd210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:16.929754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc22285-8e03-4851-8c6f-af3f4e1b561f service placement] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:16.930160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc22285-8e03-4851-8c6f-af3f4e1b561f service placement] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:16.930300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc22285-8e03-4851-8c6f-af3f4e1b561f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:16.932135 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-bbc22285-8e03-4851-8c6f-af3f4e1b561f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:16.945465 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc22285-8e03-4851-8c6f-af3f4e1b561f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:16.947065 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc22285-8e03-4851-8c6f-af3f4e1b561f service placement] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:16.957792 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1088/2191] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:04:16 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:04:40.636200 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2c17-30a6-4756-ba7b-5a0c20e936e4 service swift] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:40.638036 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-728e2c17-30a6-4756-ba7b-5a0c20e936e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:40.684398 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2c17-30a6-4756-ba7b-5a0c20e936e4 service swift] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:40.690090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0172f-f124-4c06-8d95-01bf1bd3bef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:40.690971 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0172f-f124-4c06-8d95-01bf1bd3bef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:40.691291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0172f-f124-4c06-8d95-01bf1bd3bef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:40.691572 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0172f-f124-4c06-8d95-01bf1bd3bef1 admin admin] PATH_INFO: `/v3/users/f163d3e6c712494abb9527c42922763b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:40.692803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0172f-f124-4c06-8d95-01bf1bd3bef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f163d3e6c712494abb9527c42922763b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:40.694735 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0172f-f124-4c06-8d95-01bf1bd3bef1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:40.749716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-16c0172f-f124-4c06-8d95-01bf1bd3bef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f163d3e6c712494abb9527c42922763b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:40.750376 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-16c0172f-f124-4c06-8d95-01bf1bd3bef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f163d3e6c712494abb9527c42922763b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:40.760300 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-16c0172f-f124-4c06-8d95-01bf1bd3bef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f163d3e6c712494abb9527c42922763b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:40.760907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-16c0172f-f124-4c06-8d95-01bf1bd3bef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f163d3e6c712494abb9527c42922763b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:40.774819 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-16c0172f-f124-4c06-8d95-01bf1bd3bef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f163d3e6c712494abb9527c42922763b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:40.788110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1104/2192] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:04:40 2021] DELETE /identity/v3/users/f163d3e6c712494abb9527c42922763b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:40.970348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc22285-8e03-4851-8c6f-af3f4e1b561f service placement] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:40.988180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc22285-8e03-4851-8c6f-af3f4e1b561f service placement] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:41.054326 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47325899-7b49-48d5-9ccb-44ab1b89d1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:41.055275 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47325899-7b49-48d5-9ccb-44ab1b89d1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:41.055569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47325899-7b49-48d5-9ccb-44ab1b89d1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:41.056003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47325899-7b49-48d5-9ccb-44ab1b89d1e4 admin admin] PATH_INFO: `/v3/projects/be28da99be9a462fa89a87973f93a733` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:41.058050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47325899-7b49-48d5-9ccb-44ab1b89d1e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be28da99be9a462fa89a87973f93a733)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:41.060263 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47325899-7b49-48d5-9ccb-44ab1b89d1e4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:41.122969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-47325899-7b49-48d5-9ccb-44ab1b89d1e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be28da99be9a462fa89a87973f93a733', 'request_id': 'req-47325899-7b49-48d5-9ccb-44ab1b89d1e4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:41.131986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-47325899-7b49-48d5-9ccb-44ab1b89d1e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be28da99be9a462fa89a87973f93a733', 'request_id': 'req-47325899-7b49-48d5-9ccb-44ab1b89d1e4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:41.140051 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-47325899-7b49-48d5-9ccb-44ab1b89d1e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be28da99be9a462fa89a87973f93a733', 'request_id': 'req-47325899-7b49-48d5-9ccb-44ab1b89d1e4'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:41.154917 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-47325899-7b49-48d5-9ccb-44ab1b89d1e4 admin admin] The token cache is being invalidate because project be28da99be9a462fa89a87973f93a733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:04:41.155247 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-47325899-7b49-48d5-9ccb-44ab1b89d1e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:41.155916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-47325899-7b49-48d5-9ccb-44ab1b89d1e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:41.159207 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1089/2193] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:04:40 2021] DELETE /identity/v3/projects/be28da99be9a462fa89a87973f93a733 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:41.164824 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0d5c-e28e-4166-97df-e0f3376bb306 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:41.165244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0d5c-e28e-4166-97df-e0f3376bb306 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:41.165602 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0d5c-e28e-4166-97df-e0f3376bb306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:41.240951 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-0f1a0d5c-e28e-4166-97df-e0f3376bb306 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:41.241967 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0f1a0d5c-e28e-4166-97df-e0f3376bb306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:41.313255 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1105/2194] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:41.321887 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be650507-2555-4feb-a06e-613c5c195eff None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:41.322176 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be650507-2555-4feb-a06e-613c5c195eff None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:41.322641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be650507-2555-4feb-a06e-613c5c195eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:41.342382 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-be650507-2555-4feb-a06e-613c5c195eff None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:41.343901 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-be650507-2555-4feb-a06e-613c5c195eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:41.355227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1090/2195] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:41.359662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a0d5c-e28e-4166-97df-e0f3376bb306 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:41.374199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a0d5c-e28e-4166-97df-e0f3376bb306 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:41.381303 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd51b8-2713-4a26-883f-14cc31d336bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:41.381985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd51b8-2713-4a26-883f-14cc31d336bc admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:41.382267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd51b8-2713-4a26-883f-14cc31d336bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:41.382542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd51b8-2713-4a26-883f-14cc31d336bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:41.383348 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd51b8-2713-4a26-883f-14cc31d336bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:04:41.383662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd51b8-2713-4a26-883f-14cc31d336bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:41.385282 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd51b8-2713-4a26-883f-14cc31d336bc admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:41.403029 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1106/2196] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:04:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 11:04:41.404247 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be650507-2555-4feb-a06e-613c5c195eff None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:41.417621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be650507-2555-4feb-a06e-613c5c195eff None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:41.427212 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0bb6c-e602-40d8-b67f-c02f0a1d84da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:41.428213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0bb6c-e602-40d8-b67f-c02f0a1d84da admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:41.428867 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0bb6c-e602-40d8-b67f-c02f0a1d84da admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:41.429281 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0bb6c-e602-40d8-b67f-c02f0a1d84da admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:41.430366 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0bb6c-e602-40d8-b67f-c02f0a1d84da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:41.433525 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0bb6c-e602-40d8-b67f-c02f0a1d84da admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:41.466099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1091/2197] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:04:41 2021] POST /identity/v3/projects => generated 403 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:04:41.471574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd51b8-2713-4a26-883f-14cc31d336bc admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:41.483113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd51b8-2713-4a26-883f-14cc31d336bc admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:41.546853 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948842a1-097e-4019-9820-e6fa4ccb317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:41.547594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948842a1-097e-4019-9820-e6fa4ccb317a admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:41.548042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948842a1-097e-4019-9820-e6fa4ccb317a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:41.548304 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948842a1-097e-4019-9820-e6fa4ccb317a admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:41.549236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948842a1-097e-4019-9820-e6fa4ccb317a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:41.551382 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948842a1-097e-4019-9820-e6fa4ccb317a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:41.578796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1107/2198] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:04:41 2021] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:04:41.580374 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0bb6c-e602-40d8-b67f-c02f0a1d84da admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:41.593628 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0bb6c-e602-40d8-b67f-c02f0a1d84da admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:41.598958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b38d11-a54b-4284-b2de-807ca6d641df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:41.599808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b38d11-a54b-4284-b2de-807ca6d641df admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:41.600244 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b38d11-a54b-4284-b2de-807ca6d641df admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:41.601502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b38d11-a54b-4284-b2de-807ca6d641df admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:41.602407 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b38d11-a54b-4284-b2de-807ca6d641df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:41.604200 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b38d11-a54b-4284-b2de-807ca6d641df admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:41.616294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1092/2199] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:41 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:41.620177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948842a1-097e-4019-9820-e6fa4ccb317a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:41.631023 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948842a1-097e-4019-9820-e6fa4ccb317a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:41.636153 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62254381-3119-4d70-b626-187f8b2ba0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:41.637361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62254381-3119-4d70-b626-187f8b2ba0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:41.637916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62254381-3119-4d70-b626-187f8b2ba0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:41.638072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62254381-3119-4d70-b626-187f8b2ba0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:41.638966 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62254381-3119-4d70-b626-187f8b2ba0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:41.640752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62254381-3119-4d70-b626-187f8b2ba0a1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:41.651948 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1108/2200] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:41 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:41.656839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b38d11-a54b-4284-b2de-807ca6d641df admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:41.667534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b38d11-a54b-4284-b2de-807ca6d641df admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:41.672761 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f329cc4-e7d8-400b-b77a-aaa615320f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:41.674178 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f329cc4-e7d8-400b-b77a-aaa615320f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:41.675390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f329cc4-e7d8-400b-b77a-aaa615320f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:41.675712 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f329cc4-e7d8-400b-b77a-aaa615320f09 admin admin] PATH_INFO: `/v3/projects/ad09dbfe65e645b185046d500fe95313/users/d70a273d83f847e7a6151c37fccbe96f/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:41.693946 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f329cc4-e7d8-400b-b77a-aaa615320f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad09dbfe65e645b185046d500fe95313, user_id=d70a273d83f847e7a6151c37fccbe96f, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:41.696843 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f329cc4-e7d8-400b-b77a-aaa615320f09 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:41.711346 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1093/2201] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:41 2021] PUT /identity/v3/projects/ad09dbfe65e645b185046d500fe95313/users/d70a273d83f847e7a6151c37fccbe96f/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:41.716541 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925065f-67e7-47dc-8dfd-732c52c59770 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:41.716910 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925065f-67e7-47dc-8dfd-732c52c59770 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:41.717292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925065f-67e7-47dc-8dfd-732c52c59770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:41.736383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-4925065f-67e7-47dc-8dfd-732c52c59770 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:41.737807 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4925065f-67e7-47dc-8dfd-732c52c59770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:41.835430 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1109/2202] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:41.842639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f329cc4-e7d8-400b-b77a-aaa615320f09 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:41.844773 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3f329cc4-e7d8-400b-b77a-aaa615320f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:41.919581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f329cc4-e7d8-400b-b77a-aaa615320f09 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:41.924363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c1917-df2f-41f7-a1dd-248487ea39df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:41.925774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c1917-df2f-41f7-a1dd-248487ea39df service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:41.925774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c1917-df2f-41f7-a1dd-248487ea39df service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:41.925774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c1917-df2f-41f7-a1dd-248487ea39df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:41.936321 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c1917-df2f-41f7-a1dd-248487ea39df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:41.937889 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c1917-df2f-41f7-a1dd-248487ea39df service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:41.949913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1094/2203] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:04:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:04:42.942614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0adce-f5f1-4db7-869f-87fa00d4b619 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:42.943430 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0adce-f5f1-4db7-869f-87fa00d4b619 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:42.943430 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0adce-f5f1-4db7-869f-87fa00d4b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:42.974225 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-71d0adce-f5f1-4db7-869f-87fa00d4b619 None None] MFA Rules not processed for user `d70a273d83f847e7a6151c37fccbe96f`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:42.975555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-71d0adce-f5f1-4db7-869f-87fa00d4b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:43.069593 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1110/2204] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:42 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:43.075728 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c1917-df2f-41f7-a1dd-248487ea39df service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:43.088273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c1917-df2f-41f7-a1dd-248487ea39df service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:43.094676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0f776-347f-48e9-9313-a05286b8dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:43.095808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0f776-347f-48e9-9313-a05286b8dda0 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:43.096462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0f776-347f-48e9-9313-a05286b8dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:43.097001 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0f776-347f-48e9-9313-a05286b8dda0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:43.098937 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0f776-347f-48e9-9313-a05286b8dda0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:43.105527 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0f776-347f-48e9-9313-a05286b8dda0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:43.156971 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0adce-f5f1-4db7-869f-87fa00d4b619 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:43.171491 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1095/2205] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:04:43 2021] POST /identity/v3/projects => generated 405 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:04:43.184986 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0adce-f5f1-4db7-869f-87fa00d4b619 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:43.214912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0f776-347f-48e9-9313-a05286b8dda0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:43.216934 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8bc0f776-347f-48e9-9313-a05286b8dda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:43.260316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f2fa4-6c8c-45a7-92a6-76ddd5b227a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:43.261174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f2fa4-6c8c-45a7-92a6-76ddd5b227a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:43.261929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f2fa4-6c8c-45a7-92a6-76ddd5b227a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:43.262276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f2fa4-6c8c-45a7-92a6-76ddd5b227a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:43.263080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f2fa4-6c8c-45a7-92a6-76ddd5b227a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:43.265523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f2fa4-6c8c-45a7-92a6-76ddd5b227a0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:43.291971 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1111/2206] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:04:43 2021] POST /identity/v3/users => generated 309 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:04:43.296170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f2fa4-6c8c-45a7-92a6-76ddd5b227a0 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:43.303176 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0f776-347f-48e9-9313-a05286b8dda0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:43.307104 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f2fa4-6c8c-45a7-92a6-76ddd5b227a0 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:43.308214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702f29c-9f0d-4729-a306-05f0240ad891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:43.309102 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702f29c-9f0d-4729-a306-05f0240ad891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:43.309381 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702f29c-9f0d-4729-a306-05f0240ad891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:43.309830 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702f29c-9f0d-4729-a306-05f0240ad891 admin admin] PATH_INFO: `/v3/users/73ef103ad38f498c8ea87525f554f438` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:43.311296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702f29c-9f0d-4729-a306-05f0240ad891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ef103ad38f498c8ea87525f554f438)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:43.311766 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5929dd-e048-4b0b-b74d-86d0a8b9c5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:43.312425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5929dd-e048-4b0b-b74d-86d0a8b9c5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:43.312740 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5929dd-e048-4b0b-b74d-86d0a8b9c5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:43.313012 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5929dd-e048-4b0b-b74d-86d0a8b9c5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:43.313235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702f29c-9f0d-4729-a306-05f0240ad891 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:43.313743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5929dd-e048-4b0b-b74d-86d0a8b9c5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:43.315408 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5929dd-e048-4b0b-b74d-86d0a8b9c5e4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:43.325666 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1112/2207] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:43.330928 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5929dd-e048-4b0b-b74d-86d0a8b9c5e4 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:43.341196 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5929dd-e048-4b0b-b74d-86d0a8b9c5e4 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:43.347787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e65d8-49ee-47da-8dcc-b57a7c96694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:43.348766 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e65d8-49ee-47da-8dcc-b57a7c96694e admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:43.349050 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e65d8-49ee-47da-8dcc-b57a7c96694e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:43.349323 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e65d8-49ee-47da-8dcc-b57a7c96694e admin admin] PATH_INFO: `/v3/projects/f40fcbe997ce4341afe2f0b09bfcfd7a/users/c299f1b276534bbd86683a02b5386ea4/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:43.371523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e65d8-49ee-47da-8dcc-b57a7c96694e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40fcbe997ce4341afe2f0b09bfcfd7a, user_id=c299f1b276534bbd86683a02b5386ea4, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:43.374335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e65d8-49ee-47da-8dcc-b57a7c96694e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:43.379173 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c702f29c-9f0d-4729-a306-05f0240ad891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ef103ad38f498c8ea87525f554f438'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:43.379941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c702f29c-9f0d-4729-a306-05f0240ad891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ef103ad38f498c8ea87525f554f438'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:43.389738 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c702f29c-9f0d-4729-a306-05f0240ad891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ef103ad38f498c8ea87525f554f438'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:43.390647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c702f29c-9f0d-4729-a306-05f0240ad891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ef103ad38f498c8ea87525f554f438'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:43.391453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1113/2208] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:43 2021] PUT /identity/v3/projects/f40fcbe997ce4341afe2f0b09bfcfd7a/users/c299f1b276534bbd86683a02b5386ea4/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:04:43.396283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e65d8-49ee-47da-8dcc-b57a7c96694e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:43.398464 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e56e65d8-49ee-47da-8dcc-b57a7c96694e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:43.400445 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c702f29c-9f0d-4729-a306-05f0240ad891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ef103ad38f498c8ea87525f554f438'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:43.424035 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1096/2209] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:04:43 2021] DELETE /identity/v3/users/73ef103ad38f498c8ea87525f554f438 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:43.465737 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e65d8-49ee-47da-8dcc-b57a7c96694e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:43.526414 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87fdd2-5488-462f-a6f9-685ad77f68b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:43.527094 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87fdd2-5488-462f-a6f9-685ad77f68b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:43.527482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87fdd2-5488-462f-a6f9-685ad77f68b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:43.527757 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87fdd2-5488-462f-a6f9-685ad77f68b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:43.528507 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87fdd2-5488-462f-a6f9-685ad77f68b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:43.530115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87fdd2-5488-462f-a6f9-685ad77f68b8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:43.540273 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1114/2210] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:43 2021] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:04:43.544469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702f29c-9f0d-4729-a306-05f0240ad891 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:43.555479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702f29c-9f0d-4729-a306-05f0240ad891 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:43.561060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9c90-e3a2-4e0e-86dd-2231900b6a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:43.561947 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9c90-e3a2-4e0e-86dd-2231900b6a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:43.562230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9c90-e3a2-4e0e-86dd-2231900b6a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:43.562501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9c90-e3a2-4e0e-86dd-2231900b6a2e admin admin] PATH_INFO: `/v3/projects/f40fcbe997ce4341afe2f0b09bfcfd7a/users/c299f1b276534bbd86683a02b5386ea4/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:43.564650 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f9c90-e3a2-4e0e-86dd-2231900b6a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40fcbe997ce4341afe2f0b09bfcfd7a, user_id=c299f1b276534bbd86683a02b5386ea4, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:43.567542 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f9c90-e3a2-4e0e-86dd-2231900b6a2e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:43.578055 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1097/2211] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:43 2021] PUT /identity/v3/projects/f40fcbe997ce4341afe2f0b09bfcfd7a/users/c299f1b276534bbd86683a02b5386ea4/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:43.628058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87fdd2-5488-462f-a6f9-685ad77f68b8 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:43.629968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8f87fdd2-5488-462f-a6f9-685ad77f68b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:43.644224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87fdd2-5488-462f-a6f9-685ad77f68b8 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:43.708825 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e405c-cae6-485f-82a3-cadeecadac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:43.709712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e405c-cae6-485f-82a3-cadeecadac7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:43.709999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e405c-cae6-485f-82a3-cadeecadac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:43.710279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e405c-cae6-485f-82a3-cadeecadac7c admin admin] PATH_INFO: `/v3/projects/5fce7f68606c4cb8b214910a6dd87fb8` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:43.711531 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e405c-cae6-485f-82a3-cadeecadac7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fce7f68606c4cb8b214910a6dd87fb8)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:43.713467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e405c-cae6-485f-82a3-cadeecadac7c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:43.779875 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d84e405c-cae6-485f-82a3-cadeecadac7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fce7f68606c4cb8b214910a6dd87fb8', 'request_id': 'req-d84e405c-cae6-485f-82a3-cadeecadac7c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:43.788605 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d84e405c-cae6-485f-82a3-cadeecadac7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fce7f68606c4cb8b214910a6dd87fb8', 'request_id': 'req-d84e405c-cae6-485f-82a3-cadeecadac7c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:43.794768 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d84e405c-cae6-485f-82a3-cadeecadac7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fce7f68606c4cb8b214910a6dd87fb8', 'request_id': 'req-d84e405c-cae6-485f-82a3-cadeecadac7c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:43.811030 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d84e405c-cae6-485f-82a3-cadeecadac7c admin admin] The token cache is being invalidate because project 5fce7f68606c4cb8b214910a6dd87fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:04:43.811356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d84e405c-cae6-485f-82a3-cadeecadac7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:43.812019 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-d84e405c-cae6-485f-82a3-cadeecadac7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:43.814435 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1115/2212] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:04:43 2021] DELETE /identity/v3/projects/5fce7f68606c4cb8b214910a6dd87fb8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:43.821514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2a274-4921-448b-978d-859b3ef15536 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:43.821892 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2a274-4921-448b-978d-859b3ef15536 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:43.822233 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2a274-4921-448b-978d-859b3ef15536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:43.840750 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-c2b2a274-4921-448b-978d-859b3ef15536 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:43.841973 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c2b2a274-4921-448b-978d-859b3ef15536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:43.914682 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1098/2213] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:04:43.916827 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0e4d2-f177-49e1-bf6b-0f6fdc78686e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:43.917118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0e4d2-f177-49e1-bf6b-0f6fdc78686e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:43.917397 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0e4d2-f177-49e1-bf6b-0f6fdc78686e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:43.944653 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-f0d0e4d2-f177-49e1-bf6b-0f6fdc78686e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:43.946677 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f0d0e4d2-f177-49e1-bf6b-0f6fdc78686e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:43.957344 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1116/2214] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:43.961568 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2a274-4921-448b-978d-859b3ef15536 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:43.972419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2a274-4921-448b-978d-859b3ef15536 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:43.977063 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d44ff-c043-4c57-aa8f-02d0b49c52d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:43.977736 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d44ff-c043-4c57-aa8f-02d0b49c52d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:43.978021 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d44ff-c043-4c57-aa8f-02d0b49c52d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:43.978443 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d44ff-c043-4c57-aa8f-02d0b49c52d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:43.979273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d44ff-c043-4c57-aa8f-02d0b49c52d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:04:43.979613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d44ff-c043-4c57-aa8f-02d0b49c52d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:43.981229 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d44ff-c043-4c57-aa8f-02d0b49c52d8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:43.994559 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1099/2215] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:04:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:04:43.999067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0e4d2-f177-49e1-bf6b-0f6fdc78686e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:44.008886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0e4d2-f177-49e1-bf6b-0f6fdc78686e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:44.014450 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee007712-1c91-4a94-841f-828b00a75d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:44.015117 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee007712-1c91-4a94-841f-828b00a75d87 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:44.015429 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee007712-1c91-4a94-841f-828b00a75d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:44.015707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee007712-1c91-4a94-841f-828b00a75d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:44.016433 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee007712-1c91-4a94-841f-828b00a75d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:44.018591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee007712-1c91-4a94-841f-828b00a75d87 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:44.047181 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1117/2216] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:04:43 2021] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:04:44.050238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d44ff-c043-4c57-aa8f-02d0b49c52d8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:44.061039 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d44ff-c043-4c57-aa8f-02d0b49c52d8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:44.120041 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcab67e-1cc4-4ccc-a456-de56d24360a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:44.120752 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcab67e-1cc4-4ccc-a456-de56d24360a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:44.121156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcab67e-1cc4-4ccc-a456-de56d24360a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:44.121434 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcab67e-1cc4-4ccc-a456-de56d24360a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:44.122221 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcab67e-1cc4-4ccc-a456-de56d24360a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:44.124230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcab67e-1cc4-4ccc-a456-de56d24360a0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:44.147380 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1100/2217] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:04:44 2021] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:04:44.152006 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee007712-1c91-4a94-841f-828b00a75d87 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:44.162693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee007712-1c91-4a94-841f-828b00a75d87 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:44.167384 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30110f90-f446-479c-b937-12dc5a133865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:44.168053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30110f90-f446-479c-b937-12dc5a133865 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:44.168329 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30110f90-f446-479c-b937-12dc5a133865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:44.168666 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30110f90-f446-479c-b937-12dc5a133865 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:44.169414 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30110f90-f446-479c-b937-12dc5a133865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:44.171115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30110f90-f446-479c-b937-12dc5a133865 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:44.183939 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1118/2218] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:44 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:04:44.187513 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcab67e-1cc4-4ccc-a456-de56d24360a0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:44.198540 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcab67e-1cc4-4ccc-a456-de56d24360a0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:44.204039 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571476e7-97b3-43f1-ae80-6cb01e53eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:44.204898 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571476e7-97b3-43f1-ae80-6cb01e53eaed admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:44.205234 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571476e7-97b3-43f1-ae80-6cb01e53eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:44.205687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571476e7-97b3-43f1-ae80-6cb01e53eaed admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:44.206642 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571476e7-97b3-43f1-ae80-6cb01e53eaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:44.208384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571476e7-97b3-43f1-ae80-6cb01e53eaed admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:44.219034 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1101/2219] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:44 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:04:44.224194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30110f90-f446-479c-b937-12dc5a133865 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:44.234482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30110f90-f446-479c-b937-12dc5a133865 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:44.239638 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d5f3a-1694-4c3b-a994-7f79e202889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:44.240530 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5f3a-1694-4c3b-a994-7f79e202889d admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:44.240806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5f3a-1694-4c3b-a994-7f79e202889d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:44.241196 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5f3a-1694-4c3b-a994-7f79e202889d admin admin] PATH_INFO: `/v3/projects/a7f4367ed9294c10b18755ea96c8c318/users/424623fef9df40c8ada2c850d7aa8fbb/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:44.257212 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d5f3a-1694-4c3b-a994-7f79e202889d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f4367ed9294c10b18755ea96c8c318, user_id=424623fef9df40c8ada2c850d7aa8fbb, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:44.260375 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d5f3a-1694-4c3b-a994-7f79e202889d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:44.275699 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1119/2220] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:44 2021] PUT /identity/v3/projects/a7f4367ed9294c10b18755ea96c8c318/users/424623fef9df40c8ada2c850d7aa8fbb/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:44.286562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee815a-2d45-4f47-a844-0aa45e285725 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:44.286852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee815a-2d45-4f47-a844-0aa45e285725 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:44.287146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee815a-2d45-4f47-a844-0aa45e285725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:44.315832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-57ee815a-2d45-4f47-a844-0aa45e285725 None None] MFA Rules not processed for user `424623fef9df40c8ada2c850d7aa8fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:44.317287 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-57ee815a-2d45-4f47-a844-0aa45e285725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:44.356968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53a20-276c-43f3-92c2-fba87c00e66a None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:44.357257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53a20-276c-43f3-92c2-fba87c00e66a None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:44.357532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53a20-276c-43f3-92c2-fba87c00e66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:44.397099 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-60e53a20-276c-43f3-92c2-fba87c00e66a None None] MFA Rules not processed for user `c299f1b276534bbd86683a02b5386ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:44.398726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-60e53a20-276c-43f3-92c2-fba87c00e66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:44.403752 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1102/2221] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:44 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:44.416339 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee815a-2d45-4f47-a844-0aa45e285725 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:44.418019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-57ee815a-2d45-4f47-a844-0aa45e285725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:44.497415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1120/2222] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:44 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:44.541892 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee815a-2d45-4f47-a844-0aa45e285725 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:44.549932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0eeed0-9bca-4f13-9733-35478db2a309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:44.550609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eeed0-9bca-4f13-9733-35478db2a309 service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:44.551061 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eeed0-9bca-4f13-9733-35478db2a309 service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:44.551504 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eeed0-9bca-4f13-9733-35478db2a309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:44.562736 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0eeed0-9bca-4f13-9733-35478db2a309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:44.565163 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0eeed0-9bca-4f13-9733-35478db2a309 service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:44.576002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1103/2223] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:04:44 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:04:45.607952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e53a20-276c-43f3-92c2-fba87c00e66a None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:45.609809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-60e53a20-276c-43f3-92c2-fba87c00e66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:45.676171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e53a20-276c-43f3-92c2-fba87c00e66a None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:45.680762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61bf74-2471-4ee4-a394-71cdf34d6d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:45.681630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61bf74-2471-4ee4-a394-71cdf34d6d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:45.681899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61bf74-2471-4ee4-a394-71cdf34d6d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:45.682162 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61bf74-2471-4ee4-a394-71cdf34d6d39 admin admin] PATH_INFO: `/v3/users/d70a273d83f847e7a6151c37fccbe96f` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:45.683427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61bf74-2471-4ee4-a394-71cdf34d6d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70a273d83f847e7a6151c37fccbe96f)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:45.685339 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61bf74-2471-4ee4-a394-71cdf34d6d39 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:45.730650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2a61bf74-2471-4ee4-a394-71cdf34d6d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70a273d83f847e7a6151c37fccbe96f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:45.731226 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2a61bf74-2471-4ee4-a394-71cdf34d6d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70a273d83f847e7a6151c37fccbe96f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:45.738225 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2a61bf74-2471-4ee4-a394-71cdf34d6d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70a273d83f847e7a6151c37fccbe96f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:45.738870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2a61bf74-2471-4ee4-a394-71cdf34d6d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70a273d83f847e7a6151c37fccbe96f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:45.750651 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2a61bf74-2471-4ee4-a394-71cdf34d6d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70a273d83f847e7a6151c37fccbe96f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:45.763198 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1121/2224] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:04:45 2021] DELETE /identity/v3/users/d70a273d83f847e7a6151c37fccbe96f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:45.964580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0eeed0-9bca-4f13-9733-35478db2a309 service nova] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:45.976697 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0eeed0-9bca-4f13-9733-35478db2a309 service nova] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:46.049671 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:46.050646 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:46.050908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:46.051249 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] PATH_INFO: `/v3/projects/ad09dbfe65e645b185046d500fe95313` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:46.057183 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad09dbfe65e645b185046d500fe95313)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:46.059456 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:46.120538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad09dbfe65e645b185046d500fe95313', 'request_id': 'req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.128694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad09dbfe65e645b185046d500fe95313', 'request_id': 'req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.136140 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad09dbfe65e645b185046d500fe95313', 'request_id': 'req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.155718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] The token cache is being invalidate because project ad09dbfe65e645b185046d500fe95313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:04:46.156397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.158096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.160381 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1104/2225] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:04:45 2021] DELETE /identity/v3/projects/ad09dbfe65e645b185046d500fe95313 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:46.173029 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61bf74-2471-4ee4-a394-71cdf34d6d39 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:46.175891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-2a61bf74-2471-4ee4-a394-71cdf34d6d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:46.199260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61bf74-2471-4ee4-a394-71cdf34d6d39 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:46.280090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae50df6-50d2-40db-a349-1e96c4f05a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:46.281090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae50df6-50d2-40db-a349-1e96c4f05a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:46.281383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae50df6-50d2-40db-a349-1e96c4f05a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:46.281663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae50df6-50d2-40db-a349-1e96c4f05a4d admin admin] PATH_INFO: `/v3/users/c299f1b276534bbd86683a02b5386ea4` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:46.283037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae50df6-50d2-40db-a349-1e96c4f05a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c299f1b276534bbd86683a02b5386ea4)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:46.285929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae50df6-50d2-40db-a349-1e96c4f05a4d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:46.351096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-4ae50df6-50d2-40db-a349-1e96c4f05a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c299f1b276534bbd86683a02b5386ea4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.351733 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-4ae50df6-50d2-40db-a349-1e96c4f05a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c299f1b276534bbd86683a02b5386ea4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.362952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-4ae50df6-50d2-40db-a349-1e96c4f05a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c299f1b276534bbd86683a02b5386ea4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.364049 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-4ae50df6-50d2-40db-a349-1e96c4f05a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c299f1b276534bbd86683a02b5386ea4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.384376 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-4ae50df6-50d2-40db-a349-1e96c4f05a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c299f1b276534bbd86683a02b5386ea4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.405873 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1122/2226] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:04:46 2021] DELETE /identity/v3/users/c299f1b276534bbd86683a02b5386ea4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:46.632363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:46.634019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:46.650179 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d192d39-bd9f-4b43-ab5e-f7b7074f1fdc admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:46.713384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd192b9-d764-4e5d-a980-41c6704d7acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:46.714340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd192b9-d764-4e5d-a980-41c6704d7acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:46.714630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd192b9-d764-4e5d-a980-41c6704d7acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:46.714903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd192b9-d764-4e5d-a980-41c6704d7acd admin admin] PATH_INFO: `/v3/projects/f40fcbe997ce4341afe2f0b09bfcfd7a` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:46.716290 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd192b9-d764-4e5d-a980-41c6704d7acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40fcbe997ce4341afe2f0b09bfcfd7a)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:46.718353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd192b9-d764-4e5d-a980-41c6704d7acd admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:46.775938 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cfd192b9-d764-4e5d-a980-41c6704d7acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40fcbe997ce4341afe2f0b09bfcfd7a', 'request_id': 'req-cfd192b9-d764-4e5d-a980-41c6704d7acd'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.784680 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cfd192b9-d764-4e5d-a980-41c6704d7acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40fcbe997ce4341afe2f0b09bfcfd7a', 'request_id': 'req-cfd192b9-d764-4e5d-a980-41c6704d7acd'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.791825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cfd192b9-d764-4e5d-a980-41c6704d7acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40fcbe997ce4341afe2f0b09bfcfd7a', 'request_id': 'req-cfd192b9-d764-4e5d-a980-41c6704d7acd'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.807613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cfd192b9-d764-4e5d-a980-41c6704d7acd admin admin] The token cache is being invalidate because project f40fcbe997ce4341afe2f0b09bfcfd7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:04:46.808829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cfd192b9-d764-4e5d-a980-41c6704d7acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.808829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cfd192b9-d764-4e5d-a980-41c6704d7acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:46.810449 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1105/2227] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:04:46 2021] DELETE /identity/v3/projects/f40fcbe997ce4341afe2f0b09bfcfd7a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:04:46.818042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea102b0-12c6-43a9-8f85-7cc958287464 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:46.818563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea102b0-12c6-43a9-8f85-7cc958287464 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:46.818563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea102b0-12c6-43a9-8f85-7cc958287464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:46.840542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-8ea102b0-12c6-43a9-8f85-7cc958287464 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:46.842192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8ea102b0-12c6-43a9-8f85-7cc958287464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:46.913813 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1123/2228] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:04:46.922498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c9e8-f19b-46d3-9507-c8b63903c6c4 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:46.922791 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c9e8-f19b-46d3-9507-c8b63903c6c4 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:46.923071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6c9e8-f19b-46d3-9507-c8b63903c6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:46.947070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-21b6c9e8-f19b-46d3-9507-c8b63903c6c4 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:46.948446 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-21b6c9e8-f19b-46d3-9507-c8b63903c6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:46.959191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1106/2229] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:46.964598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea102b0-12c6-43a9-8f85-7cc958287464 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:46.979054 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea102b0-12c6-43a9-8f85-7cc958287464 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:46.986538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64416dab-1a7e-4c0e-83c4-ea06c0049102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:46.987231 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64416dab-1a7e-4c0e-83c4-ea06c0049102 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:46.987618 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64416dab-1a7e-4c0e-83c4-ea06c0049102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:46.987818 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64416dab-1a7e-4c0e-83c4-ea06c0049102 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:46.988542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64416dab-1a7e-4c0e-83c4-ea06c0049102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:04:46.988844 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64416dab-1a7e-4c0e-83c4-ea06c0049102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:46.990450 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64416dab-1a7e-4c0e-83c4-ea06c0049102 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:47.004262 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1124/2230] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:04:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 11:04:47.009134 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6c9e8-f19b-46d3-9507-c8b63903c6c4 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:47.020048 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6c9e8-f19b-46d3-9507-c8b63903c6c4 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:47.026007 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e07f4-173c-4017-8fb7-09885d483b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:47.026667 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e07f4-173c-4017-8fb7-09885d483b56 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:47.026945 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e07f4-173c-4017-8fb7-09885d483b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:47.027214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e07f4-173c-4017-8fb7-09885d483b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:47.027952 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e07f4-173c-4017-8fb7-09885d483b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:47.029859 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e07f4-173c-4017-8fb7-09885d483b56 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:47.060871 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1107/2231] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:04:47 2021] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:04:47.065317 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64416dab-1a7e-4c0e-83c4-ea06c0049102 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:47.075774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64416dab-1a7e-4c0e-83c4-ea06c0049102 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:47.147095 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b52a08-b5cb-4864-9b8d-c28cf8043e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:47.147802 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b52a08-b5cb-4864-9b8d-c28cf8043e0d admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:47.148080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b52a08-b5cb-4864-9b8d-c28cf8043e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:47.148333 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b52a08-b5cb-4864-9b8d-c28cf8043e0d admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:47.149059 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b52a08-b5cb-4864-9b8d-c28cf8043e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:47.151055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b52a08-b5cb-4864-9b8d-c28cf8043e0d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:47.182923 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1125/2232] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:04:47 2021] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:04:47.185423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e07f4-173c-4017-8fb7-09885d483b56 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:47.200535 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e07f4-173c-4017-8fb7-09885d483b56 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:47.207022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550db8b6-2c2c-4e88-9b47-5ac813f52c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:47.207736 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550db8b6-2c2c-4e88-9b47-5ac813f52c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:47.208020 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550db8b6-2c2c-4e88-9b47-5ac813f52c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:47.208321 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550db8b6-2c2c-4e88-9b47-5ac813f52c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:47.209062 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550db8b6-2c2c-4e88-9b47-5ac813f52c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:47.210687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550db8b6-2c2c-4e88-9b47-5ac813f52c78 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:47.222798 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1108/2233] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:47 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:47.227891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b52a08-b5cb-4864-9b8d-c28cf8043e0d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:47.241286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b52a08-b5cb-4864-9b8d-c28cf8043e0d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:47.249242 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca4386-1867-467e-8b7f-943261dbc733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:47.249917 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca4386-1867-467e-8b7f-943261dbc733 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:47.250195 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca4386-1867-467e-8b7f-943261dbc733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:47.250470 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca4386-1867-467e-8b7f-943261dbc733 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:47.251247 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca4386-1867-467e-8b7f-943261dbc733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:47.252914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca4386-1867-467e-8b7f-943261dbc733 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:47.265417 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1126/2234] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:47 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:47.269986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550db8b6-2c2c-4e88-9b47-5ac813f52c78 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:47.282412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550db8b6-2c2c-4e88-9b47-5ac813f52c78 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:47.288940 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f83ab-482e-431a-a016-caae2ae2528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:47.289858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f83ab-482e-431a-a016-caae2ae2528c admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:47.290139 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f83ab-482e-431a-a016-caae2ae2528c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:47.290393 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f83ab-482e-431a-a016-caae2ae2528c admin admin] PATH_INFO: `/v3/projects/70ed042b113045db8f28edda12edb103/users/4245211c2deb4956a594d898c3ca5b8d/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:47.306538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f83ab-482e-431a-a016-caae2ae2528c admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ed042b113045db8f28edda12edb103, user_id=4245211c2deb4956a594d898c3ca5b8d, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:47.309235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f83ab-482e-431a-a016-caae2ae2528c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:47.324267 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1109/2235] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:47 2021] PUT /identity/v3/projects/70ed042b113045db8f28edda12edb103/users/4245211c2deb4956a594d898c3ca5b8d/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:47.335656 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cfb47-08c7-45ee-a7cc-542e58bd107b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:47.335889 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cfb47-08c7-45ee-a7cc-542e58bd107b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:47.336207 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cfb47-08c7-45ee-a7cc-542e58bd107b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:47.372884 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-c24cfb47-08c7-45ee-a7cc-542e58bd107b None None] MFA Rules not processed for user `4245211c2deb4956a594d898c3ca5b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:47.374811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c24cfb47-08c7-45ee-a7cc-542e58bd107b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:47.448377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1127/2236] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:47 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:47.453213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f83ab-482e-431a-a016-caae2ae2528c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:47.532409 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f83ab-482e-431a-a016-caae2ae2528c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:47.540297 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b6075-0221-4427-b8ea-8f4479e8ae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:47.540989 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b6075-0221-4427-b8ea-8f4479e8ae23 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:47.541246 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b6075-0221-4427-b8ea-8f4479e8ae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:47.541544 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b6075-0221-4427-b8ea-8f4479e8ae23 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:47.542253 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b6075-0221-4427-b8ea-8f4479e8ae23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:47.544236 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b6075-0221-4427-b8ea-8f4479e8ae23 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:47.575540 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1110/2237] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:04:47 2021] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:04:47.580364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cfb47-08c7-45ee-a7cc-542e58bd107b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:47.593131 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cfb47-08c7-45ee-a7cc-542e58bd107b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:47.652789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace7edb-b405-4bc2-beff-121563d1638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:47.653704 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace7edb-b405-4bc2-beff-121563d1638f admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:47.654043 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace7edb-b405-4bc2-beff-121563d1638f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:47.654352 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace7edb-b405-4bc2-beff-121563d1638f admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:47.655179 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace7edb-b405-4bc2-beff-121563d1638f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:47.657561 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace7edb-b405-4bc2-beff-121563d1638f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:47.687168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1128/2238] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:04:47 2021] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:04:47.691382 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b6075-0221-4427-b8ea-8f4479e8ae23 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:47.702336 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b6075-0221-4427-b8ea-8f4479e8ae23 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:47.707797 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0c9a1-39d0-4b19-a17b-78d5e6767e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:47.708481 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0c9a1-39d0-4b19-a17b-78d5e6767e49 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:47.708767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0c9a1-39d0-4b19-a17b-78d5e6767e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:47.709043 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0c9a1-39d0-4b19-a17b-78d5e6767e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:47.709823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0c9a1-39d0-4b19-a17b-78d5e6767e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:47.711572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0c9a1-39d0-4b19-a17b-78d5e6767e49 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:47.723542 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1111/2239] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:47 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:47.728083 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace7edb-b405-4bc2-beff-121563d1638f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:47.740162 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace7edb-b405-4bc2-beff-121563d1638f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:47.745864 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d702dc-d8af-4fd3-b4a3-9cb497434b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:47.746758 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d702dc-d8af-4fd3-b4a3-9cb497434b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:47.747040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d702dc-d8af-4fd3-b4a3-9cb497434b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:47.747348 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d702dc-d8af-4fd3-b4a3-9cb497434b20 admin admin] PATH_INFO: `/v3/projects/5b837e25e7744549a83145b9314cf26f/users/17dd335d51ae401b9328e4b8d887e75c/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:47.764253 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d702dc-d8af-4fd3-b4a3-9cb497434b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b837e25e7744549a83145b9314cf26f, user_id=17dd335d51ae401b9328e4b8d887e75c, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:47.767986 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d702dc-d8af-4fd3-b4a3-9cb497434b20 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:47.783435 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1129/2240] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:47 2021] PUT /identity/v3/projects/5b837e25e7744549a83145b9314cf26f/users/17dd335d51ae401b9328e4b8d887e75c/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:47.788525 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0c9a1-39d0-4b19-a17b-78d5e6767e49 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:47.799306 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0c9a1-39d0-4b19-a17b-78d5e6767e49 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:47.866413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62b65e-1704-4efa-a20e-3a08751cce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:47.866997 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62b65e-1704-4efa-a20e-3a08751cce75 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:47.867313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62b65e-1704-4efa-a20e-3a08751cce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:47.867585 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62b65e-1704-4efa-a20e-3a08751cce75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:47.868332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62b65e-1704-4efa-a20e-3a08751cce75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:47.869934 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62b65e-1704-4efa-a20e-3a08751cce75 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:47.880469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1112/2241] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:47 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:47.884997 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d702dc-d8af-4fd3-b4a3-9cb497434b20 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:47.896961 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d702dc-d8af-4fd3-b4a3-9cb497434b20 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:47.902041 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61d5fc-9b71-443b-9a6f-6c76e1ae28c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:47.902921 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61d5fc-9b71-443b-9a6f-6c76e1ae28c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:47.903225 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61d5fc-9b71-443b-9a6f-6c76e1ae28c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:47.903496 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61d5fc-9b71-443b-9a6f-6c76e1ae28c1 admin admin] PATH_INFO: `/v3/projects/5b837e25e7744549a83145b9314cf26f/users/17dd335d51ae401b9328e4b8d887e75c/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:47.905599 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61d5fc-9b71-443b-9a6f-6c76e1ae28c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b837e25e7744549a83145b9314cf26f, user_id=17dd335d51ae401b9328e4b8d887e75c, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:47.908567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61d5fc-9b71-443b-9a6f-6c76e1ae28c1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:47.920082 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1130/2242] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:47 2021] PUT /identity/v3/projects/5b837e25e7744549a83145b9314cf26f/users/17dd335d51ae401b9328e4b8d887e75c/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:47.930622 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6599f-1201-4603-8a18-2b6d91464529 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:47.930911 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6599f-1201-4603-8a18-2b6d91464529 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:47.931182 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6599f-1201-4603-8a18-2b6d91464529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:47.959738 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-4bf6599f-1201-4603-8a18-2b6d91464529 None None] MFA Rules not processed for user `17dd335d51ae401b9328e4b8d887e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:47.960960 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-4bf6599f-1201-4603-8a18-2b6d91464529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:48.034515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1113/2243] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:47 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:48.051941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61d5fc-9b71-443b-9a6f-6c76e1ae28c1 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:48.055020 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6e61d5fc-9b71-443b-9a6f-6c76e1ae28c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:48.158148 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61d5fc-9b71-443b-9a6f-6c76e1ae28c1 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:48.163568 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd507cc-9882-4074-85c8-9829eb394f40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:48.164222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd507cc-9882-4074-85c8-9829eb394f40 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:48.164502 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd507cc-9882-4074-85c8-9829eb394f40 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:48.164781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd507cc-9882-4074-85c8-9829eb394f40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:48.175536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd507cc-9882-4074-85c8-9829eb394f40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:48.177024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd507cc-9882-4074-85c8-9829eb394f40 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:48.186990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1131/2244] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:04:48 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:04:48.362919 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6599f-1201-4603-8a18-2b6d91464529 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:48.435196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6599f-1201-4603-8a18-2b6d91464529 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:48.441723 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae978e-12db-4ee5-b8fe-0a98495f2409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:48.442630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae978e-12db-4ee5-b8fe-0a98495f2409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:48.442906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae978e-12db-4ee5-b8fe-0a98495f2409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:48.443209 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae978e-12db-4ee5-b8fe-0a98495f2409 admin admin] PATH_INFO: `/v3/users/4245211c2deb4956a594d898c3ca5b8d` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:48.444540 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae978e-12db-4ee5-b8fe-0a98495f2409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4245211c2deb4956a594d898c3ca5b8d)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:48.446487 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae978e-12db-4ee5-b8fe-0a98495f2409 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:48.496089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cbae978e-12db-4ee5-b8fe-0a98495f2409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4245211c2deb4956a594d898c3ca5b8d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:48.496730 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cbae978e-12db-4ee5-b8fe-0a98495f2409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4245211c2deb4956a594d898c3ca5b8d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:48.507433 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cbae978e-12db-4ee5-b8fe-0a98495f2409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4245211c2deb4956a594d898c3ca5b8d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:48.508349 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cbae978e-12db-4ee5-b8fe-0a98495f2409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4245211c2deb4956a594d898c3ca5b8d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:48.517423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cbae978e-12db-4ee5-b8fe-0a98495f2409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4245211c2deb4956a594d898c3ca5b8d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:48.542570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1114/2245] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:04:48 2021] DELETE /identity/v3/users/4245211c2deb4956a594d898c3ca5b8d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:48.547477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944b5b-3407-4975-b509-bf8c1f8dbe7f None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:48.547907 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944b5b-3407-4975-b509-bf8c1f8dbe7f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:48.548270 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944b5b-3407-4975-b509-bf8c1f8dbe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:48.568210 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-ff944b5b-3407-4975-b509-bf8c1f8dbe7f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:48.569420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ff944b5b-3407-4975-b509-bf8c1f8dbe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:48.637319 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1132/2246] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:48.649983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae978e-12db-4ee5-b8fe-0a98495f2409 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:48.651746 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-cbae978e-12db-4ee5-b8fe-0a98495f2409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:48.714549 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae978e-12db-4ee5-b8fe-0a98495f2409 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:48.719329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ee2a5-18ab-45f1-b46e-d84871323fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:48.720084 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ee2a5-18ab-45f1-b46e-d84871323fcd service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:48.720260 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ee2a5-18ab-45f1-b46e-d84871323fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:48.720529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ee2a5-18ab-45f1-b46e-d84871323fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:48.731613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ee2a5-18ab-45f1-b46e-d84871323fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:48.733071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ee2a5-18ab-45f1-b46e-d84871323fcd service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:48.742898 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1115/2247] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:04:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:04:49.033435 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff944b5b-3407-4975-b509-bf8c1f8dbe7f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:49.035260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ff944b5b-3407-4975-b509-bf8c1f8dbe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:49.048035 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff944b5b-3407-4975-b509-bf8c1f8dbe7f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:49.053550 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:49.054425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:49.054704 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:49.054969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] PATH_INFO: `/v3/projects/70ed042b113045db8f28edda12edb103` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:49.056373 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ed042b113045db8f28edda12edb103)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:49.058433 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:49.109529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ed042b113045db8f28edda12edb103', 'request_id': 'req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.117417 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ed042b113045db8f28edda12edb103', 'request_id': 'req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.124584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ed042b113045db8f28edda12edb103', 'request_id': 'req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.138858 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] The token cache is being invalidate because project 70ed042b113045db8f28edda12edb103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:04:49.139167 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.139819 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.141399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1133/2248] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:04:49 2021] DELETE /identity/v3/projects/70ed042b113045db8f28edda12edb103 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:49.145508 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ee2a5-18ab-45f1-b46e-d84871323fcd service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:49.154970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ee2a5-18ab-45f1-b46e-d84871323fcd service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:49.221674 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41dc89-ee4b-44d5-b542-6ee89e062b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:49.222759 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41dc89-ee4b-44d5-b542-6ee89e062b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:49.223048 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41dc89-ee4b-44d5-b542-6ee89e062b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:49.223356 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41dc89-ee4b-44d5-b542-6ee89e062b07 admin admin] PATH_INFO: `/v3/users/17dd335d51ae401b9328e4b8d887e75c` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:49.224614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41dc89-ee4b-44d5-b542-6ee89e062b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17dd335d51ae401b9328e4b8d887e75c)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:49.226613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41dc89-ee4b-44d5-b542-6ee89e062b07 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:49.280199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-af41dc89-ee4b-44d5-b542-6ee89e062b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17dd335d51ae401b9328e4b8d887e75c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.280897 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-af41dc89-ee4b-44d5-b542-6ee89e062b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17dd335d51ae401b9328e4b8d887e75c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.294090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-af41dc89-ee4b-44d5-b542-6ee89e062b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17dd335d51ae401b9328e4b8d887e75c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.294775 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-af41dc89-ee4b-44d5-b542-6ee89e062b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17dd335d51ae401b9328e4b8d887e75c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.302507 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-af41dc89-ee4b-44d5-b542-6ee89e062b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17dd335d51ae401b9328e4b8d887e75c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.324091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1116/2249] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:04:49 2021] DELETE /identity/v3/users/17dd335d51ae401b9328e4b8d887e75c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:49.608931 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:49.610416 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:49.624674 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbcc80-b0c2-4b68-bff4-92d659f8625d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:49.709334 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:49.710201 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:49.710483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:49.710754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f admin admin] PATH_INFO: `/v3/projects/5b837e25e7744549a83145b9314cf26f` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:49.711990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b837e25e7744549a83145b9314cf26f)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:49.714180 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:49.768810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b837e25e7744549a83145b9314cf26f', 'request_id': 'req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.775173 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b837e25e7744549a83145b9314cf26f', 'request_id': 'req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.780529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b837e25e7744549a83145b9314cf26f', 'request_id': 'req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.794222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f admin admin] The token cache is being invalidate because project 5b837e25e7744549a83145b9314cf26f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:04:49.794662 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.795207 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-24a62910-31ae-46aa-9d0a-1d0bad7fc54f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:49.796840 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1134/2250] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:04:49 2021] DELETE /identity/v3/projects/5b837e25e7744549a83145b9314cf26f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:49.803050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec506c-1875-4e18-9c40-80fed5e56a41 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:49.803542 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec506c-1875-4e18-9c40-80fed5e56a41 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:49.803830 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec506c-1875-4e18-9c40-80fed5e56a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:49.823863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-22ec506c-1875-4e18-9c40-80fed5e56a41 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:49.825180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-22ec506c-1875-4e18-9c40-80fed5e56a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:49.889006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1117/2251] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:04:49.897806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f6f7-e9b4-435e-aa72-c11d376f68f1 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:49.898114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f6f7-e9b4-435e-aa72-c11d376f68f1 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:49.898411 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f6f7-e9b4-435e-aa72-c11d376f68f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:49.917604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-0ab0f6f7-e9b4-435e-aa72-c11d376f68f1 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:49.918834 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0ab0f6f7-e9b4-435e-aa72-c11d376f68f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:49.929566 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1135/2252] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:49.933952 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec506c-1875-4e18-9c40-80fed5e56a41 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:49.943819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec506c-1875-4e18-9c40-80fed5e56a41 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:49.949093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556382a-c623-4c93-8619-8302442b67ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:49.949747 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556382a-c623-4c93-8619-8302442b67ab admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:49.950032 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556382a-c623-4c93-8619-8302442b67ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:49.950307 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556382a-c623-4c93-8619-8302442b67ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:49.951049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556382a-c623-4c93-8619-8302442b67ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:04:49.951383 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556382a-c623-4c93-8619-8302442b67ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:49.952974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556382a-c623-4c93-8619-8302442b67ab admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:49.965222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1118/2253] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:04:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:04:49.970575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0f6f7-e9b4-435e-aa72-c11d376f68f1 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:49.985219 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0f6f7-e9b4-435e-aa72-c11d376f68f1 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:49.993387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716c2f7-e05b-4247-91af-e89f6b0d5536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:49.994057 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716c2f7-e05b-4247-91af-e89f6b0d5536 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:49.994340 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716c2f7-e05b-4247-91af-e89f6b0d5536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:49.994614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716c2f7-e05b-4247-91af-e89f6b0d5536 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:49.995363 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716c2f7-e05b-4247-91af-e89f6b0d5536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:49.997284 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716c2f7-e05b-4247-91af-e89f6b0d5536 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:50.033945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1136/2254] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:04:49 2021] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:04:50.040001 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556382a-c623-4c93-8619-8302442b67ab admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:50.051437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556382a-c623-4c93-8619-8302442b67ab admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:50.113241 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd99ad-7288-4b9a-92d5-61fb52ac555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:50.113932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd99ad-7288-4b9a-92d5-61fb52ac555e admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:50.114216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd99ad-7288-4b9a-92d5-61fb52ac555e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:50.114491 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd99ad-7288-4b9a-92d5-61fb52ac555e admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:50.115235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd99ad-7288-4b9a-92d5-61fb52ac555e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:50.117165 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd99ad-7288-4b9a-92d5-61fb52ac555e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:50.143240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1119/2255] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:04:50 2021] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:04:50.148090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716c2f7-e05b-4247-91af-e89f6b0d5536 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:50.162850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716c2f7-e05b-4247-91af-e89f6b0d5536 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:50.170733 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52dcde-abee-405d-b913-0ceb5f7358ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:50.171495 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52dcde-abee-405d-b913-0ceb5f7358ae admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:50.171828 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52dcde-abee-405d-b913-0ceb5f7358ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:50.172178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52dcde-abee-405d-b913-0ceb5f7358ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:50.173198 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52dcde-abee-405d-b913-0ceb5f7358ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:50.176022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52dcde-abee-405d-b913-0ceb5f7358ae admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:50.187215 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1137/2256] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:50 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:50.191723 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd99ad-7288-4b9a-92d5-61fb52ac555e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:50.202403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd99ad-7288-4b9a-92d5-61fb52ac555e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:50.208196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ba4c6-e40a-4c4d-a06f-f86ad04df902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:50.209007 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ba4c6-e40a-4c4d-a06f-f86ad04df902 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:50.209295 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ba4c6-e40a-4c4d-a06f-f86ad04df902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:50.209576 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ba4c6-e40a-4c4d-a06f-f86ad04df902 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:50.210515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ba4c6-e40a-4c4d-a06f-f86ad04df902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:50.212421 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ba4c6-e40a-4c4d-a06f-f86ad04df902 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:50.223735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1120/2257] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:50 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:50.228105 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52dcde-abee-405d-b913-0ceb5f7358ae admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:50.240398 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52dcde-abee-405d-b913-0ceb5f7358ae admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:50.245321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20720a-03c2-4d7a-b064-ab08ddb15ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:50.246210 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20720a-03c2-4d7a-b064-ab08ddb15ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:50.246491 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20720a-03c2-4d7a-b064-ab08ddb15ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:50.246768 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20720a-03c2-4d7a-b064-ab08ddb15ca0 admin admin] PATH_INFO: `/v3/projects/c607f39d66df489ab706ca40efa35709/users/aa873725fd494813888e3cf975a40207/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:50.263781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20720a-03c2-4d7a-b064-ab08ddb15ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c607f39d66df489ab706ca40efa35709, user_id=aa873725fd494813888e3cf975a40207, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:50.266452 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20720a-03c2-4d7a-b064-ab08ddb15ca0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:50.283318 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1138/2258] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:50 2021] PUT /identity/v3/projects/c607f39d66df489ab706ca40efa35709/users/aa873725fd494813888e3cf975a40207/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:04:50.295401 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67f4c6-ec05-434b-b47c-b3ae45b93c5f None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:50.295690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67f4c6-ec05-434b-b47c-b3ae45b93c5f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:50.295986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67f4c6-ec05-434b-b47c-b3ae45b93c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:50.323891 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-3a67f4c6-ec05-434b-b47c-b3ae45b93c5f None None] MFA Rules not processed for user `aa873725fd494813888e3cf975a40207`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:50.325118 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3a67f4c6-ec05-434b-b47c-b3ae45b93c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:50.401594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1121/2259] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:50 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:50.407963 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20720a-03c2-4d7a-b064-ab08ddb15ca0 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:50.487734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20720a-03c2-4d7a-b064-ab08ddb15ca0 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:50.494084 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28e678-2dd6-473b-a375-cd5fcbcb8379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:50.494678 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e678-2dd6-473b-a375-cd5fcbcb8379 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:50.494952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e678-2dd6-473b-a375-cd5fcbcb8379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:50.495253 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e678-2dd6-473b-a375-cd5fcbcb8379 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:50.495976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28e678-2dd6-473b-a375-cd5fcbcb8379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:50.497870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28e678-2dd6-473b-a375-cd5fcbcb8379 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:50.538208 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1139/2260] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:04:50 2021] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:04:50.542442 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67f4c6-ec05-434b-b47c-b3ae45b93c5f None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:50.559413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67f4c6-ec05-434b-b47c-b3ae45b93c5f None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:50.631909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6092587-9f52-40ab-9cd9-3c420cd6ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:50.632593 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6092587-9f52-40ab-9cd9-3c420cd6ce24 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:50.632873 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6092587-9f52-40ab-9cd9-3c420cd6ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:50.633143 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6092587-9f52-40ab-9cd9-3c420cd6ce24 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:50.633875 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6092587-9f52-40ab-9cd9-3c420cd6ce24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:50.635858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6092587-9f52-40ab-9cd9-3c420cd6ce24 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:50.665657 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1122/2261] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:04:50 2021] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:04:50.666868 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28e678-2dd6-473b-a375-cd5fcbcb8379 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:50.678122 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28e678-2dd6-473b-a375-cd5fcbcb8379 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:50.682937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23031a85-d066-4243-82d0-19546b61b2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:50.683616 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23031a85-d066-4243-82d0-19546b61b2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:50.683902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23031a85-d066-4243-82d0-19546b61b2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:50.684184 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23031a85-d066-4243-82d0-19546b61b2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:50.684932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23031a85-d066-4243-82d0-19546b61b2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:50.686537 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23031a85-d066-4243-82d0-19546b61b2b5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:50.698298 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1140/2262] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:50.702600 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6092587-9f52-40ab-9cd9-3c420cd6ce24 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:50.713740 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6092587-9f52-40ab-9cd9-3c420cd6ce24 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:50.719761 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fffac-072c-4ba1-b11d-b42044ba1b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:50.720662 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fffac-072c-4ba1-b11d-b42044ba1b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:50.720938 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fffac-072c-4ba1-b11d-b42044ba1b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:50.721210 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fffac-072c-4ba1-b11d-b42044ba1b32 admin admin] PATH_INFO: `/v3/projects/bdd5189d1e564aeb9105d035c1d3fb5b/users/7c23786cdccb49a4b016ada8ec2ba64b/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:50.738579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fffac-072c-4ba1-b11d-b42044ba1b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd5189d1e564aeb9105d035c1d3fb5b, user_id=7c23786cdccb49a4b016ada8ec2ba64b, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:50.741288 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fffac-072c-4ba1-b11d-b42044ba1b32 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:50.757429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1123/2263] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:50 2021] PUT /identity/v3/projects/bdd5189d1e564aeb9105d035c1d3fb5b/users/7c23786cdccb49a4b016ada8ec2ba64b/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:50.762071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23031a85-d066-4243-82d0-19546b61b2b5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:50.772259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23031a85-d066-4243-82d0-19546b61b2b5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:50.849336 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e0056-381d-4256-8342-845cd6c0813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:50.850004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0056-381d-4256-8342-845cd6c0813e admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:50.850286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0056-381d-4256-8342-845cd6c0813e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:50.850559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0056-381d-4256-8342-845cd6c0813e admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:50.851353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e0056-381d-4256-8342-845cd6c0813e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:50.853146 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e0056-381d-4256-8342-845cd6c0813e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:50.866241 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1141/2264] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:50 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:50.869669 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fffac-072c-4ba1-b11d-b42044ba1b32 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:50.883276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fffac-072c-4ba1-b11d-b42044ba1b32 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:50.889350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd99ee-f276-44a3-9b8c-d4cc5783db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:50.890316 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd99ee-f276-44a3-9b8c-d4cc5783db23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:50.890606 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd99ee-f276-44a3-9b8c-d4cc5783db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:50.890862 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd99ee-f276-44a3-9b8c-d4cc5783db23 admin admin] PATH_INFO: `/v3/projects/bdd5189d1e564aeb9105d035c1d3fb5b/users/7c23786cdccb49a4b016ada8ec2ba64b/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:50.893824 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd99ee-f276-44a3-9b8c-d4cc5783db23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd5189d1e564aeb9105d035c1d3fb5b, user_id=7c23786cdccb49a4b016ada8ec2ba64b, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:50.897005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd99ee-f276-44a3-9b8c-d4cc5783db23 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:50.908791 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1124/2265] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:50 2021] PUT /identity/v3/projects/bdd5189d1e564aeb9105d035c1d3fb5b/users/7c23786cdccb49a4b016ada8ec2ba64b/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:50.920008 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308745a3-8e74-4977-998b-e82499f87cbc None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:50.920285 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308745a3-8e74-4977-998b-e82499f87cbc None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:50.920558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308745a3-8e74-4977-998b-e82499f87cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:50.963194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-308745a3-8e74-4977-998b-e82499f87cbc None None] MFA Rules not processed for user `7c23786cdccb49a4b016ada8ec2ba64b`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:50.964424 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-308745a3-8e74-4977-998b-e82499f87cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:51.051491 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1142/2266] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:50 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:51.069075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd99ee-f276-44a3-9b8c-d4cc5783db23 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:51.071347 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c4cd99ee-f276-44a3-9b8c-d4cc5783db23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:51.149360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd99ee-f276-44a3-9b8c-d4cc5783db23 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:51.153543 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4e6af-19ba-4614-b225-5f95fdc2b39b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:51.154202 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e6af-19ba-4614-b225-5f95fdc2b39b service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:51.154487 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e6af-19ba-4614-b225-5f95fdc2b39b service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:51.154761 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e6af-19ba-4614-b225-5f95fdc2b39b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:51.165817 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4e6af-19ba-4614-b225-5f95fdc2b39b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:51.167369 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4e6af-19ba-4614-b225-5f95fdc2b39b service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:51.178842 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1125/2267] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:04:51 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:04:51.560836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308745a3-8e74-4977-998b-e82499f87cbc None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:51.572606 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308745a3-8e74-4977-998b-e82499f87cbc None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:51.578647 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81099e7-0e1d-4242-92bc-72526eec879e tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23786cdccb49a4b016ada8ec2ba64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd5189d1e564aeb9105d035c1d3fb5b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:51.579353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81099e7-0e1d-4242-92bc-72526eec879e tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:51.579625 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81099e7-0e1d-4242-92bc-72526eec879e tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:51.579906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81099e7-0e1d-4242-92bc-72526eec879e tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:51.580664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81099e7-0e1d-4242-92bc-72526eec879e tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:04:51.580976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81099e7-0e1d-4242-92bc-72526eec879e tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:51.582594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81099e7-0e1d-4242-92bc-72526eec879e tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:51.596208 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1143/2268] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:04:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:04:51.601286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4e6af-19ba-4614-b225-5f95fdc2b39b service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:51.615203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4e6af-19ba-4614-b225-5f95fdc2b39b service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:51.621992 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47575e9-6a43-4988-9266-ab1accc7bb5f tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23786cdccb49a4b016ada8ec2ba64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd5189d1e564aeb9105d035c1d3fb5b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:51.622647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47575e9-6a43-4988-9266-ab1accc7bb5f tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:51.622941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47575e9-6a43-4988-9266-ab1accc7bb5f tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:51.623237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47575e9-6a43-4988-9266-ab1accc7bb5f tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:51.624614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47575e9-6a43-4988-9266-ab1accc7bb5f tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:51.626537 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47575e9-6a43-4988-9266-ab1accc7bb5f tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:51.659180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1126/2269] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:04:51 2021] POST /identity/v3/projects => generated 354 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:04:51.665847 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81099e7-0e1d-4242-92bc-72526eec879e tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:51.680630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81099e7-0e1d-4242-92bc-72526eec879e tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:51.749939 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ceeea5-2d40-48c3-89e8-63037cac7e59 tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23786cdccb49a4b016ada8ec2ba64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd5189d1e564aeb9105d035c1d3fb5b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:51.750625 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceeea5-2d40-48c3-89e8-63037cac7e59 tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:51.750904 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceeea5-2d40-48c3-89e8-63037cac7e59 tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:51.751247 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceeea5-2d40-48c3-89e8-63037cac7e59 tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:51.752011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ceeea5-2d40-48c3-89e8-63037cac7e59 tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:04:51.752325 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ceeea5-2d40-48c3-89e8-63037cac7e59 tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:51.753922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ceeea5-2d40-48c3-89e8-63037cac7e59 tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:51.766809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1144/2270] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:04:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:04:51.803791 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47575e9-6a43-4988-9266-ab1accc7bb5f tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:51.814242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47575e9-6a43-4988-9266-ab1accc7bb5f tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:51.821810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ed9cb-8664-4914-b878-4eacf119d88b tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c23786cdccb49a4b016ada8ec2ba64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdd5189d1e564aeb9105d035c1d3fb5b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:51.821810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ed9cb-8664-4914-b878-4eacf119d88b tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:51.821810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ed9cb-8664-4914-b878-4eacf119d88b tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:51.822150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ed9cb-8664-4914-b878-4eacf119d88b tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] PATH_INFO: `/v3/projects/e7e4dc7ec62c4c49add2e52017854383` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:51.822150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ed9cb-8664-4914-b878-4eacf119d88b tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e7e4dc7ec62c4c49add2e52017854383)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:51.823947 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ed9cb-8664-4914-b878-4eacf119d88b tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:51.881907 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-7c7ed9cb-8664-4914-b878-4eacf119d88b tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e4dc7ec62c4c49add2e52017854383', 'request_id': 'req-7c7ed9cb-8664-4914-b878-4eacf119d88b'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:51.889251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-7c7ed9cb-8664-4914-b878-4eacf119d88b tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e4dc7ec62c4c49add2e52017854383', 'request_id': 'req-7c7ed9cb-8664-4914-b878-4eacf119d88b'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:51.894954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-7c7ed9cb-8664-4914-b878-4eacf119d88b tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e4dc7ec62c4c49add2e52017854383', 'request_id': 'req-7c7ed9cb-8664-4914-b878-4eacf119d88b'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:51.908437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-7c7ed9cb-8664-4914-b878-4eacf119d88b tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] The token cache is being invalidate because project e7e4dc7ec62c4c49add2e52017854383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:04:51.908721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-7c7ed9cb-8664-4914-b878-4eacf119d88b tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:51.909342 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-7c7ed9cb-8664-4914-b878-4eacf119d88b tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:51.910890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1127/2271] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:04:51 2021] DELETE /identity/v3/projects/e7e4dc7ec62c4c49add2e52017854383 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:52.136101 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ceeea5-2d40-48c3-89e8-63037cac7e59 tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:52.139452 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a0ceeea5-2d40-48c3-89e8-63037cac7e59 tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:52.222294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ceeea5-2d40-48c3-89e8-63037cac7e59 tempest-VolumeQuotaClassesTest-234297188 tempest-VolumeQuotaClassesTest-234297188-project-admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:52.282024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b02f98-01c3-420f-8666-1133cdd77b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:52.282934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b02f98-01c3-420f-8666-1133cdd77b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:52.283244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b02f98-01c3-420f-8666-1133cdd77b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:52.283516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b02f98-01c3-420f-8666-1133cdd77b77 admin admin] PATH_INFO: `/v3/users/aa873725fd494813888e3cf975a40207` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:52.284906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b02f98-01c3-420f-8666-1133cdd77b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa873725fd494813888e3cf975a40207)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:52.287115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b02f98-01c3-420f-8666-1133cdd77b77 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:52.337712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-36b02f98-01c3-420f-8666-1133cdd77b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa873725fd494813888e3cf975a40207'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:52.338387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-36b02f98-01c3-420f-8666-1133cdd77b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa873725fd494813888e3cf975a40207'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:52.346405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-36b02f98-01c3-420f-8666-1133cdd77b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa873725fd494813888e3cf975a40207'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:52.347178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-36b02f98-01c3-420f-8666-1133cdd77b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa873725fd494813888e3cf975a40207'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:52.361385 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-36b02f98-01c3-420f-8666-1133cdd77b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa873725fd494813888e3cf975a40207'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:52.374839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1145/2272] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:04:52 2021] DELETE /identity/v3/users/aa873725fd494813888e3cf975a40207 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:52.379730 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c0f4-7f3c-480f-a55d-20abd84e8643 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:52.380015 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c0f4-7f3c-480f-a55d-20abd84e8643 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:52.380291 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c0f4-7f3c-480f-a55d-20abd84e8643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:52.400393 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-35e7c0f4-7f3c-480f-a55d-20abd84e8643 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:52.401611 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-35e7c0f4-7f3c-480f-a55d-20abd84e8643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:52.464783 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1128/2273] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:52.477077 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b02f98-01c3-420f-8666-1133cdd77b77 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:52.479802 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-36b02f98-01c3-420f-8666-1133cdd77b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:52.549039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b02f98-01c3-420f-8666-1133cdd77b77 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:52.553419 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047964b-9e57-49bb-bf7f-01f9e0411205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:52.554231 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047964b-9e57-49bb-bf7f-01f9e0411205 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:52.554381 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047964b-9e57-49bb-bf7f-01f9e0411205 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:52.554686 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047964b-9e57-49bb-bf7f-01f9e0411205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:52.564845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047964b-9e57-49bb-bf7f-01f9e0411205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:52.566609 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047964b-9e57-49bb-bf7f-01f9e0411205 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:52.577555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1146/2274] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:04:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:04:52.879049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7c0f4-7f3c-480f-a55d-20abd84e8643 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:52.882572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-35e7c0f4-7f3c-480f-a55d-20abd84e8643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:52.920839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7c0f4-7f3c-480f-a55d-20abd84e8643 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:52.931463 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:52.931973 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:52.932261 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:52.932532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] PATH_INFO: `/v3/projects/c607f39d66df489ab706ca40efa35709` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:52.934464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c607f39d66df489ab706ca40efa35709)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:52.937700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:53.003703 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c607f39d66df489ab706ca40efa35709', 'request_id': 'req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.012951 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c607f39d66df489ab706ca40efa35709', 'request_id': 'req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.023607 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c607f39d66df489ab706ca40efa35709', 'request_id': 'req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.039356 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] The token cache is being invalidate because project c607f39d66df489ab706ca40efa35709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:04:53.039706 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.040413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.042129 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1129/2275] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:04:52 2021] DELETE /identity/v3/projects/c607f39d66df489ab706ca40efa35709 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:53.052835 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047964b-9e57-49bb-bf7f-01f9e0411205 service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:53.064046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047964b-9e57-49bb-bf7f-01f9e0411205 service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:53.125946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbee638-e016-414c-b061-0cefa9ac4ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:53.126825 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbee638-e016-414c-b061-0cefa9ac4ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:53.127109 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbee638-e016-414c-b061-0cefa9ac4ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:53.127437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbee638-e016-414c-b061-0cefa9ac4ee6 admin admin] PATH_INFO: `/v3/users/7c23786cdccb49a4b016ada8ec2ba64b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:53.128634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbee638-e016-414c-b061-0cefa9ac4ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c23786cdccb49a4b016ada8ec2ba64b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:53.130612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbee638-e016-414c-b061-0cefa9ac4ee6 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:53.183669 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-5dbee638-e016-414c-b061-0cefa9ac4ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c23786cdccb49a4b016ada8ec2ba64b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.184356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-5dbee638-e016-414c-b061-0cefa9ac4ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c23786cdccb49a4b016ada8ec2ba64b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.192137 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-5dbee638-e016-414c-b061-0cefa9ac4ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c23786cdccb49a4b016ada8ec2ba64b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.193213 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-5dbee638-e016-414c-b061-0cefa9ac4ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c23786cdccb49a4b016ada8ec2ba64b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.210337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-5dbee638-e016-414c-b061-0cefa9ac4ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c23786cdccb49a4b016ada8ec2ba64b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.225214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1147/2276] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:04:53 2021] DELETE /identity/v3/users/7c23786cdccb49a4b016ada8ec2ba64b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:53.518289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:53.519794 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:53.534285 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e8936-32b7-41aa-8c6a-76f4cf042c6d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:53.590861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:53.591767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:53.592045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:53.592474 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f admin admin] PATH_INFO: `/v3/projects/bdd5189d1e564aeb9105d035c1d3fb5b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:53.593825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd5189d1e564aeb9105d035c1d3fb5b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:53.595981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:53.644329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd5189d1e564aeb9105d035c1d3fb5b', 'request_id': 'req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.650716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd5189d1e564aeb9105d035c1d3fb5b', 'request_id': 'req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.656387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd5189d1e564aeb9105d035c1d3fb5b', 'request_id': 'req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.672530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f admin admin] The token cache is being invalidate because project bdd5189d1e564aeb9105d035c1d3fb5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:04:53.672816 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.673419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9aa77115-e9b5-45e0-8e3c-abfd600f9b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:53.674969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1130/2277] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:04:53 2021] DELETE /identity/v3/projects/bdd5189d1e564aeb9105d035c1d3fb5b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:53.681507 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fd821-0e5f-4a50-86c5-8d58cb050975 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:53.681958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fd821-0e5f-4a50-86c5-8d58cb050975 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:53.682438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fd821-0e5f-4a50-86c5-8d58cb050975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:53.701365 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-052fd821-0e5f-4a50-86c5-8d58cb050975 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:53.702731 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-052fd821-0e5f-4a50-86c5-8d58cb050975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:53.779584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1148/2278] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:53.791116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20030a-f659-4390-90cb-5ba6651a285f None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:53.791433 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20030a-f659-4390-90cb-5ba6651a285f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:53.791726 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20030a-f659-4390-90cb-5ba6651a285f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:53.811700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-3a20030a-f659-4390-90cb-5ba6651a285f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:53.812916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3a20030a-f659-4390-90cb-5ba6651a285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:53.822259 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1131/2279] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:53.826715 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fd821-0e5f-4a50-86c5-8d58cb050975 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:53.837008 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fd821-0e5f-4a50-86c5-8d58cb050975 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:53.842979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f9848-b65c-4a4d-89de-948f7a238512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:53.843673 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f9848-b65c-4a4d-89de-948f7a238512 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:53.843963 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f9848-b65c-4a4d-89de-948f7a238512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:53.844229 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f9848-b65c-4a4d-89de-948f7a238512 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:53.844970 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f9848-b65c-4a4d-89de-948f7a238512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:04:53.845276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f9848-b65c-4a4d-89de-948f7a238512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:53.846889 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f9848-b65c-4a4d-89de-948f7a238512 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:53.863549 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1149/2280] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:04:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:04:53.868942 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20030a-f659-4390-90cb-5ba6651a285f None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:53.878521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20030a-f659-4390-90cb-5ba6651a285f None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:53.886663 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d15209-3a99-4367-ba5d-697d8d42a447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:53.887339 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d15209-3a99-4367-ba5d-697d8d42a447 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:53.887637 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d15209-3a99-4367-ba5d-697d8d42a447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:53.887908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d15209-3a99-4367-ba5d-697d8d42a447 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:53.888625 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d15209-3a99-4367-ba5d-697d8d42a447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:53.890541 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d15209-3a99-4367-ba5d-697d8d42a447 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:53.919017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1132/2281] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:04:53 2021] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:04:53.923479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f9848-b65c-4a4d-89de-948f7a238512 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:53.936595 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f9848-b65c-4a4d-89de-948f7a238512 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:54.011532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc440e-a828-4446-bb63-92019c938860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:54.012246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc440e-a828-4446-bb63-92019c938860 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:54.012524 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc440e-a828-4446-bb63-92019c938860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:54.012793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc440e-a828-4446-bb63-92019c938860 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:54.013514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc440e-a828-4446-bb63-92019c938860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:54.015478 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc440e-a828-4446-bb63-92019c938860 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:54.038226 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1150/2282] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:04:53 2021] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:04:54.042777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d15209-3a99-4367-ba5d-697d8d42a447 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:54.054034 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d15209-3a99-4367-ba5d-697d8d42a447 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:54.059678 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdddc8b-68c8-4c86-8c35-cd58ffa28c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:54.060414 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdddc8b-68c8-4c86-8c35-cd58ffa28c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:54.060710 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdddc8b-68c8-4c86-8c35-cd58ffa28c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:54.060992 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdddc8b-68c8-4c86-8c35-cd58ffa28c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:54.062033 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdddc8b-68c8-4c86-8c35-cd58ffa28c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:54.065418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdddc8b-68c8-4c86-8c35-cd58ffa28c69 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:54.075914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1133/2283] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:54 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:54.080136 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc440e-a828-4446-bb63-92019c938860 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:54.098330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc440e-a828-4446-bb63-92019c938860 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:54.108869 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8196ef-d241-45ba-a6cf-3051417d96b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:54.109840 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8196ef-d241-45ba-a6cf-3051417d96b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:54.110110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8196ef-d241-45ba-a6cf-3051417d96b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:54.110358 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8196ef-d241-45ba-a6cf-3051417d96b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:54.111146 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8196ef-d241-45ba-a6cf-3051417d96b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:54.114161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8196ef-d241-45ba-a6cf-3051417d96b9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:54.126373 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1151/2284] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:54 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:54.131018 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdddc8b-68c8-4c86-8c35-cd58ffa28c69 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:54.143648 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdddc8b-68c8-4c86-8c35-cd58ffa28c69 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:54.151329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192684b0-c289-4d83-a59b-e604fd055bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:54.152554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192684b0-c289-4d83-a59b-e604fd055bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:54.152810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192684b0-c289-4d83-a59b-e604fd055bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:54.153102 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192684b0-c289-4d83-a59b-e604fd055bcf admin admin] PATH_INFO: `/v3/projects/417ac5241b394a12bcd78be41d6821b9/users/a8f4319dabe2401690314ed214e1d0b0/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:54.184115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192684b0-c289-4d83-a59b-e604fd055bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=417ac5241b394a12bcd78be41d6821b9, user_id=a8f4319dabe2401690314ed214e1d0b0, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:54.189759 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192684b0-c289-4d83-a59b-e604fd055bcf admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:54.220377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1134/2285] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:54 2021] PUT /identity/v3/projects/417ac5241b394a12bcd78be41d6821b9/users/a8f4319dabe2401690314ed214e1d0b0/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:04:54.245432 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2baa0-d9c5-4243-a7d0-fb28bbf0e2d7 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:54.245940 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2baa0-d9c5-4243-a7d0-fb28bbf0e2d7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:54.246050 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2baa0-d9c5-4243-a7d0-fb28bbf0e2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:54.289291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-62a2baa0-d9c5-4243-a7d0-fb28bbf0e2d7 None None] MFA Rules not processed for user `a8f4319dabe2401690314ed214e1d0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:54.291264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-62a2baa0-d9c5-4243-a7d0-fb28bbf0e2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:54.291694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192684b0-c289-4d83-a59b-e604fd055bcf admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:54.293867 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-192684b0-c289-4d83-a59b-e604fd055bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:54.381830 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1152/2286] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:54 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:54.386599 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192684b0-c289-4d83-a59b-e604fd055bcf admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:54.392668 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431bde2-d8dc-467f-b501-9375bb456902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:54.395223 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2baa0-d9c5-4243-a7d0-fb28bbf0e2d7 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:54.395699 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431bde2-d8dc-467f-b501-9375bb456902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:54.396337 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431bde2-d8dc-467f-b501-9375bb456902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:54.396609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431bde2-d8dc-467f-b501-9375bb456902 admin admin] PATH_INFO: `/v3/users/424623fef9df40c8ada2c850d7aa8fbb` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:54.397116 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-62a2baa0-d9c5-4243-a7d0-fb28bbf0e2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:54.398286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431bde2-d8dc-467f-b501-9375bb456902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=424623fef9df40c8ada2c850d7aa8fbb)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:54.400491 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431bde2-d8dc-467f-b501-9375bb456902 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:54.455428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0431bde2-d8dc-467f-b501-9375bb456902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '424623fef9df40c8ada2c850d7aa8fbb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:54.456110 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0431bde2-d8dc-467f-b501-9375bb456902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '424623fef9df40c8ada2c850d7aa8fbb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:54.467740 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0431bde2-d8dc-467f-b501-9375bb456902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '424623fef9df40c8ada2c850d7aa8fbb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:54.468502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0431bde2-d8dc-467f-b501-9375bb456902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '424623fef9df40c8ada2c850d7aa8fbb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:54.471996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2baa0-d9c5-4243-a7d0-fb28bbf0e2d7 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:54.476222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82c0f9-613d-4e95-86ba-128a4a7a8630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:54.477031 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82c0f9-613d-4e95-86ba-128a4a7a8630 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:54.477309 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82c0f9-613d-4e95-86ba-128a4a7a8630 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:54.477586 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0431bde2-d8dc-467f-b501-9375bb456902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '424623fef9df40c8ada2c850d7aa8fbb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:54.477746 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82c0f9-613d-4e95-86ba-128a4a7a8630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:54.479542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-bf82c0f9-613d-4e95-86ba-128a4a7a8630 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:54.491370 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82c0f9-613d-4e95-86ba-128a4a7a8630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:54.492799 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82c0f9-613d-4e95-86ba-128a4a7a8630 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:54.500323 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1135/2287] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:04:54 2021] DELETE /identity/v3/users/424623fef9df40c8ada2c850d7aa8fbb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:54.502333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e9b74-77a5-4f95-a8a8-0abe1fd3cbf3 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:54.502789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1153/2288] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:04:54 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:04:54.502915 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e9b74-77a5-4f95-a8a8-0abe1fd3cbf3 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:54.503281 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e9b74-77a5-4f95-a8a8-0abe1fd3cbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:54.523194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-d93e9b74-77a5-4f95-a8a8-0abe1fd3cbf3 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:54.524463 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d93e9b74-77a5-4f95-a8a8-0abe1fd3cbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:54.609413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1136/2289] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:54.624415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82c0f9-613d-4e95-86ba-128a4a7a8630 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:54.626797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-bf82c0f9-613d-4e95-86ba-128a4a7a8630 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:54.705222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82c0f9-613d-4e95-86ba-128a4a7a8630 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:54.762980 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46d66d-098f-4fe5-9d94-f96fd899c4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:54.764221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46d66d-098f-4fe5-9d94-f96fd899c4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:54.764690 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46d66d-098f-4fe5-9d94-f96fd899c4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:54.765185 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46d66d-098f-4fe5-9d94-f96fd899c4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:54.779118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46d66d-098f-4fe5-9d94-f96fd899c4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:54.782205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46d66d-098f-4fe5-9d94-f96fd899c4f5 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:54.793465 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1154/2290] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:04:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:04:55.093023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e9b74-77a5-4f95-a8a8-0abe1fd3cbf3 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:55.095423 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d93e9b74-77a5-4f95-a8a8-0abe1fd3cbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:55.110438 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e9b74-77a5-4f95-a8a8-0abe1fd3cbf3 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:55.115922 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7799a-e1fd-4eec-bde3-75e9d05f644d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:55.116819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7799a-e1fd-4eec-bde3-75e9d05f644d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:55.117094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7799a-e1fd-4eec-bde3-75e9d05f644d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:55.117499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7799a-e1fd-4eec-bde3-75e9d05f644d admin admin] PATH_INFO: `/v3/projects/a7f4367ed9294c10b18755ea96c8c318` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:55.118778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7799a-e1fd-4eec-bde3-75e9d05f644d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f4367ed9294c10b18755ea96c8c318)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:55.120804 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7799a-e1fd-4eec-bde3-75e9d05f644d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:55.179891 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-72c7799a-e1fd-4eec-bde3-75e9d05f644d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f4367ed9294c10b18755ea96c8c318', 'request_id': 'req-72c7799a-e1fd-4eec-bde3-75e9d05f644d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:55.186459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-72c7799a-e1fd-4eec-bde3-75e9d05f644d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f4367ed9294c10b18755ea96c8c318', 'request_id': 'req-72c7799a-e1fd-4eec-bde3-75e9d05f644d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:55.192270 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-72c7799a-e1fd-4eec-bde3-75e9d05f644d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f4367ed9294c10b18755ea96c8c318', 'request_id': 'req-72c7799a-e1fd-4eec-bde3-75e9d05f644d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:55.206060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-72c7799a-e1fd-4eec-bde3-75e9d05f644d admin admin] The token cache is being invalidate because project a7f4367ed9294c10b18755ea96c8c318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:04:55.206345 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-72c7799a-e1fd-4eec-bde3-75e9d05f644d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:55.207030 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-72c7799a-e1fd-4eec-bde3-75e9d05f644d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:55.208800 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1137/2291] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:04:55 2021] DELETE /identity/v3/projects/a7f4367ed9294c10b18755ea96c8c318 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:04:55.214979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ac17f-959d-4e9b-83ee-7a1a1a957e98 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:55.215307 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ac17f-959d-4e9b-83ee-7a1a1a957e98 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:55.215589 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ac17f-959d-4e9b-83ee-7a1a1a957e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:55.237945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-fc3ac17f-959d-4e9b-83ee-7a1a1a957e98 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:55.239165 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-fc3ac17f-959d-4e9b-83ee-7a1a1a957e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:55.305360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1155/2292] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:55.313874 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29a8c2-5244-48d5-8829-acd6a6f820d0 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:55.314163 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29a8c2-5244-48d5-8829-acd6a6f820d0 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:55.314442 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29a8c2-5244-48d5-8829-acd6a6f820d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:55.333755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-2c29a8c2-5244-48d5-8829-acd6a6f820d0 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:55.335091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2c29a8c2-5244-48d5-8829-acd6a6f820d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:55.344559 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1138/2293] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:55.349090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ac17f-959d-4e9b-83ee-7a1a1a957e98 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:55.359254 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ac17f-959d-4e9b-83ee-7a1a1a957e98 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:55.364895 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f42a40-8826-4caf-846c-8f3a6a8733c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:55.365549 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f42a40-8826-4caf-846c-8f3a6a8733c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:55.365849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f42a40-8826-4caf-846c-8f3a6a8733c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:55.366120 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f42a40-8826-4caf-846c-8f3a6a8733c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:55.366862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f42a40-8826-4caf-846c-8f3a6a8733c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:04:55.367161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f42a40-8826-4caf-846c-8f3a6a8733c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:55.368797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f42a40-8826-4caf-846c-8f3a6a8733c4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:55.381205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1156/2294] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:04:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:04:55.386588 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29a8c2-5244-48d5-8829-acd6a6f820d0 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:55.399174 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29a8c2-5244-48d5-8829-acd6a6f820d0 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:55.404977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ebe66-8d6c-4efb-89bb-ccd0cd303b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:55.405639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ebe66-8d6c-4efb-89bb-ccd0cd303b4b admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:55.405922 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ebe66-8d6c-4efb-89bb-ccd0cd303b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:55.406194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ebe66-8d6c-4efb-89bb-ccd0cd303b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:55.407024 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ebe66-8d6c-4efb-89bb-ccd0cd303b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:55.408991 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ebe66-8d6c-4efb-89bb-ccd0cd303b4b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:55.439233 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1139/2295] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:04:55 2021] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:04:55.443899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f42a40-8826-4caf-846c-8f3a6a8733c4 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:55.454694 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f42a40-8826-4caf-846c-8f3a6a8733c4 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:55.517529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40cfb1-943e-4af4-bc14-a4ee3f57457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:55.518472 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40cfb1-943e-4af4-bc14-a4ee3f57457b admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:55.518853 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40cfb1-943e-4af4-bc14-a4ee3f57457b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:55.519233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40cfb1-943e-4af4-bc14-a4ee3f57457b admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:55.520253 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40cfb1-943e-4af4-bc14-a4ee3f57457b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:55.523340 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40cfb1-943e-4af4-bc14-a4ee3f57457b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:55.550809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1157/2296] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:04:55 2021] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:04:55.556168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ebe66-8d6c-4efb-89bb-ccd0cd303b4b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:55.566696 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ebe66-8d6c-4efb-89bb-ccd0cd303b4b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:55.571616 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8213ea6-c471-4f0f-b4b1-226f237d058b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:55.572275 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8213ea6-c471-4f0f-b4b1-226f237d058b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:55.572553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8213ea6-c471-4f0f-b4b1-226f237d058b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:55.572826 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8213ea6-c471-4f0f-b4b1-226f237d058b admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:55.573567 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8213ea6-c471-4f0f-b4b1-226f237d058b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:55.575224 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8213ea6-c471-4f0f-b4b1-226f237d058b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:55.585800 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1140/2297] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:04:55.590150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40cfb1-943e-4af4-bc14-a4ee3f57457b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:55.600443 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40cfb1-943e-4af4-bc14-a4ee3f57457b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:55.606764 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf7e18-4ed6-4667-8902-b387ee3ed3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:55.607461 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf7e18-4ed6-4667-8902-b387ee3ed3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:55.607738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf7e18-4ed6-4667-8902-b387ee3ed3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:55.608249 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf7e18-4ed6-4667-8902-b387ee3ed3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:55.608736 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf7e18-4ed6-4667-8902-b387ee3ed3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:55.610328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf7e18-4ed6-4667-8902-b387ee3ed3f5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:55.623752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1158/2298] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:55 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:55.626315 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8213ea6-c471-4f0f-b4b1-226f237d058b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:55.638469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8213ea6-c471-4f0f-b4b1-226f237d058b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:55.644535 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7c407-54b6-4056-9fc5-944d0592156b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:55.645426 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7c407-54b6-4056-9fc5-944d0592156b admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:55.645707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7c407-54b6-4056-9fc5-944d0592156b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:55.645980 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7c407-54b6-4056-9fc5-944d0592156b admin admin] PATH_INFO: `/v3/projects/b4bcf30cba6943f9a19c18b1d1c2a5aa/users/a982c626c5234f6b8a79106afae1ca67/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:55.662289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7c407-54b6-4056-9fc5-944d0592156b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4bcf30cba6943f9a19c18b1d1c2a5aa, user_id=a982c626c5234f6b8a79106afae1ca67, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:55.665054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7c407-54b6-4056-9fc5-944d0592156b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:55.678635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1141/2299] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:55 2021] PUT /identity/v3/projects/b4bcf30cba6943f9a19c18b1d1c2a5aa/users/a982c626c5234f6b8a79106afae1ca67/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:04:55.689001 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a66eca-b877-49a4-9c65-09c1a8eed47e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:55.689287 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a66eca-b877-49a4-9c65-09c1a8eed47e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:55.689752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a66eca-b877-49a4-9c65-09c1a8eed47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:55.717382 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-28a66eca-b877-49a4-9c65-09c1a8eed47e None None] MFA Rules not processed for user `a982c626c5234f6b8a79106afae1ca67`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:55.718590 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-28a66eca-b877-49a4-9c65-09c1a8eed47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:55.787929 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1159/2300] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:55 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:55.792589 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7c407-54b6-4056-9fc5-944d0592156b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:55.855012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7c407-54b6-4056-9fc5-944d0592156b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:55.860350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0fe81-a5ca-4da6-8cbc-d5da56b8d07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:55.861012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0fe81-a5ca-4da6-8cbc-d5da56b8d07f admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:55.861294 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0fe81-a5ca-4da6-8cbc-d5da56b8d07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:55.861569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0fe81-a5ca-4da6-8cbc-d5da56b8d07f admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:55.862288 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0fe81-a5ca-4da6-8cbc-d5da56b8d07f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:55.864314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0fe81-a5ca-4da6-8cbc-d5da56b8d07f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:55.899504 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1142/2301] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:04:55 2021] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:04:55.900772 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a66eca-b877-49a4-9c65-09c1a8eed47e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:55.912387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a66eca-b877-49a4-9c65-09c1a8eed47e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:55.974081 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0428ad0-9850-4f19-9b41-bdcb26699278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:55.975055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0428ad0-9850-4f19-9b41-bdcb26699278 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:55.975368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0428ad0-9850-4f19-9b41-bdcb26699278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:55.975652 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0428ad0-9850-4f19-9b41-bdcb26699278 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:55.976354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0428ad0-9850-4f19-9b41-bdcb26699278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:55.978302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0428ad0-9850-4f19-9b41-bdcb26699278 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:55.999133 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1160/2302] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:04:55 2021] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:04:56.003222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0fe81-a5ca-4da6-8cbc-d5da56b8d07f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:56.014737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0fe81-a5ca-4da6-8cbc-d5da56b8d07f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:56.020401 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eb711-4f29-4b67-96e2-89742258fa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:56.021552 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb711-4f29-4b67-96e2-89742258fa34 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:56.021794 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb711-4f29-4b67-96e2-89742258fa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:56.022186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb711-4f29-4b67-96e2-89742258fa34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:56.023049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eb711-4f29-4b67-96e2-89742258fa34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:56.025162 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eb711-4f29-4b67-96e2-89742258fa34 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:56.035790 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1143/2303] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:56 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:56.042185 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0428ad0-9850-4f19-9b41-bdcb26699278 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:56.053037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0428ad0-9850-4f19-9b41-bdcb26699278 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:56.058512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae6b81-5363-493f-9016-b4ab7b657115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:56.059465 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae6b81-5363-493f-9016-b4ab7b657115 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:56.059733 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae6b81-5363-493f-9016-b4ab7b657115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:56.060015 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae6b81-5363-493f-9016-b4ab7b657115 admin admin] PATH_INFO: `/v3/projects/74a30c4f674346b5884e2ada85ee34b3/users/94b1d89b11b24fb58c2b13de70245f48/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:56.078443 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae6b81-5363-493f-9016-b4ab7b657115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a30c4f674346b5884e2ada85ee34b3, user_id=94b1d89b11b24fb58c2b13de70245f48, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:56.081161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae6b81-5363-493f-9016-b4ab7b657115 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:56.097295 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1161/2304] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:56 2021] PUT /identity/v3/projects/74a30c4f674346b5884e2ada85ee34b3/users/94b1d89b11b24fb58c2b13de70245f48/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:56.103426 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eb711-4f29-4b67-96e2-89742258fa34 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:56.116598 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eb711-4f29-4b67-96e2-89742258fa34 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:56.175800 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b9069-3744-4e8e-a8ef-deac2e6d3231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:56.176471 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b9069-3744-4e8e-a8ef-deac2e6d3231 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:56.176749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b9069-3744-4e8e-a8ef-deac2e6d3231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:56.177191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b9069-3744-4e8e-a8ef-deac2e6d3231 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:56.177877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b9069-3744-4e8e-a8ef-deac2e6d3231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:56.179517 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b9069-3744-4e8e-a8ef-deac2e6d3231 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:56.194330 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1144/2305] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:56 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:04:56.200593 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae6b81-5363-493f-9016-b4ab7b657115 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:56.212900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae6b81-5363-493f-9016-b4ab7b657115 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:56.218247 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36b6f-9a68-44f4-ade9-d57e290c5200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:56.219194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36b6f-9a68-44f4-ade9-d57e290c5200 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:56.219480 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36b6f-9a68-44f4-ade9-d57e290c5200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:56.219754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36b6f-9a68-44f4-ade9-d57e290c5200 admin admin] PATH_INFO: `/v3/projects/74a30c4f674346b5884e2ada85ee34b3/users/94b1d89b11b24fb58c2b13de70245f48/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:56.221950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b36b6f-9a68-44f4-ade9-d57e290c5200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a30c4f674346b5884e2ada85ee34b3, user_id=94b1d89b11b24fb58c2b13de70245f48, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:56.225306 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b36b6f-9a68-44f4-ade9-d57e290c5200 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:56.237368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1162/2306] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:56 2021] PUT /identity/v3/projects/74a30c4f674346b5884e2ada85ee34b3/users/94b1d89b11b24fb58c2b13de70245f48/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:56.249457 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7647c2-93a3-4769-8113-1688a066a597 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:56.249753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7647c2-93a3-4769-8113-1688a066a597 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:56.250033 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7647c2-93a3-4769-8113-1688a066a597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:56.285906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-1e7647c2-93a3-4769-8113-1688a066a597 None None] MFA Rules not processed for user `94b1d89b11b24fb58c2b13de70245f48`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:56.287427 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1e7647c2-93a3-4769-8113-1688a066a597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:56.360793 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1145/2307] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:56 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:56.371630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36b6f-9a68-44f4-ade9-d57e290c5200 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:56.373730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-76b36b6f-9a68-44f4-ade9-d57e290c5200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:56.435340 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36b6f-9a68-44f4-ade9-d57e290c5200 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:56.440636 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c78c4-f325-4949-807a-81f664665c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:56.441307 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c78c4-f325-4949-807a-81f664665c7f service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:56.441611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c78c4-f325-4949-807a-81f664665c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:56.441869 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c78c4-f325-4949-807a-81f664665c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:56.452454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c78c4-f325-4949-807a-81f664665c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:56.453896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c78c4-f325-4949-807a-81f664665c7f service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:56.463756 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1163/2308] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:04:56 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:04:56.785269 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7647c2-93a3-4769-8113-1688a066a597 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:56.851049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7647c2-93a3-4769-8113-1688a066a597 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:56.855804 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540678d-b6c0-4e07-b8cf-4863327d3a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:56.856705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540678d-b6c0-4e07-b8cf-4863327d3a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:56.856998 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540678d-b6c0-4e07-b8cf-4863327d3a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:56.857312 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540678d-b6c0-4e07-b8cf-4863327d3a88 admin admin] PATH_INFO: `/v3/users/a982c626c5234f6b8a79106afae1ca67` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:56.858576 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540678d-b6c0-4e07-b8cf-4863327d3a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a982c626c5234f6b8a79106afae1ca67)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:56.860534 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540678d-b6c0-4e07-b8cf-4863327d3a88 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:56.912974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9540678d-b6c0-4e07-b8cf-4863327d3a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a982c626c5234f6b8a79106afae1ca67'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:56.913823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9540678d-b6c0-4e07-b8cf-4863327d3a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a982c626c5234f6b8a79106afae1ca67'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:56.922693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9540678d-b6c0-4e07-b8cf-4863327d3a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a982c626c5234f6b8a79106afae1ca67'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:56.923360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9540678d-b6c0-4e07-b8cf-4863327d3a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a982c626c5234f6b8a79106afae1ca67'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:56.932546 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9540678d-b6c0-4e07-b8cf-4863327d3a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a982c626c5234f6b8a79106afae1ca67'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:56.952089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1146/2309] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:04:56 2021] DELETE /identity/v3/users/a982c626c5234f6b8a79106afae1ca67 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:56.956720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae27946-7c8a-4ae5-89d8-b2674457c53b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:56.957009 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae27946-7c8a-4ae5-89d8-b2674457c53b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:56.957272 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae27946-7c8a-4ae5-89d8-b2674457c53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:56.975583 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-aae27946-7c8a-4ae5-89d8-b2674457c53b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:56.976790 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-aae27946-7c8a-4ae5-89d8-b2674457c53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:57.038854 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1164/2310] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:57.051633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540678d-b6c0-4e07-b8cf-4863327d3a88 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:57.053340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9540678d-b6c0-4e07-b8cf-4863327d3a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:57.119991 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540678d-b6c0-4e07-b8cf-4863327d3a88 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:57.124398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9d456-a7c9-4e9c-80e1-4673ee67500d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:57.125038 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9d456-a7c9-4e9c-80e1-4673ee67500d service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:57.125312 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9d456-a7c9-4e9c-80e1-4673ee67500d service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:57.125582 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9d456-a7c9-4e9c-80e1-4673ee67500d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:57.135479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9d456-a7c9-4e9c-80e1-4673ee67500d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:57.137207 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9d456-a7c9-4e9c-80e1-4673ee67500d service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:57.146498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1147/2311] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:04:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:04:57.434950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae27946-7c8a-4ae5-89d8-b2674457c53b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:57.436470 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-aae27946-7c8a-4ae5-89d8-b2674457c53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:57.448800 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae27946-7c8a-4ae5-89d8-b2674457c53b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:57.454165 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:57.455033 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:57.455345 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:57.455612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] PATH_INFO: `/v3/projects/b4bcf30cba6943f9a19c18b1d1c2a5aa` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:57.456953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4bcf30cba6943f9a19c18b1d1c2a5aa)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:57.459228 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:57.506317 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4bcf30cba6943f9a19c18b1d1c2a5aa', 'request_id': 'req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:57.512761 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4bcf30cba6943f9a19c18b1d1c2a5aa', 'request_id': 'req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:57.518158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4bcf30cba6943f9a19c18b1d1c2a5aa', 'request_id': 'req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:57.530151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] The token cache is being invalidate because project b4bcf30cba6943f9a19c18b1d1c2a5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:04:57.530433 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:57.531040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:57.532602 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1165/2312] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:04:57 2021] DELETE /identity/v3/projects/b4bcf30cba6943f9a19c18b1d1c2a5aa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:57.537018 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9d456-a7c9-4e9c-80e1-4673ee67500d service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:57.547274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9d456-a7c9-4e9c-80e1-4673ee67500d service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:57.606958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793d905-c3c3-4569-a4f5-37ba2adef1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:57.607872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793d905-c3c3-4569-a4f5-37ba2adef1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:57.608150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793d905-c3c3-4569-a4f5-37ba2adef1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:57.608419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793d905-c3c3-4569-a4f5-37ba2adef1ef admin admin] PATH_INFO: `/v3/users/94b1d89b11b24fb58c2b13de70245f48` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:57.609634 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793d905-c3c3-4569-a4f5-37ba2adef1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b1d89b11b24fb58c2b13de70245f48)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:57.611587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793d905-c3c3-4569-a4f5-37ba2adef1ef admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:57.664464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c793d905-c3c3-4569-a4f5-37ba2adef1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b1d89b11b24fb58c2b13de70245f48'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:57.665123 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c793d905-c3c3-4569-a4f5-37ba2adef1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b1d89b11b24fb58c2b13de70245f48'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:57.674011 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c793d905-c3c3-4569-a4f5-37ba2adef1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b1d89b11b24fb58c2b13de70245f48'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:57.674636 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c793d905-c3c3-4569-a4f5-37ba2adef1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b1d89b11b24fb58c2b13de70245f48'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:57.682485 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c793d905-c3c3-4569-a4f5-37ba2adef1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b1d89b11b24fb58c2b13de70245f48'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:57.701038 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1148/2313] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:04:57 2021] DELETE /identity/v3/users/94b1d89b11b24fb58c2b13de70245f48 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:04:57.998896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:58.000474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:58.018098 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd3ec8-e4e6-4da8-93c1-bd011db3e89b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:58.084253 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca68d3c-166b-45a9-951b-aeffce688417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:58.085136 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca68d3c-166b-45a9-951b-aeffce688417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:58.085427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca68d3c-166b-45a9-951b-aeffce688417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:58.086002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca68d3c-166b-45a9-951b-aeffce688417 admin admin] PATH_INFO: `/v3/projects/74a30c4f674346b5884e2ada85ee34b3` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:58.086911 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca68d3c-166b-45a9-951b-aeffce688417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a30c4f674346b5884e2ada85ee34b3)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:58.088875 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca68d3c-166b-45a9-951b-aeffce688417 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:58.150684 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-5ca68d3c-166b-45a9-951b-aeffce688417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a30c4f674346b5884e2ada85ee34b3', 'request_id': 'req-5ca68d3c-166b-45a9-951b-aeffce688417'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:58.158134 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-5ca68d3c-166b-45a9-951b-aeffce688417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a30c4f674346b5884e2ada85ee34b3', 'request_id': 'req-5ca68d3c-166b-45a9-951b-aeffce688417'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:58.164511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-5ca68d3c-166b-45a9-951b-aeffce688417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a30c4f674346b5884e2ada85ee34b3', 'request_id': 'req-5ca68d3c-166b-45a9-951b-aeffce688417'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:58.189515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-5ca68d3c-166b-45a9-951b-aeffce688417 admin admin] The token cache is being invalidate because project 74a30c4f674346b5884e2ada85ee34b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:04:58.189829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-5ca68d3c-166b-45a9-951b-aeffce688417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:58.190796 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-5ca68d3c-166b-45a9-951b-aeffce688417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:04:58.192644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1166/2314] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:04:57 2021] DELETE /identity/v3/projects/74a30c4f674346b5884e2ada85ee34b3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:04:58.200716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6c24-886c-4563-911a-fec75bf44715 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:58.201218 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6c24-886c-4563-911a-fec75bf44715 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:58.201324 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6c24-886c-4563-911a-fec75bf44715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:58.221284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-e93f6c24-886c-4563-911a-fec75bf44715 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:58.222542 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e93f6c24-886c-4563-911a-fec75bf44715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:58.282972 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1149/2315] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:58.291091 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907efb-3efd-43b6-a8a1-4fe998c86a18 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:58.291389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907efb-3efd-43b6-a8a1-4fe998c86a18 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:58.291669 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907efb-3efd-43b6-a8a1-4fe998c86a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:58.311543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-2c907efb-3efd-43b6-a8a1-4fe998c86a18 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:58.312765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-2c907efb-3efd-43b6-a8a1-4fe998c86a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:58.321921 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1167/2316] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:58.326220 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f6c24-886c-4563-911a-fec75bf44715 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:58.336234 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f6c24-886c-4563-911a-fec75bf44715 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:58.341420 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865581c-d52d-4f1a-bf82-594c33fb52ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:58.342076 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865581c-d52d-4f1a-bf82-594c33fb52ee admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:58.342356 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865581c-d52d-4f1a-bf82-594c33fb52ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:58.342629 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865581c-d52d-4f1a-bf82-594c33fb52ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:58.343428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865581c-d52d-4f1a-bf82-594c33fb52ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:04:58.343735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865581c-d52d-4f1a-bf82-594c33fb52ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:58.345379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865581c-d52d-4f1a-bf82-594c33fb52ee admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:58.357495 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1150/2317] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:04:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:04:58.362033 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c907efb-3efd-43b6-a8a1-4fe998c86a18 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:58.371995 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c907efb-3efd-43b6-a8a1-4fe998c86a18 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:58.377729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d7392-7b76-4a14-b294-e391628b0f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:58.378355 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d7392-7b76-4a14-b294-e391628b0f01 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:58.378658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d7392-7b76-4a14-b294-e391628b0f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:58.378918 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d7392-7b76-4a14-b294-e391628b0f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:58.379668 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d7392-7b76-4a14-b294-e391628b0f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:58.382978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d7392-7b76-4a14-b294-e391628b0f01 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:58.405687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f6830-78b9-42de-b42f-29fde391153b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:58.406004 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f6830-78b9-42de-b42f-29fde391153b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:58.406277 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f6830-78b9-42de-b42f-29fde391153b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:58.410603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1168/2318] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:04:58 2021] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:04:58.415147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d7392-7b76-4a14-b294-e391628b0f01 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:58.424568 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-e18f6830-78b9-42de-b42f-29fde391153b None None] MFA Rules not processed for user `2e336e1a35de4e5780c3c460d9a4ddd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:58.425853 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e18f6830-78b9-42de-b42f-29fde391153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:58.483425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d7392-7b76-4a14-b294-e391628b0f01 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:58.490832 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1151/2319] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:58 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:58.491000 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ec4a3-2760-4212-a255-cdc6b33a907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:58.491000 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ec4a3-2760-4212-a255-cdc6b33a907f admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:58.491000 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ec4a3-2760-4212-a255-cdc6b33a907f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:58.491000 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ec4a3-2760-4212-a255-cdc6b33a907f admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:58.491378 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ec4a3-2760-4212-a255-cdc6b33a907f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:58.492210 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ec4a3-2760-4212-a255-cdc6b33a907f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:58.515691 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1169/2320] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:04:58 2021] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:04:58.517755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f6830-78b9-42de-b42f-29fde391153b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:58.527785 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f6830-78b9-42de-b42f-29fde391153b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:58.532654 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340359b9-1aeb-493c-a476-5b79e6ea8b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:58.533338 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340359b9-1aeb-493c-a476-5b79e6ea8b5b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:58.533727 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340359b9-1aeb-493c-a476-5b79e6ea8b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:58.533999 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340359b9-1aeb-493c-a476-5b79e6ea8b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:58.534858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340359b9-1aeb-493c-a476-5b79e6ea8b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:58.536733 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340359b9-1aeb-493c-a476-5b79e6ea8b5b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:58.547897 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1152/2321] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:58.551822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ec4a3-2760-4212-a255-cdc6b33a907f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:58.562036 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ec4a3-2760-4212-a255-cdc6b33a907f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:58.566714 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d001e-6cfe-4ee5-a75d-4a3059361674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:58.567430 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d001e-6cfe-4ee5-a75d-4a3059361674 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:58.567789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d001e-6cfe-4ee5-a75d-4a3059361674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:58.568066 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d001e-6cfe-4ee5-a75d-4a3059361674 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:58.568946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d001e-6cfe-4ee5-a75d-4a3059361674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:58.570545 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d001e-6cfe-4ee5-a75d-4a3059361674 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:58.584596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1170/2322] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:58.586158 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340359b9-1aeb-493c-a476-5b79e6ea8b5b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:58.596105 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340359b9-1aeb-493c-a476-5b79e6ea8b5b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:58.600912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed1566-db75-4076-86ed-db61cd6167a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:58.601806 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed1566-db75-4076-86ed-db61cd6167a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:58.602087 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed1566-db75-4076-86ed-db61cd6167a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:58.602358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed1566-db75-4076-86ed-db61cd6167a1 admin admin] PATH_INFO: `/v3/projects/b96b8932d356455f8971256cfb09dd57/users/edd2df0f74984bb9a8148126ae11ed40/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:58.617990 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed1566-db75-4076-86ed-db61cd6167a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96b8932d356455f8971256cfb09dd57, user_id=edd2df0f74984bb9a8148126ae11ed40, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:58.620750 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed1566-db75-4076-86ed-db61cd6167a1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:58.635332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1153/2323] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:58 2021] PUT /identity/v3/projects/b96b8932d356455f8971256cfb09dd57/users/edd2df0f74984bb9a8148126ae11ed40/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:58.647374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5f769-2bd9-4164-88cd-e4e5fecf6b89 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:58.647733 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5f769-2bd9-4164-88cd-e4e5fecf6b89 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:58.648125 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5f769-2bd9-4164-88cd-e4e5fecf6b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:58.675442 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-6bf5f769-2bd9-4164-88cd-e4e5fecf6b89 None None] MFA Rules not processed for user `edd2df0f74984bb9a8148126ae11ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:58.676792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6bf5f769-2bd9-4164-88cd-e4e5fecf6b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:58.741032 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1171/2324] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:58 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:58.745665 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed1566-db75-4076-86ed-db61cd6167a1 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:58.807023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed1566-db75-4076-86ed-db61cd6167a1 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:58.811880 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc94b7f-4694-425e-983b-03e93c0b12a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:58.812542 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc94b7f-4694-425e-983b-03e93c0b12a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:58.812822 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc94b7f-4694-425e-983b-03e93c0b12a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:58.813092 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc94b7f-4694-425e-983b-03e93c0b12a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:58.813808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc94b7f-4694-425e-983b-03e93c0b12a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:58.815777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc94b7f-4694-425e-983b-03e93c0b12a2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:58.845079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1154/2325] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:04:58 2021] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:04:58.846265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5f769-2bd9-4164-88cd-e4e5fecf6b89 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:58.857589 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5f769-2bd9-4164-88cd-e4e5fecf6b89 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:58.916682 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c037648-64dc-415a-bf2e-355bff47a524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:58.917375 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037648-64dc-415a-bf2e-355bff47a524 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:58.917648 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037648-64dc-415a-bf2e-355bff47a524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:58.917925 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037648-64dc-415a-bf2e-355bff47a524 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:58.918679 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c037648-64dc-415a-bf2e-355bff47a524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:58.920710 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c037648-64dc-415a-bf2e-355bff47a524 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:58.945646 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1172/2326] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:04:58 2021] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:04:58.950237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc94b7f-4694-425e-983b-03e93c0b12a2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:58.960755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc94b7f-4694-425e-983b-03e93c0b12a2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:58.966029 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b6bf2-da5b-43e9-ab66-cbb9e909c2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:58.966809 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b6bf2-da5b-43e9-ab66-cbb9e909c2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:58.967153 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b6bf2-da5b-43e9-ab66-cbb9e909c2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:58.967587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b6bf2-da5b-43e9-ab66-cbb9e909c2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:58.968365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b6bf2-da5b-43e9-ab66-cbb9e909c2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:58.970184 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b6bf2-da5b-43e9-ab66-cbb9e909c2c2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:58.981751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1155/2327] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:58 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:58.986049 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c037648-64dc-415a-bf2e-355bff47a524 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:58.999672 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c037648-64dc-415a-bf2e-355bff47a524 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:59.025815 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6eeec-d513-4cec-a93e-f819daaaa724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:59.026738 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6eeec-d513-4cec-a93e-f819daaaa724 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:59.027461 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6eeec-d513-4cec-a93e-f819daaaa724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:59.027461 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6eeec-d513-4cec-a93e-f819daaaa724 admin admin] PATH_INFO: `/v3/projects/02dd6d0f86d64517a653350fe7f12c7e/users/c962a9dce2f840e9a04649dc92d695bc/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:59.044383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6eeec-d513-4cec-a93e-f819daaaa724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02dd6d0f86d64517a653350fe7f12c7e, user_id=c962a9dce2f840e9a04649dc92d695bc, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:59.047320 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6eeec-d513-4cec-a93e-f819daaaa724 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:59.062444 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1173/2328] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:58 2021] PUT /identity/v3/projects/02dd6d0f86d64517a653350fe7f12c7e/users/c962a9dce2f840e9a04649dc92d695bc/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:59.067082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b6bf2-da5b-43e9-ab66-cbb9e909c2c2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:59.079519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b6bf2-da5b-43e9-ab66-cbb9e909c2c2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:59.139864 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14180c12-acd9-4821-81e6-ffe03495cc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:59.140549 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14180c12-acd9-4821-81e6-ffe03495cc1a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:59.140833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14180c12-acd9-4821-81e6-ffe03495cc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:59.141111 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14180c12-acd9-4821-81e6-ffe03495cc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:59.141870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14180c12-acd9-4821-81e6-ffe03495cc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:59.143598 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14180c12-acd9-4821-81e6-ffe03495cc1a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:59.155019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1156/2329] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:04:59 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:04:59.159441 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6eeec-d513-4cec-a93e-f819daaaa724 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:59.170204 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6eeec-d513-4cec-a93e-f819daaaa724 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:59.175506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3b11b-faa1-4e21-ba19-a86fdce54ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:59.176433 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3b11b-faa1-4e21-ba19-a86fdce54ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:59.176716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3b11b-faa1-4e21-ba19-a86fdce54ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:59.177092 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3b11b-faa1-4e21-ba19-a86fdce54ea0 admin admin] PATH_INFO: `/v3/projects/02dd6d0f86d64517a653350fe7f12c7e/users/c962a9dce2f840e9a04649dc92d695bc/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:59.179298 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3b11b-faa1-4e21-ba19-a86fdce54ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02dd6d0f86d64517a653350fe7f12c7e, user_id=c962a9dce2f840e9a04649dc92d695bc, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:59.181983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3b11b-faa1-4e21-ba19-a86fdce54ea0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:59.195227 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1174/2330] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:04:59 2021] PUT /identity/v3/projects/02dd6d0f86d64517a653350fe7f12c7e/users/c962a9dce2f840e9a04649dc92d695bc/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:04:59.205589 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca91c0-5c2d-4745-82f6-0da552ffb8e8 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:59.206035 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca91c0-5c2d-4745-82f6-0da552ffb8e8 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:59.206155 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca91c0-5c2d-4745-82f6-0da552ffb8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:59.246005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-67ca91c0-5c2d-4745-82f6-0da552ffb8e8 None None] MFA Rules not processed for user `c962a9dce2f840e9a04649dc92d695bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:04:59.247274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-67ca91c0-5c2d-4745-82f6-0da552ffb8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:59.349050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1157/2331] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:04:59 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:04:59.365514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3b11b-faa1-4e21-ba19-a86fdce54ea0 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:59.367988 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6ae3b11b-faa1-4e21-ba19-a86fdce54ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:59.449336 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3b11b-faa1-4e21-ba19-a86fdce54ea0 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:59.455774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499fedb-390e-4403-9d1a-0ec94f97c8ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:59.456456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499fedb-390e-4403-9d1a-0ec94f97c8ba service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:59.457719 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499fedb-390e-4403-9d1a-0ec94f97c8ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:59.458007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499fedb-390e-4403-9d1a-0ec94f97c8ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:59.473615 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499fedb-390e-4403-9d1a-0ec94f97c8ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:59.476623 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499fedb-390e-4403-9d1a-0ec94f97c8ba service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:59.490263 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1175/2332] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:04:59 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:04:59.546603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca91c0-5c2d-4745-82f6-0da552ffb8e8 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:04:59.548059 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-67ca91c0-5c2d-4745-82f6-0da552ffb8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:04:59.559962 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca91c0-5c2d-4745-82f6-0da552ffb8e8 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:04:59.563954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada412c0-6e75-4f85-b5bd-14168aaece7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:04:59.564597 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada412c0-6e75-4f85-b5bd-14168aaece7d service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:04:59.564881 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada412c0-6e75-4f85-b5bd-14168aaece7d service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:04:59.565155 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada412c0-6e75-4f85-b5bd-14168aaece7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:04:59.621480 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada412c0-6e75-4f85-b5bd-14168aaece7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:04:59.622935 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada412c0-6e75-4f85-b5bd-14168aaece7d service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:04:59.632264 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1158/2333] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:04:59 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:05:03.109716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499fedb-390e-4403-9d1a-0ec94f97c8ba service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:03.177634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499fedb-390e-4403-9d1a-0ec94f97c8ba service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:03.182909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49009ebb-03df-441c-a6f9-23e9c7d88ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:03.183853 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49009ebb-03df-441c-a6f9-23e9c7d88ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:03.184135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49009ebb-03df-441c-a6f9-23e9c7d88ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:03.184408 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49009ebb-03df-441c-a6f9-23e9c7d88ee9 admin admin] PATH_INFO: `/v3/users/edd2df0f74984bb9a8148126ae11ed40` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:03.185753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49009ebb-03df-441c-a6f9-23e9c7d88ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd2df0f74984bb9a8148126ae11ed40)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:03.187780 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49009ebb-03df-441c-a6f9-23e9c7d88ee9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:03.237578 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-49009ebb-03df-441c-a6f9-23e9c7d88ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd2df0f74984bb9a8148126ae11ed40'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:03.238317 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-49009ebb-03df-441c-a6f9-23e9c7d88ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd2df0f74984bb9a8148126ae11ed40'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:03.247566 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-49009ebb-03df-441c-a6f9-23e9c7d88ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd2df0f74984bb9a8148126ae11ed40'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:03.248177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-49009ebb-03df-441c-a6f9-23e9c7d88ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd2df0f74984bb9a8148126ae11ed40'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:03.260757 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-49009ebb-03df-441c-a6f9-23e9c7d88ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd2df0f74984bb9a8148126ae11ed40'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:03.274302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1176/2334] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:05:03 2021] DELETE /identity/v3/users/edd2df0f74984bb9a8148126ae11ed40 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:05:03.279045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc2d6c-e227-4dd1-84d1-f23b3e970771 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:03.279600 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc2d6c-e227-4dd1-84d1-f23b3e970771 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:03.279714 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc2d6c-e227-4dd1-84d1-f23b3e970771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:03.297807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-e9dc2d6c-e227-4dd1-84d1-f23b3e970771 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:03.299021 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e9dc2d6c-e227-4dd1-84d1-f23b3e970771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:03.366431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1159/2335] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:05:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:03.376558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49009ebb-03df-441c-a6f9-23e9c7d88ee9 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:03.378120 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-49009ebb-03df-441c-a6f9-23e9c7d88ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:03.439786 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49009ebb-03df-441c-a6f9-23e9c7d88ee9 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:03.444109 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3111e-c746-4c4c-8334-1995c04633a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:03.444734 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3111e-c746-4c4c-8334-1995c04633a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:03.445041 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3111e-c746-4c4c-8334-1995c04633a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:03.445407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3111e-c746-4c4c-8334-1995c04633a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:03.455479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3111e-c746-4c4c-8334-1995c04633a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:03.456906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3111e-c746-4c4c-8334-1995c04633a6 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:03.466755 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1177/2336] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:05:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:05:03.962041 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc2d6c-e227-4dd1-84d1-f23b3e970771 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:03.963578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e9dc2d6c-e227-4dd1-84d1-f23b3e970771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:03.979175 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc2d6c-e227-4dd1-84d1-f23b3e970771 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:03.985600 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:03.987551 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:03.988040 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:03.988390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] PATH_INFO: `/v3/projects/b96b8932d356455f8971256cfb09dd57` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:03.989909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b96b8932d356455f8971256cfb09dd57)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:03.991999 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:04.046828 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b96b8932d356455f8971256cfb09dd57', 'request_id': 'req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.053916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b96b8932d356455f8971256cfb09dd57', 'request_id': 'req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.059820 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b96b8932d356455f8971256cfb09dd57', 'request_id': 'req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.074523 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] The token cache is being invalidate because project b96b8932d356455f8971256cfb09dd57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:05:04.074810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.075601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.077149 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1160/2337] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:05:03 2021] DELETE /identity/v3/projects/b96b8932d356455f8971256cfb09dd57 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:05:04.081292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3111e-c746-4c4c-8334-1995c04633a6 service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:04.091430 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3111e-c746-4c4c-8334-1995c04633a6 service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:04.148594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d3811-4313-4ff3-943d-175f7d7320ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:04.149466 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d3811-4313-4ff3-943d-175f7d7320ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:04.149754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d3811-4313-4ff3-943d-175f7d7320ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:04.150034 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d3811-4313-4ff3-943d-175f7d7320ff admin admin] PATH_INFO: `/v3/users/c962a9dce2f840e9a04649dc92d695bc` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:04.151296 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d3811-4313-4ff3-943d-175f7d7320ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c962a9dce2f840e9a04649dc92d695bc)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:04.153222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d3811-4313-4ff3-943d-175f7d7320ff admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:04.205233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-fe0d3811-4313-4ff3-943d-175f7d7320ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c962a9dce2f840e9a04649dc92d695bc'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.205872 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-fe0d3811-4313-4ff3-943d-175f7d7320ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c962a9dce2f840e9a04649dc92d695bc'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.214288 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-fe0d3811-4313-4ff3-943d-175f7d7320ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c962a9dce2f840e9a04649dc92d695bc'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.214916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-fe0d3811-4313-4ff3-943d-175f7d7320ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c962a9dce2f840e9a04649dc92d695bc'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.226801 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-fe0d3811-4313-4ff3-943d-175f7d7320ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c962a9dce2f840e9a04649dc92d695bc'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.238751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1178/2338] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:05:04 2021] DELETE /identity/v3/users/c962a9dce2f840e9a04649dc92d695bc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:05:04.508956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:04.510474 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:04.527438 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfce5e-58c7-4f7d-a1c6-3205eadcc314 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:04.590577 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95814a76-b5ac-49c6-addd-18baa258559c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:04.591472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95814a76-b5ac-49c6-addd-18baa258559c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:04.591754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95814a76-b5ac-49c6-addd-18baa258559c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:04.592024 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95814a76-b5ac-49c6-addd-18baa258559c admin admin] PATH_INFO: `/v3/projects/02dd6d0f86d64517a653350fe7f12c7e` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:04.593333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95814a76-b5ac-49c6-addd-18baa258559c admin admin] RBAC: Authorizing `identity:delete_project(project_id=02dd6d0f86d64517a653350fe7f12c7e)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:04.595554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95814a76-b5ac-49c6-addd-18baa258559c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:04.658824 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-95814a76-b5ac-49c6-addd-18baa258559c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02dd6d0f86d64517a653350fe7f12c7e', 'request_id': 'req-95814a76-b5ac-49c6-addd-18baa258559c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.666490 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-95814a76-b5ac-49c6-addd-18baa258559c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02dd6d0f86d64517a653350fe7f12c7e', 'request_id': 'req-95814a76-b5ac-49c6-addd-18baa258559c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.672354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-95814a76-b5ac-49c6-addd-18baa258559c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02dd6d0f86d64517a653350fe7f12c7e', 'request_id': 'req-95814a76-b5ac-49c6-addd-18baa258559c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.690502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-95814a76-b5ac-49c6-addd-18baa258559c admin admin] The token cache is being invalidate because project 02dd6d0f86d64517a653350fe7f12c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:05:04.690680 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-95814a76-b5ac-49c6-addd-18baa258559c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.691479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-95814a76-b5ac-49c6-addd-18baa258559c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:04.693333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1161/2339] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:05:04 2021] DELETE /identity/v3/projects/02dd6d0f86d64517a653350fe7f12c7e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:05:04.699470 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b86ebb-081b-4888-8163-cc37784a334e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:04.699758 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b86ebb-081b-4888-8163-cc37784a334e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:04.700005 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b86ebb-081b-4888-8163-cc37784a334e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:04.718756 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-79b86ebb-081b-4888-8163-cc37784a334e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:04.719982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-79b86ebb-081b-4888-8163-cc37784a334e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:04.783382 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1179/2340] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:05:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:04.792598 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9733c43-9cc2-4c5c-82ab-833e53353032 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:04.793005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9733c43-9cc2-4c5c-82ab-833e53353032 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:04.793353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9733c43-9cc2-4c5c-82ab-833e53353032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:04.815979 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-f9733c43-9cc2-4c5c-82ab-833e53353032 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:04.817371 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f9733c43-9cc2-4c5c-82ab-833e53353032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:04.825555 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1162/2341] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:05:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:04.830132 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b86ebb-081b-4888-8163-cc37784a334e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:04.839883 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b86ebb-081b-4888-8163-cc37784a334e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:04.844611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82bd64-83dd-42f1-b506-8e74bf6abd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:04.845270 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82bd64-83dd-42f1-b506-8e74bf6abd37 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:04.845545 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82bd64-83dd-42f1-b506-8e74bf6abd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:04.845816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82bd64-83dd-42f1-b506-8e74bf6abd37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:04.846582 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82bd64-83dd-42f1-b506-8e74bf6abd37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:05:04.846887 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82bd64-83dd-42f1-b506-8e74bf6abd37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:04.848505 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82bd64-83dd-42f1-b506-8e74bf6abd37 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:04.861002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1180/2342] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:05:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 11:05:04.865945 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9733c43-9cc2-4c5c-82ab-833e53353032 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:04.875377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9733c43-9cc2-4c5c-82ab-833e53353032 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:04.881974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d2c04-5a4f-4f70-9f80-be08ce6b836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:04.882687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2c04-5a4f-4f70-9f80-be08ce6b836b admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:04.882993 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2c04-5a4f-4f70-9f80-be08ce6b836b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:04.883299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2c04-5a4f-4f70-9f80-be08ce6b836b admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:04.884033 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d2c04-5a4f-4f70-9f80-be08ce6b836b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:04.887300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d2c04-5a4f-4f70-9f80-be08ce6b836b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:04.925317 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1163/2343] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:05:04 2021] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:05:04.931037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82bd64-83dd-42f1-b506-8e74bf6abd37 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:04.941170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82bd64-83dd-42f1-b506-8e74bf6abd37 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:05.006184 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dec93d-5ecc-43db-8679-f38d5cf934e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:05.006859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dec93d-5ecc-43db-8679-f38d5cf934e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:05.007179 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dec93d-5ecc-43db-8679-f38d5cf934e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:05.007438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dec93d-5ecc-43db-8679-f38d5cf934e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:05.008143 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dec93d-5ecc-43db-8679-f38d5cf934e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:05.010068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dec93d-5ecc-43db-8679-f38d5cf934e5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:05.033471 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1181/2344] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:05:04 2021] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:05:05.038998 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d2c04-5a4f-4f70-9f80-be08ce6b836b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:05.052857 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d2c04-5a4f-4f70-9f80-be08ce6b836b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:05.065573 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0adc6-29d1-4243-8f0b-5fa3327de7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:05.066450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0adc6-29d1-4243-8f0b-5fa3327de7aa admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:05.066716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0adc6-29d1-4243-8f0b-5fa3327de7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:05.067003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0adc6-29d1-4243-8f0b-5fa3327de7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:05.067860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0adc6-29d1-4243-8f0b-5fa3327de7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:05.070726 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0adc6-29d1-4243-8f0b-5fa3327de7aa admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:05.084478 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1164/2345] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:05:05 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:05:05.089078 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dec93d-5ecc-43db-8679-f38d5cf934e5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:05.102055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dec93d-5ecc-43db-8679-f38d5cf934e5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:05.107568 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87e835-3380-41b9-875d-47aad2da368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:05.109007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87e835-3380-41b9-875d-47aad2da368c admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:05.109007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87e835-3380-41b9-875d-47aad2da368c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:05.109007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87e835-3380-41b9-875d-47aad2da368c admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:05.109538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87e835-3380-41b9-875d-47aad2da368c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:05.111291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87e835-3380-41b9-875d-47aad2da368c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:05.124143 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1182/2346] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:05:05 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:05:05.130503 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0adc6-29d1-4243-8f0b-5fa3327de7aa admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:05.148024 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0adc6-29d1-4243-8f0b-5fa3327de7aa admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:05.153589 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9ee63-487d-4c4d-87b7-9ef8c9c56bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:05.154569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9ee63-487d-4c4d-87b7-9ef8c9c56bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:05.154848 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9ee63-487d-4c4d-87b7-9ef8c9c56bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:05.155242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9ee63-487d-4c4d-87b7-9ef8c9c56bf2 admin admin] PATH_INFO: `/v3/projects/10f712d3ff2d42ce89ed8187013aeb14/users/3b1a4d9480364cb593aea28a10fab99a/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:05.172520 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9ee63-487d-4c4d-87b7-9ef8c9c56bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f712d3ff2d42ce89ed8187013aeb14, user_id=3b1a4d9480364cb593aea28a10fab99a, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:05.175708 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9ee63-487d-4c4d-87b7-9ef8c9c56bf2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:05.194649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1165/2347] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:05:05 2021] PUT /identity/v3/projects/10f712d3ff2d42ce89ed8187013aeb14/users/3b1a4d9480364cb593aea28a10fab99a/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:05:05.206392 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2aeeb-385b-417c-b2b0-3ddee9e81656 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:05.206926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2aeeb-385b-417c-b2b0-3ddee9e81656 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:05.206926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2aeeb-385b-417c-b2b0-3ddee9e81656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:05.240354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-98f2aeeb-385b-417c-b2b0-3ddee9e81656 None None] MFA Rules not processed for user `3b1a4d9480364cb593aea28a10fab99a`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:05.241812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-98f2aeeb-385b-417c-b2b0-3ddee9e81656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:05.328055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1183/2348] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:05:05 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:05.344114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9ee63-487d-4c4d-87b7-9ef8c9c56bf2 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:05.346340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-47c9ee63-487d-4c4d-87b7-9ef8c9c56bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:05.417672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9ee63-487d-4c4d-87b7-9ef8c9c56bf2 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:05.422716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8c6b1-e32d-4bfc-a0a7-f246d94357ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:05.423429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c6b1-e32d-4bfc-a0a7-f246d94357ba service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:05.423713 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c6b1-e32d-4bfc-a0a7-f246d94357ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:05.423975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c6b1-e32d-4bfc-a0a7-f246d94357ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:05.434058 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8c6b1-e32d-4bfc-a0a7-f246d94357ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:05.435583 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8c6b1-e32d-4bfc-a0a7-f246d94357ba service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:05.446418 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1166/2349] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:05:05 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:05:08.539247 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2aeeb-385b-417c-b2b0-3ddee9e81656 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:08.618337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2aeeb-385b-417c-b2b0-3ddee9e81656 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:08.623486 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fc687-b6ab-4cc4-a460-245d84b7d70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:08.624386 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fc687-b6ab-4cc4-a460-245d84b7d70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:08.624666 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fc687-b6ab-4cc4-a460-245d84b7d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:08.624938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fc687-b6ab-4cc4-a460-245d84b7d70b admin admin] PATH_INFO: `/v3/users/3b1a4d9480364cb593aea28a10fab99a` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:08.626174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3fc687-b6ab-4cc4-a460-245d84b7d70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1a4d9480364cb593aea28a10fab99a)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:08.628156 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3fc687-b6ab-4cc4-a460-245d84b7d70b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:08.691081 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ba3fc687-b6ab-4cc4-a460-245d84b7d70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1a4d9480364cb593aea28a10fab99a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:08.691911 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ba3fc687-b6ab-4cc4-a460-245d84b7d70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1a4d9480364cb593aea28a10fab99a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:08.702057 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ba3fc687-b6ab-4cc4-a460-245d84b7d70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1a4d9480364cb593aea28a10fab99a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:08.703387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ba3fc687-b6ab-4cc4-a460-245d84b7d70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1a4d9480364cb593aea28a10fab99a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:08.718945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ba3fc687-b6ab-4cc4-a460-245d84b7d70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1a4d9480364cb593aea28a10fab99a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:08.732065 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1184/2350] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:05:08 2021] DELETE /identity/v3/users/3b1a4d9480364cb593aea28a10fab99a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:05:08.737587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb9364-9e8a-4f97-aec0-cdb5f7651a29 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:08.738188 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb9364-9e8a-4f97-aec0-cdb5f7651a29 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:08.738188 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb9364-9e8a-4f97-aec0-cdb5f7651a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:08.756345 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-c5bb9364-9e8a-4f97-aec0-cdb5f7651a29 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:08.757559 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c5bb9364-9e8a-4f97-aec0-cdb5f7651a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:08.829448 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1167/2351] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:05:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:08.841220 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fc687-b6ab-4cc4-a460-245d84b7d70b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:08.842866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ba3fc687-b6ab-4cc4-a460-245d84b7d70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:08.912721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fc687-b6ab-4cc4-a460-245d84b7d70b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:08.916797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadc99c-83f3-48c9-86ad-77be78bf8c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:08.917453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc99c-83f3-48c9-86ad-77be78bf8c3c service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:08.918165 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc99c-83f3-48c9-86ad-77be78bf8c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:08.918165 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc99c-83f3-48c9-86ad-77be78bf8c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:08.929181 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daadc99c-83f3-48c9-86ad-77be78bf8c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:08.930893 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daadc99c-83f3-48c9-86ad-77be78bf8c3c service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:08.942236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1185/2352] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:05:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:05:09.304095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb9364-9e8a-4f97-aec0-cdb5f7651a29 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:09.305635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c5bb9364-9e8a-4f97-aec0-cdb5f7651a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:09.322019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb9364-9e8a-4f97-aec0-cdb5f7651a29 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:09.327787 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443be6f-25ee-4fd4-8144-8b85a78c6ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:09.329138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443be6f-25ee-4fd4-8144-8b85a78c6ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:09.329138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443be6f-25ee-4fd4-8144-8b85a78c6ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:09.331383 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443be6f-25ee-4fd4-8144-8b85a78c6ece admin admin] PATH_INFO: `/v3/projects/10f712d3ff2d42ce89ed8187013aeb14` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:09.332786 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443be6f-25ee-4fd4-8144-8b85a78c6ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f712d3ff2d42ce89ed8187013aeb14)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:09.335847 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443be6f-25ee-4fd4-8144-8b85a78c6ece admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:09.400222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c443be6f-25ee-4fd4-8144-8b85a78c6ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f712d3ff2d42ce89ed8187013aeb14', 'request_id': 'req-c443be6f-25ee-4fd4-8144-8b85a78c6ece'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:09.406849 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c443be6f-25ee-4fd4-8144-8b85a78c6ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f712d3ff2d42ce89ed8187013aeb14', 'request_id': 'req-c443be6f-25ee-4fd4-8144-8b85a78c6ece'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:09.414816 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c443be6f-25ee-4fd4-8144-8b85a78c6ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f712d3ff2d42ce89ed8187013aeb14', 'request_id': 'req-c443be6f-25ee-4fd4-8144-8b85a78c6ece'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:09.430227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c443be6f-25ee-4fd4-8144-8b85a78c6ece admin admin] The token cache is being invalidate because project 10f712d3ff2d42ce89ed8187013aeb14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:05:09.430739 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c443be6f-25ee-4fd4-8144-8b85a78c6ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:09.431867 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c443be6f-25ee-4fd4-8144-8b85a78c6ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:09.433972 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1168/2353] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:05:09 2021] DELETE /identity/v3/projects/10f712d3ff2d42ce89ed8187013aeb14 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:05:09.439937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac775440-4691-476f-ab49-0b04d2ca92de None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:09.440223 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac775440-4691-476f-ab49-0b04d2ca92de None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:09.440494 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac775440-4691-476f-ab49-0b04d2ca92de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:09.465171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-ac775440-4691-476f-ab49-0b04d2ca92de None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:09.466512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ac775440-4691-476f-ab49-0b04d2ca92de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:09.534574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1186/2354] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:05:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:09.547327 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bdb9e-2e8b-4d9c-9ae1-3b1fb397f8d3 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:09.547529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bdb9e-2e8b-4d9c-9ae1-3b1fb397f8d3 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:09.547890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bdb9e-2e8b-4d9c-9ae1-3b1fb397f8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:09.570348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-e91bdb9e-2e8b-4d9c-9ae1-3b1fb397f8d3 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:09.571610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e91bdb9e-2e8b-4d9c-9ae1-3b1fb397f8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:09.580041 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1169/2355] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:05:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:09.585194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac775440-4691-476f-ab49-0b04d2ca92de None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:09.595297 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac775440-4691-476f-ab49-0b04d2ca92de None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:09.600828 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc052b-8e83-4fd6-b732-09e4f4d0efb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:09.601529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc052b-8e83-4fd6-b732-09e4f4d0efb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:09.601810 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc052b-8e83-4fd6-b732-09e4f4d0efb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:09.602083 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc052b-8e83-4fd6-b732-09e4f4d0efb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:09.602821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc052b-8e83-4fd6-b732-09e4f4d0efb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:05:09.603153 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc052b-8e83-4fd6-b732-09e4f4d0efb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:09.604754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc052b-8e83-4fd6-b732-09e4f4d0efb9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:09.617550 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1187/2356] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:05:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:05:09.622192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bdb9e-2e8b-4d9c-9ae1-3b1fb397f8d3 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:09.631762 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bdb9e-2e8b-4d9c-9ae1-3b1fb397f8d3 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:09.636936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca601e23-7bce-4042-b730-229407261b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:09.637601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca601e23-7bce-4042-b730-229407261b58 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:09.637881 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca601e23-7bce-4042-b730-229407261b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:09.638136 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca601e23-7bce-4042-b730-229407261b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:09.638861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca601e23-7bce-4042-b730-229407261b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:09.640955 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca601e23-7bce-4042-b730-229407261b58 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:09.669984 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1170/2357] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:05:09 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:05:09.674202 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc052b-8e83-4fd6-b732-09e4f4d0efb9 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:09.684851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc052b-8e83-4fd6-b732-09e4f4d0efb9 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:09.744770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0b722-db08-4443-b3b5-5e377fcbeb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:09.745464 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0b722-db08-4443-b3b5-5e377fcbeb81 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:09.745747 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0b722-db08-4443-b3b5-5e377fcbeb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:09.746053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0b722-db08-4443-b3b5-5e377fcbeb81 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:09.746758 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0b722-db08-4443-b3b5-5e377fcbeb81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:09.751246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0b722-db08-4443-b3b5-5e377fcbeb81 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:09.775612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1188/2358] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:05:09 2021] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:05:09.779574 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca601e23-7bce-4042-b730-229407261b58 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:09.791016 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca601e23-7bce-4042-b730-229407261b58 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:09.798167 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0824a52-0842-4c52-b2b1-60246640b419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:09.798789 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0824a52-0842-4c52-b2b1-60246640b419 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:09.799076 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0824a52-0842-4c52-b2b1-60246640b419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:09.799467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0824a52-0842-4c52-b2b1-60246640b419 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:09.800453 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0824a52-0842-4c52-b2b1-60246640b419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:09.802303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0824a52-0842-4c52-b2b1-60246640b419 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:09.817413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1171/2359] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:05:09 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:05:09.818764 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0b722-db08-4443-b3b5-5e377fcbeb81 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:09.829577 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0b722-db08-4443-b3b5-5e377fcbeb81 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:09.834476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dffe53-64a8-439c-8b89-21a83c4da820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:09.835349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dffe53-64a8-439c-8b89-21a83c4da820 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:09.835628 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dffe53-64a8-439c-8b89-21a83c4da820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:09.835903 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dffe53-64a8-439c-8b89-21a83c4da820 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:09.836664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dffe53-64a8-439c-8b89-21a83c4da820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:09.838216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dffe53-64a8-439c-8b89-21a83c4da820 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:09.848852 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1189/2360] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:05:09 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:05:09.856918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0824a52-0842-4c52-b2b1-60246640b419 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:09.867595 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0824a52-0842-4c52-b2b1-60246640b419 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:09.872193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8138b-6ce0-4d1f-b6ca-3379009caedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:09.873089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8138b-6ce0-4d1f-b6ca-3379009caedc admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:09.873365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8138b-6ce0-4d1f-b6ca-3379009caedc admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:09.873637 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8138b-6ce0-4d1f-b6ca-3379009caedc admin admin] PATH_INFO: `/v3/projects/cf2112d28b064283bd2b793117948f31/users/4c743071c99a431291b1855534649a8c/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:09.891340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8138b-6ce0-4d1f-b6ca-3379009caedc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2112d28b064283bd2b793117948f31, user_id=4c743071c99a431291b1855534649a8c, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:09.894123 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8138b-6ce0-4d1f-b6ca-3379009caedc admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:09.910344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1172/2361] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:05:09 2021] PUT /identity/v3/projects/cf2112d28b064283bd2b793117948f31/users/4c743071c99a431291b1855534649a8c/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:05:09.921887 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8439e5-52f7-4d8e-95a2-3656c7b19c40 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:09.922179 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8439e5-52f7-4d8e-95a2-3656c7b19c40 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:09.922462 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8439e5-52f7-4d8e-95a2-3656c7b19c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:09.953851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-ec8439e5-52f7-4d8e-95a2-3656c7b19c40 None None] MFA Rules not processed for user `4c743071c99a431291b1855534649a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:09.955077 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ec8439e5-52f7-4d8e-95a2-3656c7b19c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:10.036076 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1190/2362] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:05:09 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:10.047591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8138b-6ce0-4d1f-b6ca-3379009caedc admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:10.049597 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-0ca8138b-6ce0-4d1f-b6ca-3379009caedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:10.111890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8138b-6ce0-4d1f-b6ca-3379009caedc admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:10.116714 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d28b0-6d5d-4086-a584-c93ef9422d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:10.117351 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d28b0-6d5d-4086-a584-c93ef9422d3b service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:10.117641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d28b0-6d5d-4086-a584-c93ef9422d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:10.117932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d28b0-6d5d-4086-a584-c93ef9422d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:10.127474 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d28b0-6d5d-4086-a584-c93ef9422d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:10.128914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d28b0-6d5d-4086-a584-c93ef9422d3b service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:10.139434 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1173/2363] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:05:10 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:05:13.610010 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d8f3f-838f-488f-aba3-b292445b318b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:13.610566 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d8f3f-838f-488f-aba3-b292445b318b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:13.610566 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d8f3f-838f-488f-aba3-b292445b318b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:13.628498 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-ab9d8f3f-838f-488f-aba3-b292445b318b None None] MFA Rules not processed for user `4c743071c99a431291b1855534649a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:13.629722 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ab9d8f3f-838f-488f-aba3-b292445b318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:13.637705 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1191/2364] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:05:13 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:17.461298 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d28b0-6d5d-4086-a584-c93ef9422d3b service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:17.464556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c12d28b0-6d5d-4086-a584-c93ef9422d3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:17.567158 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d28b0-6d5d-4086-a584-c93ef9422d3b service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:17.574505 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f215b-1466-4290-a012-142c5d912094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:17.575526 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f215b-1466-4290-a012-142c5d912094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:17.576000 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f215b-1466-4290-a012-142c5d912094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:17.576286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f215b-1466-4290-a012-142c5d912094 admin admin] PATH_INFO: `/v3/users/a8f4319dabe2401690314ed214e1d0b0` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:17.577587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f215b-1466-4290-a012-142c5d912094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8f4319dabe2401690314ed214e1d0b0)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:17.579644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f215b-1466-4290-a012-142c5d912094 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:17.646693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e25f215b-1466-4290-a012-142c5d912094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8f4319dabe2401690314ed214e1d0b0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:17.647419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e25f215b-1466-4290-a012-142c5d912094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8f4319dabe2401690314ed214e1d0b0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:17.658936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e25f215b-1466-4290-a012-142c5d912094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8f4319dabe2401690314ed214e1d0b0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:17.659600 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e25f215b-1466-4290-a012-142c5d912094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8f4319dabe2401690314ed214e1d0b0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:17.668338 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e25f215b-1466-4290-a012-142c5d912094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8f4319dabe2401690314ed214e1d0b0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:17.706357 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1174/2365] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:05:17 2021] DELETE /identity/v3/users/a8f4319dabe2401690314ed214e1d0b0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:05:17.710821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faba4d7-4e0c-4d75-9ccb-b4330cb179f4 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:17.711868 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faba4d7-4e0c-4d75-9ccb-b4330cb179f4 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:17.712166 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faba4d7-4e0c-4d75-9ccb-b4330cb179f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:17.742497 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-0faba4d7-4e0c-4d75-9ccb-b4330cb179f4 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:17.744201 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0faba4d7-4e0c-4d75-9ccb-b4330cb179f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:17.903629 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1192/2366] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:05:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:05:17.913910 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f215b-1466-4290-a012-142c5d912094 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:17.916050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e25f215b-1466-4290-a012-142c5d912094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:17.987927 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f215b-1466-4290-a012-142c5d912094 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:17.992077 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a2f75-5dd2-45f8-a191-a3646b93b5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:17.992849 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a2f75-5dd2-45f8-a191-a3646b93b5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:17.993135 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a2f75-5dd2-45f8-a191-a3646b93b5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:17.993470 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a2f75-5dd2-45f8-a191-a3646b93b5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:18.003414 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a2f75-5dd2-45f8-a191-a3646b93b5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:18.004962 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a2f75-5dd2-45f8-a191-a3646b93b5e9 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:18.016458 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1175/2367] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:05:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:05:18.400516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faba4d7-4e0c-4d75-9ccb-b4330cb179f4 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:18.401533 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0faba4d7-4e0c-4d75-9ccb-b4330cb179f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:18.413437 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faba4d7-4e0c-4d75-9ccb-b4330cb179f4 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:18.424636 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68b028-c6c9-49fa-b32e-4dc42e049007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:18.425529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68b028-c6c9-49fa-b32e-4dc42e049007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:18.425847 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68b028-c6c9-49fa-b32e-4dc42e049007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:18.426262 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68b028-c6c9-49fa-b32e-4dc42e049007 admin admin] PATH_INFO: `/v3/projects/417ac5241b394a12bcd78be41d6821b9` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:18.427712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68b028-c6c9-49fa-b32e-4dc42e049007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=417ac5241b394a12bcd78be41d6821b9)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:18.429882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68b028-c6c9-49fa-b32e-4dc42e049007 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:18.485419 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7f68b028-c6c9-49fa-b32e-4dc42e049007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417ac5241b394a12bcd78be41d6821b9', 'request_id': 'req-7f68b028-c6c9-49fa-b32e-4dc42e049007'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:18.492110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7f68b028-c6c9-49fa-b32e-4dc42e049007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417ac5241b394a12bcd78be41d6821b9', 'request_id': 'req-7f68b028-c6c9-49fa-b32e-4dc42e049007'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:18.497934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7f68b028-c6c9-49fa-b32e-4dc42e049007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417ac5241b394a12bcd78be41d6821b9', 'request_id': 'req-7f68b028-c6c9-49fa-b32e-4dc42e049007'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:18.514356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7f68b028-c6c9-49fa-b32e-4dc42e049007 admin admin] The token cache is being invalidate because project 417ac5241b394a12bcd78be41d6821b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:05:18.514642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7f68b028-c6c9-49fa-b32e-4dc42e049007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:18.515391 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7f68b028-c6c9-49fa-b32e-4dc42e049007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:05:18.517046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1193/2368] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:05:18 2021] DELETE /identity/v3/projects/417ac5241b394a12bcd78be41d6821b9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:05:18.523101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06501344-c3fc-48c9-9904-b29fd183a4f5 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:18.523641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06501344-c3fc-48c9-9904-b29fd183a4f5 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:18.523641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06501344-c3fc-48c9-9904-b29fd183a4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:18.542385 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-06501344-c3fc-48c9-9904-b29fd183a4f5 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:18.543648 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-06501344-c3fc-48c9-9904-b29fd183a4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:18.623433 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1176/2369] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:05:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:18.631555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34368a0-ec7e-417e-869b-5503c2699253 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:18.631857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34368a0-ec7e-417e-869b-5503c2699253 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:18.632108 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34368a0-ec7e-417e-869b-5503c2699253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:18.657130 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-e34368a0-ec7e-417e-869b-5503c2699253 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:18.658349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e34368a0-ec7e-417e-869b-5503c2699253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:18.669416 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1194/2370] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:05:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:18.673801 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06501344-c3fc-48c9-9904-b29fd183a4f5 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:18.684816 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06501344-c3fc-48c9-9904-b29fd183a4f5 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:18.690239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e40d7-5b49-4a93-89c1-34d609ef033a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:18.690914 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e40d7-5b49-4a93-89c1-34d609ef033a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:18.691218 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e40d7-5b49-4a93-89c1-34d609ef033a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:18.691495 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e40d7-5b49-4a93-89c1-34d609ef033a admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:18.692270 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e40d7-5b49-4a93-89c1-34d609ef033a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:05:18.692572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e40d7-5b49-4a93-89c1-34d609ef033a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:18.694485 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e40d7-5b49-4a93-89c1-34d609ef033a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:18.710672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1177/2371] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:05:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 11:05:18.734276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34368a0-ec7e-417e-869b-5503c2699253 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:18.734276 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34368a0-ec7e-417e-869b-5503c2699253 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:18.737772 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369f318-f4f4-4d31-8fd0-a5551777fdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:18.738446 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369f318-f4f4-4d31-8fd0-a5551777fdf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:18.738826 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369f318-f4f4-4d31-8fd0-a5551777fdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:18.739099 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369f318-f4f4-4d31-8fd0-a5551777fdf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:18.740064 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369f318-f4f4-4d31-8fd0-a5551777fdf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:18.742018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369f318-f4f4-4d31-8fd0-a5551777fdf0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:18.771719 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1195/2372] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:05:18 2021] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:05:18.776628 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e40d7-5b49-4a93-89c1-34d609ef033a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:18.787482 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e40d7-5b49-4a93-89c1-34d609ef033a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:18.858699 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2576a4b-572f-4985-99d3-559d63d3907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:18.859585 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2576a4b-572f-4985-99d3-559d63d3907a admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:18.859868 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2576a4b-572f-4985-99d3-559d63d3907a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:18.860145 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2576a4b-572f-4985-99d3-559d63d3907a admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:18.861159 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2576a4b-572f-4985-99d3-559d63d3907a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:18.863266 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2576a4b-572f-4985-99d3-559d63d3907a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:18.890515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1178/2373] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:05:18 2021] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:05:18.894635 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369f318-f4f4-4d31-8fd0-a5551777fdf0 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:18.924847 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369f318-f4f4-4d31-8fd0-a5551777fdf0 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:18.932142 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa68089-e658-4c29-a868-5c3dc214dfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:18.933257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa68089-e658-4c29-a868-5c3dc214dfbd admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:18.933773 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa68089-e658-4c29-a868-5c3dc214dfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:18.934299 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa68089-e658-4c29-a868-5c3dc214dfbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:18.935354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa68089-e658-4c29-a868-5c3dc214dfbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:18.937392 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa68089-e658-4c29-a868-5c3dc214dfbd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:18.956004 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2576a4b-572f-4985-99d3-559d63d3907a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:18.956747 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1196/2374] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:05:18.968571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2576a4b-572f-4985-99d3-559d63d3907a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:18.972601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b69f7-41f7-4b9a-aa69-d57e1748d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:18.973284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b69f7-41f7-4b9a-aa69-d57e1748d407 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:18.973569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b69f7-41f7-4b9a-aa69-d57e1748d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:18.973846 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b69f7-41f7-4b9a-aa69-d57e1748d407 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:18.974593 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b69f7-41f7-4b9a-aa69-d57e1748d407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:18.976541 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b69f7-41f7-4b9a-aa69-d57e1748d407 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:18.991171 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1179/2375] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:05:18.993030 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa68089-e658-4c29-a868-5c3dc214dfbd admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:19.002969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa68089-e658-4c29-a868-5c3dc214dfbd admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:19.007600 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428392f7-40b1-4311-aeeb-2c35621d0070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:19.008779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428392f7-40b1-4311-aeeb-2c35621d0070 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:19.009058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428392f7-40b1-4311-aeeb-2c35621d0070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:19.009362 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428392f7-40b1-4311-aeeb-2c35621d0070 admin admin] PATH_INFO: `/v3/projects/e2e01728aeec4f289300335f546ae49e/users/90b810b6e3a6435e88273d0c53bf0d90/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:19.026080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428392f7-40b1-4311-aeeb-2c35621d0070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e01728aeec4f289300335f546ae49e, user_id=90b810b6e3a6435e88273d0c53bf0d90, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:19.028822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428392f7-40b1-4311-aeeb-2c35621d0070 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:19.047628 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1197/2376] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:05:18 2021] PUT /identity/v3/projects/e2e01728aeec4f289300335f546ae49e/users/90b810b6e3a6435e88273d0c53bf0d90/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:05:19.058962 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8dfd2-383d-42bc-baba-bc2c056101bb None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:19.059274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8dfd2-383d-42bc-baba-bc2c056101bb None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:19.059623 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8dfd2-383d-42bc-baba-bc2c056101bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:19.087283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-d0d8dfd2-383d-42bc-baba-bc2c056101bb None None] MFA Rules not processed for user `90b810b6e3a6435e88273d0c53bf0d90`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:19.088754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d0d8dfd2-383d-42bc-baba-bc2c056101bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:19.157737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1180/2377] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:05:19 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:05:19.171406 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428392f7-40b1-4311-aeeb-2c35621d0070 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:19.173311 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-428392f7-40b1-4311-aeeb-2c35621d0070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:19.262602 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428392f7-40b1-4311-aeeb-2c35621d0070 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:19.266967 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814b4bf-a185-4301-8e1a-bd01fc7f8df4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a71b8adef243049d3b055e66566a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:19.267649 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814b4bf-a185-4301-8e1a-bd01fc7f8df4 service glance] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:19.267930 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814b4bf-a185-4301-8e1a-bd01fc7f8df4 service glance] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:19.268186 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814b4bf-a185-4301-8e1a-bd01fc7f8df4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:19.278025 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814b4bf-a185-4301-8e1a-bd01fc7f8df4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:19.280313 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814b4bf-a185-4301-8e1a-bd01fc7f8df4 service glance] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:19.295405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1198/2378] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:05:19 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:05:46.117812 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c3235-11e8-4ce1-a2f1-db7a3d5fee04 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:46.118598 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c3235-11e8-4ce1-a2f1-db7a3d5fee04 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:46.118598 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c3235-11e8-4ce1-a2f1-db7a3d5fee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:46.195678 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8a8c3235-11e8-4ce1-a2f1-db7a3d5fee04 None None] MFA Rules not processed for user `f9fc539f38364a648b9a4c25d3dbea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:46.197196 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8a8c3235-11e8-4ce1-a2f1-db7a3d5fee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:46.280475 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1181/2379] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Nov 8 11:05:46 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:46.338692 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814b4bf-a185-4301-8e1a-bd01fc7f8df4 service glance] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:46.340316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6814b4bf-a185-4301-8e1a-bd01fc7f8df4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:46.462753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814b4bf-a185-4301-8e1a-bd01fc7f8df4 service glance] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:46.468812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a2703-5c1f-4e3e-bad7-b8856ff812b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '029506cc966a44c9bbe83eb084ac6feb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:46.469251 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a2703-5c1f-4e3e-bad7-b8856ff812b7 service swift] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:46.469752 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a2703-5c1f-4e3e-bad7-b8856ff812b7 service swift] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:46.470189 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a2703-5c1f-4e3e-bad7-b8856ff812b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:46.480648 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a2703-5c1f-4e3e-bad7-b8856ff812b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:46.482713 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a2703-5c1f-4e3e-bad7-b8856ff812b7 service swift] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:46.494099 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1199/2380] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Nov 8 11:05:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 11:05:46.935653 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc019dcb-7e52-465f-9728-109f77589176 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:46.936155 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc019dcb-7e52-465f-9728-109f77589176 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:46.936499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc019dcb-7e52-465f-9728-109f77589176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:46.961681 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-bc019dcb-7e52-465f-9728-109f77589176 None None] MFA Rules not processed for user `fd75fa7d42a5418e87ebc4176e5a2790`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:46.962907 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-bc019dcb-7e52-465f-9728-109f77589176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:47.052935 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1182/2381] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:05:46 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:47.240569 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d9894-681e-48b7-bee2-2eabf2af4240 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:47.240823 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d9894-681e-48b7-bee2-2eabf2af4240 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:47.241310 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d9894-681e-48b7-bee2-2eabf2af4240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:47.262799 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-f14d9894-681e-48b7-bee2-2eabf2af4240 None None] MFA Rules not processed for user `f9fc539f38364a648b9a4c25d3dbea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:47.264094 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f14d9894-681e-48b7-bee2-2eabf2af4240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:47.277537 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1200/2382] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Nov 8 11:05:47 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:47.290514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc019dcb-7e52-465f-9728-109f77589176 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:47.302813 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc019dcb-7e52-465f-9728-109f77589176 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:47.308778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa73a0-dfa6-4cae-ac31-670185b0e6d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '029506cc966a44c9bbe83eb084ac6feb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:47.309455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa73a0-dfa6-4cae-ac31-670185b0e6d0 service swift] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:47.309726 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa73a0-dfa6-4cae-ac31-670185b0e6d0 service swift] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:47.310185 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa73a0-dfa6-4cae-ac31-670185b0e6d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:47.320199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa73a0-dfa6-4cae-ac31-670185b0e6d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:47.321828 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa73a0-dfa6-4cae-ac31-670185b0e6d0 service swift] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:47.331171 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1183/2383] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Nov 8 11:05:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 11:05:47.766927 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c41d1-3865-4e9e-bfb7-844b3e2e7140 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:47.767673 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c41d1-3865-4e9e-bfb7-844b3e2e7140 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:47.767803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c41d1-3865-4e9e-bfb7-844b3e2e7140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:47.793275 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-1d7c41d1-3865-4e9e-bfb7-844b3e2e7140 None None] MFA Rules not processed for user `f9fc539f38364a648b9a4c25d3dbea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:05:47.794710 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1d7c41d1-3865-4e9e-bfb7-844b3e2e7140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:05:47.803610 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1201/2384] 10.222.0.20 () {58 vars in 967 bytes} [Mon Nov 8 11:05:47 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:05:47.821117 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa73a0-dfa6-4cae-ac31-670185b0e6d0 service swift] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:05:47.837102 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa73a0-dfa6-4cae-ac31-670185b0e6d0 service swift] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:05:47.844043 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2042c77-e8e0-464b-9395-8be862cb9fcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '029506cc966a44c9bbe83eb084ac6feb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:05:47.844714 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2042c77-e8e0-464b-9395-8be862cb9fcc service swift] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:05:47.844993 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2042c77-e8e0-464b-9395-8be862cb9fcc service swift] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:05:47.845266 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2042c77-e8e0-464b-9395-8be862cb9fcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:05:47.856651 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2042c77-e8e0-464b-9395-8be862cb9fcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:05:47.858654 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2042c77-e8e0-464b-9395-8be862cb9fcc service swift] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:05:47.869763 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1184/2385] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Nov 8 11:05:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 11:06:06.507751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c41d1-3865-4e9e-bfb7-844b3e2e7140 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:06:06.509306 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1d7c41d1-3865-4e9e-bfb7-844b3e2e7140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:06:06.585562 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c41d1-3865-4e9e-bfb7-844b3e2e7140 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:06:06.591549 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c1d12-f197-47c3-b1cf-cc384d625ae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:06:06.592197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c1d12-f197-47c3-b1cf-cc384d625ae5 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:06:06.592477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c1d12-f197-47c3-b1cf-cc384d625ae5 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:06:06.592749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c1d12-f197-47c3-b1cf-cc384d625ae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:06:06.594648 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c30c1d12-f197-47c3-b1cf-cc384d625ae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:06:06.606829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c1d12-f197-47c3-b1cf-cc384d625ae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:06:06.608490 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c1d12-f197-47c3-b1cf-cc384d625ae5 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:06:06.618447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1202/2386] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:06:06 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:06:07.976311 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2042c77-e8e0-464b-9395-8be862cb9fcc service swift] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:06:07.977904 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e2042c77-e8e0-464b-9395-8be862cb9fcc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:06:08.036199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2042c77-e8e0-464b-9395-8be862cb9fcc service swift] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:06:08.040044 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f9ad2-4e26-439d-a7f5-fe7d02203597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:06:08.040700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f9ad2-4e26-439d-a7f5-fe7d02203597 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:06:08.041008 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f9ad2-4e26-439d-a7f5-fe7d02203597 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:06:08.041260 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f9ad2-4e26-439d-a7f5-fe7d02203597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:06:08.043337 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d43f9ad2-4e26-439d-a7f5-fe7d02203597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:06:08.057637 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f9ad2-4e26-439d-a7f5-fe7d02203597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:06:08.059097 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f9ad2-4e26-439d-a7f5-fe7d02203597 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:06:08.070810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1185/2387] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:06:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:06:12.799419 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c1d12-f197-47c3-b1cf-cc384d625ae5 service nova] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:06:12.801053 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c30c1d12-f197-47c3-b1cf-cc384d625ae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:06:12.813874 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c1d12-f197-47c3-b1cf-cc384d625ae5 service nova] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:06:12.817883 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf17af-c5fb-464d-b9a3-5b5ddfeb1dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:06:12.818572 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf17af-c5fb-464d-b9a3-5b5ddfeb1dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:06:12.818854 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf17af-c5fb-464d-b9a3-5b5ddfeb1dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:06:12.819142 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf17af-c5fb-464d-b9a3-5b5ddfeb1dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:06:12.821037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-07bf17af-c5fb-464d-b9a3-5b5ddfeb1dd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:06:12.882261 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf17af-c5fb-464d-b9a3-5b5ddfeb1dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:06:12.883786 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf17af-c5fb-464d-b9a3-5b5ddfeb1dd1 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:06:12.893579 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1203/2388] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:06:12 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:06:14.190870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc21ef-0304-4879-b4fb-d25d472e91da None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:06:14.191486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc21ef-0304-4879-b4fb-d25d472e91da None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:06:14.191600 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc21ef-0304-4879-b4fb-d25d472e91da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:06:14.213754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-eddc21ef-0304-4879-b4fb-d25d472e91da None None] MFA Rules not processed for user `763c552499cc4f2ca8e7070f822f51b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:06:14.215011 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-eddc21ef-0304-4879-b4fb-d25d472e91da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:06:14.223240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1186/2389] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:06:14 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:06:14.581047 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf17af-c5fb-464d-b9a3-5b5ddfeb1dd1 service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:06:14.590278 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf17af-c5fb-464d-b9a3-5b5ddfeb1dd1 service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:06:14.595084 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade881eb-42cb-48df-a557-30d7dc26dbbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:06:14.595753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade881eb-42cb-48df-a557-30d7dc26dbbb service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:06:14.596024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade881eb-42cb-48df-a557-30d7dc26dbbb service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:06:14.596290 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade881eb-42cb-48df-a557-30d7dc26dbbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:06:14.598485 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ade881eb-42cb-48df-a557-30d7dc26dbbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:06:14.609362 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade881eb-42cb-48df-a557-30d7dc26dbbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:06:14.611824 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade881eb-42cb-48df-a557-30d7dc26dbbb service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:06:14.624264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1204/2390] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:06:14 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:06:14.954613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc21ef-0304-4879-b4fb-d25d472e91da None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:06:14.956281 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-eddc21ef-0304-4879-b4fb-d25d472e91da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:06:14.960135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade881eb-42cb-48df-a557-30d7dc26dbbb service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:06:14.968744 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade881eb-42cb-48df-a557-30d7dc26dbbb service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:06:14.973374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f04d58-a20f-4caf-9102-885a4623b694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:06:14.974040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f04d58-a20f-4caf-9102-885a4623b694 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:06:14.974321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f04d58-a20f-4caf-9102-885a4623b694 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:06:14.974595 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f04d58-a20f-4caf-9102-885a4623b694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:06:14.976462 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-04f04d58-a20f-4caf-9102-885a4623b694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:06:14.990494 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f04d58-a20f-4caf-9102-885a4623b694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:06:14.991967 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f04d58-a20f-4caf-9102-885a4623b694 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:06:15.003890 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1205/2391] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:06:14 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:06:15.031869 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc21ef-0304-4879-b4fb-d25d472e91da None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:06:15.037048 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba541e3-8022-442f-b7bb-8f13503b1536 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '642c2b97ece34d69bacd821b108bd210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:06:15.037734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba541e3-8022-442f-b7bb-8f13503b1536 service placement] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:06:15.038012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba541e3-8022-442f-b7bb-8f13503b1536 service placement] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:06:15.038286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba541e3-8022-442f-b7bb-8f13503b1536 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:06:15.040146 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8ba541e3-8022-442f-b7bb-8f13503b1536 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:06:15.052123 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba541e3-8022-442f-b7bb-8f13503b1536 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:06:15.054667 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba541e3-8022-442f-b7bb-8f13503b1536 service placement] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:06:15.064794 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1187/2392] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:06:14 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:06:26.882806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f04d58-a20f-4caf-9102-885a4623b694 service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:06:26.896844 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f04d58-a20f-4caf-9102-885a4623b694 service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:06:26.897826 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152875ca-511a-498d-8963-058e1905df0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:06:26.898534 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152875ca-511a-498d-8963-058e1905df0c service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:06:26.898821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152875ca-511a-498d-8963-058e1905df0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:06:26.899100 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152875ca-511a-498d-8963-058e1905df0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:06:26.901147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-152875ca-511a-498d-8963-058e1905df0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:06:26.912452 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152875ca-511a-498d-8963-058e1905df0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:06:26.914643 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152875ca-511a-498d-8963-058e1905df0c service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:06:26.923804 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1206/2393] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:06:26 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:08:22.287854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba541e3-8022-442f-b7bb-8f13503b1536 service placement] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:08:22.289467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8ba541e3-8022-442f-b7bb-8f13503b1536 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:08:22.354559 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba541e3-8022-442f-b7bb-8f13503b1536 service placement] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:08:22.358500 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6598578-82e0-40d2-966f-cca1d703587f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:08:22.359255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6598578-82e0-40d2-966f-cca1d703587f service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:08:22.359535 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6598578-82e0-40d2-966f-cca1d703587f service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:08:22.359805 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6598578-82e0-40d2-966f-cca1d703587f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:08:22.361746 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b6598578-82e0-40d2-966f-cca1d703587f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:08:22.423629 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6598578-82e0-40d2-966f-cca1d703587f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:08:22.425068 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6598578-82e0-40d2-966f-cca1d703587f service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:08:22.435639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1188/2394] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:08:22 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:10:08.929947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152875ca-511a-498d-8963-058e1905df0c service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:10:08.932063 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-152875ca-511a-498d-8963-058e1905df0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:10:08.952265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152875ca-511a-498d-8963-058e1905df0c service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:10:08.958812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903e9eb-217a-4c58-8959-3e89534c6695 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '642c2b97ece34d69bacd821b108bd210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:10:08.959513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e9eb-217a-4c58-8959-3e89534c6695 service placement] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:10:08.959808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e9eb-217a-4c58-8959-3e89534c6695 service placement] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:10:08.960161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e9eb-217a-4c58-8959-3e89534c6695 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:10:08.962158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a903e9eb-217a-4c58-8959-3e89534c6695 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:10:08.976060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903e9eb-217a-4c58-8959-3e89534c6695 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:10:08.977833 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903e9eb-217a-4c58-8959-3e89534c6695 service placement] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:10:08.989642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1207/2395] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:10:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:10:10.038100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6598578-82e0-40d2-966f-cca1d703587f service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:10:10.052133 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6598578-82e0-40d2-966f-cca1d703587f service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:10:10.058700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763189b-307a-4fce-9a11-072223c5cff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:10:10.059763 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763189b-307a-4fce-9a11-072223c5cff9 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:10:10.060114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763189b-307a-4fce-9a11-072223c5cff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:10:10.060499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763189b-307a-4fce-9a11-072223c5cff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:10:10.063528 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c763189b-307a-4fce-9a11-072223c5cff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:10:10.124521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763189b-307a-4fce-9a11-072223c5cff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:10:10.126057 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763189b-307a-4fce-9a11-072223c5cff9 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:10:10.136496 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1189/2396] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:10:10 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:10:19.687685 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903e9eb-217a-4c58-8959-3e89534c6695 service placement] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:10:19.689314 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a903e9eb-217a-4c58-8959-3e89534c6695 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:10:19.701829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903e9eb-217a-4c58-8959-3e89534c6695 service placement] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:10:19.706773 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a940d8f-cf7f-4bda-a6a4-d2d57e9799d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:10:19.707552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a940d8f-cf7f-4bda-a6a4-d2d57e9799d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:10:19.707910 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a940d8f-cf7f-4bda-a6a4-d2d57e9799d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:10:19.708258 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a940d8f-cf7f-4bda-a6a4-d2d57e9799d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:10:19.718493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a940d8f-cf7f-4bda-a6a4-d2d57e9799d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:10:19.719909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a940d8f-cf7f-4bda-a6a4-d2d57e9799d3 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:10:19.731144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1208/2397] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:10:19 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:11:07.037267 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763189b-307a-4fce-9a11-072223c5cff9 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:07.047624 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763189b-307a-4fce-9a11-072223c5cff9 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:07.052351 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1abcc-781a-4ad1-b06b-56935a409f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:07.053722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1abcc-781a-4ad1-b06b-56935a409f8c service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:07.053722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1abcc-781a-4ad1-b06b-56935a409f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:07.054024 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1abcc-781a-4ad1-b06b-56935a409f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:07.071160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1abcc-781a-4ad1-b06b-56935a409f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:07.072901 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1abcc-781a-4ad1-b06b-56935a409f8c service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:07.112322 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1190/2398] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:11:07 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:11:12.720699 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a940d8f-cf7f-4bda-a6a4-d2d57e9799d3 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:12.730248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a940d8f-cf7f-4bda-a6a4-d2d57e9799d3 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:12.734985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d24317-d0ee-4bab-a8ef-a9b76bc5baab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:12.735673 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d24317-d0ee-4bab-a8ef-a9b76bc5baab service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:12.735958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d24317-d0ee-4bab-a8ef-a9b76bc5baab service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:12.736221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d24317-d0ee-4bab-a8ef-a9b76bc5baab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:12.745721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d24317-d0ee-4bab-a8ef-a9b76bc5baab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:12.747163 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d24317-d0ee-4bab-a8ef-a9b76bc5baab service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:12.777584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1209/2399] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:11:12 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:11:49.238626 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1abcc-781a-4ad1-b06b-56935a409f8c service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:49.240225 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-aac1abcc-781a-4ad1-b06b-56935a409f8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:11:49.309662 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1abcc-781a-4ad1-b06b-56935a409f8c service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:49.314571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd4a4c-b9f4-4f59-b8d5-5abeda416951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:49.315647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd4a4c-b9f4-4f59-b8d5-5abeda416951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:49.315921 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd4a4c-b9f4-4f59-b8d5-5abeda416951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:49.316192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd4a4c-b9f4-4f59-b8d5-5abeda416951 admin admin] PATH_INFO: `/v3/users/4c743071c99a431291b1855534649a8c` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:49.317457 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd4a4c-b9f4-4f59-b8d5-5abeda416951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c743071c99a431291b1855534649a8c)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:49.319403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd4a4c-b9f4-4f59-b8d5-5abeda416951 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:49.371559 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-85bd4a4c-b9f4-4f59-b8d5-5abeda416951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c743071c99a431291b1855534649a8c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:11:49.372286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-85bd4a4c-b9f4-4f59-b8d5-5abeda416951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c743071c99a431291b1855534649a8c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:11:49.381330 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-85bd4a4c-b9f4-4f59-b8d5-5abeda416951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c743071c99a431291b1855534649a8c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:11:49.381986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-85bd4a4c-b9f4-4f59-b8d5-5abeda416951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c743071c99a431291b1855534649a8c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:11:49.389565 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-85bd4a4c-b9f4-4f59-b8d5-5abeda416951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c743071c99a431291b1855534649a8c'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:11:49.411622 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1191/2400] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:11:49 2021] DELETE /identity/v3/users/4c743071c99a431291b1855534649a8c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:11:49.417123 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc03d6-ca30-4cfa-8a24-674566a193c0 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:49.417848 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc03d6-ca30-4cfa-8a24-674566a193c0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:49.417848 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc03d6-ca30-4cfa-8a24-674566a193c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:49.436428 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-dcbc03d6-ca30-4cfa-8a24-674566a193c0 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:11:49.437695 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-dcbc03d6-ca30-4cfa-8a24-674566a193c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:11:49.503687 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1210/2401] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:11:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:11:49.514851 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd4a4c-b9f4-4f59-b8d5-5abeda416951 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:49.516725 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-85bd4a4c-b9f4-4f59-b8d5-5abeda416951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:11:49.579308 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd4a4c-b9f4-4f59-b8d5-5abeda416951 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:49.583335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ab0e4-dd33-4c70-83b0-3c0d1865e359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:49.584071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ab0e4-dd33-4c70-83b0-3c0d1865e359 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:49.584916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ab0e4-dd33-4c70-83b0-3c0d1865e359 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:49.584916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ab0e4-dd33-4c70-83b0-3c0d1865e359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:49.597246 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ab0e4-dd33-4c70-83b0-3c0d1865e359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:49.598729 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ab0e4-dd33-4c70-83b0-3c0d1865e359 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:49.609996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1192/2402] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:11:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:11:49.789770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc03d6-ca30-4cfa-8a24-674566a193c0 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:49.791422 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-dcbc03d6-ca30-4cfa-8a24-674566a193c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:11:49.805191 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc03d6-ca30-4cfa-8a24-674566a193c0 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:49.814128 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:49.815646 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:49.815646 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:49.816388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787 admin admin] PATH_INFO: `/v3/projects/cf2112d28b064283bd2b793117948f31` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:49.818231 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2112d28b064283bd2b793117948f31)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:49.820481 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:49.881112 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2112d28b064283bd2b793117948f31', 'request_id': 'req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:11:49.888513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2112d28b064283bd2b793117948f31', 'request_id': 'req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:11:49.895595 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2112d28b064283bd2b793117948f31', 'request_id': 'req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:11:49.908555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787 admin admin] The token cache is being invalidate because project cf2112d28b064283bd2b793117948f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:11:49.909137 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:11:49.909870 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9e3ceeaf-e8e8-4d1d-abe3-cb9625a67787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:11:49.913666 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1211/2403] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:11:49 2021] DELETE /identity/v3/projects/cf2112d28b064283bd2b793117948f31 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:11:49.920467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1e75e-9591-4f42-869f-8096c0ac4814 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:49.920954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1e75e-9591-4f42-869f-8096c0ac4814 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:49.921386 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1e75e-9591-4f42-869f-8096c0ac4814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:49.944885 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-caf1e75e-9591-4f42-869f-8096c0ac4814 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:11:49.946140 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-caf1e75e-9591-4f42-869f-8096c0ac4814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:11:50.011216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1193/2404] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:11:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:11:50.019649 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9baa35-f319-431a-b107-a8e1fc59d440 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:50.019940 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9baa35-f319-431a-b107-a8e1fc59d440 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:50.020220 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9baa35-f319-431a-b107-a8e1fc59d440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:50.040778 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-ed9baa35-f319-431a-b107-a8e1fc59d440 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:11:50.042008 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ed9baa35-f319-431a-b107-a8e1fc59d440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:11:50.050679 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1212/2405] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:11:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:11:50.055440 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1e75e-9591-4f42-869f-8096c0ac4814 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:50.065853 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1e75e-9591-4f42-869f-8096c0ac4814 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:50.071064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5dfc2-7cf9-4092-b91d-a4c639e439c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:50.071811 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5dfc2-7cf9-4092-b91d-a4c639e439c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:50.072134 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5dfc2-7cf9-4092-b91d-a4c639e439c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:50.072441 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5dfc2-7cf9-4092-b91d-a4c639e439c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:50.073240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5dfc2-7cf9-4092-b91d-a4c639e439c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:11:50.073594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5dfc2-7cf9-4092-b91d-a4c639e439c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:50.075290 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5dfc2-7cf9-4092-b91d-a4c639e439c0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:50.089569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1194/2406] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:11:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:11:50.093969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9baa35-f319-431a-b107-a8e1fc59d440 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:50.104270 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9baa35-f319-431a-b107-a8e1fc59d440 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:50.109591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19934e4d-b256-4f8b-9049-35394c63749d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:50.110257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19934e4d-b256-4f8b-9049-35394c63749d admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:50.110523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19934e4d-b256-4f8b-9049-35394c63749d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:50.110821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19934e4d-b256-4f8b-9049-35394c63749d admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:50.111586 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19934e4d-b256-4f8b-9049-35394c63749d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:50.113559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19934e4d-b256-4f8b-9049-35394c63749d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:50.152959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1213/2407] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:11:50 2021] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:11:50.157530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5dfc2-7cf9-4092-b91d-a4c639e439c0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:50.170927 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5dfc2-7cf9-4092-b91d-a4c639e439c0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:50.227915 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016d8f4-5950-41f6-aba4-41bfabf9243f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:50.228587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d8f4-5950-41f6-aba4-41bfabf9243f admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:50.228909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d8f4-5950-41f6-aba4-41bfabf9243f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:50.229169 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016d8f4-5950-41f6-aba4-41bfabf9243f admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:50.229872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016d8f4-5950-41f6-aba4-41bfabf9243f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:50.231852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016d8f4-5950-41f6-aba4-41bfabf9243f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:50.257499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1195/2408] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:11:50 2021] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:11:50.260509 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19934e4d-b256-4f8b-9049-35394c63749d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:50.276323 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19934e4d-b256-4f8b-9049-35394c63749d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:50.281265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b67f7-2852-443a-8485-6e7d71dd3017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:50.281951 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b67f7-2852-443a-8485-6e7d71dd3017 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:50.282245 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b67f7-2852-443a-8485-6e7d71dd3017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:50.282924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b67f7-2852-443a-8485-6e7d71dd3017 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:50.283394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b67f7-2852-443a-8485-6e7d71dd3017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:50.286032 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b67f7-2852-443a-8485-6e7d71dd3017 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:50.312102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1214/2409] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:11:50 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:11:50.317114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016d8f4-5950-41f6-aba4-41bfabf9243f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:50.333415 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016d8f4-5950-41f6-aba4-41bfabf9243f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:50.340817 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc3284-d86a-43e9-b4d4-d20548c2e2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:50.341506 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc3284-d86a-43e9-b4d4-d20548c2e2ad admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:50.341833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc3284-d86a-43e9-b4d4-d20548c2e2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:50.342315 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc3284-d86a-43e9-b4d4-d20548c2e2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:50.343753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc3284-d86a-43e9-b4d4-d20548c2e2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:50.346393 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc3284-d86a-43e9-b4d4-d20548c2e2ad admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:50.361267 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1196/2410] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:11:50 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:11:50.365839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b67f7-2852-443a-8485-6e7d71dd3017 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:50.376694 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b67f7-2852-443a-8485-6e7d71dd3017 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:50.382274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913be214-45b6-4c6b-bc66-c8d68330e688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:50.383578 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913be214-45b6-4c6b-bc66-c8d68330e688 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:50.383862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913be214-45b6-4c6b-bc66-c8d68330e688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:50.384137 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913be214-45b6-4c6b-bc66-c8d68330e688 admin admin] PATH_INFO: `/v3/projects/659fac3889964d1cad61a9db97c72ca7/users/2f75c040d8dc4dbd88d0fa1ade9be724/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:50.400555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913be214-45b6-4c6b-bc66-c8d68330e688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=659fac3889964d1cad61a9db97c72ca7, user_id=2f75c040d8dc4dbd88d0fa1ade9be724, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:50.403263 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913be214-45b6-4c6b-bc66-c8d68330e688 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:50.418540 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1215/2411] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:11:50 2021] PUT /identity/v3/projects/659fac3889964d1cad61a9db97c72ca7/users/2f75c040d8dc4dbd88d0fa1ade9be724/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:11:50.424255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8c874-5ceb-4bd6-afe5-61bec7ff2563 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:50.424585 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8c874-5ceb-4bd6-afe5-61bec7ff2563 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:50.424866 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8c874-5ceb-4bd6-afe5-61bec7ff2563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:50.445197 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-54b8c874-5ceb-4bd6-afe5-61bec7ff2563 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:11:50.446443 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-54b8c874-5ceb-4bd6-afe5-61bec7ff2563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:11:50.512986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1197/2412] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:11:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:11:50.523575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913be214-45b6-4c6b-bc66-c8d68330e688 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:50.525471 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-913be214-45b6-4c6b-bc66-c8d68330e688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:11:50.592482 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913be214-45b6-4c6b-bc66-c8d68330e688 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:50.597366 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702c7d2-0415-4699-ac25-e59c55a6aedd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:50.598043 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702c7d2-0415-4699-ac25-e59c55a6aedd service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:50.598324 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702c7d2-0415-4699-ac25-e59c55a6aedd service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:50.598603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702c7d2-0415-4699-ac25-e59c55a6aedd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:50.608438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702c7d2-0415-4699-ac25-e59c55a6aedd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:50.609854 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702c7d2-0415-4699-ac25-e59c55a6aedd service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:50.621701 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1216/2413] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:11:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:11:55.188777 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05633c57-0804-4dfd-a167-fea194998fb9 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:55.189387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05633c57-0804-4dfd-a167-fea194998fb9 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:55.189387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05633c57-0804-4dfd-a167-fea194998fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:55.218994 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-05633c57-0804-4dfd-a167-fea194998fb9 None None] MFA Rules not processed for user `2f75c040d8dc4dbd88d0fa1ade9be724`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:11:55.220360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-05633c57-0804-4dfd-a167-fea194998fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:11:55.294231 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1198/2414] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:11:55 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:11:55.299019 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702c7d2-0415-4699-ac25-e59c55a6aedd service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:55.309989 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702c7d2-0415-4699-ac25-e59c55a6aedd service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:55.315542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c113-161f-44b2-8aa6-893ace140dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:55.316218 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c113-161f-44b2-8aa6-893ace140dcd admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:55.316720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c113-161f-44b2-8aa6-893ace140dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:55.316993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c113-161f-44b2-8aa6-893ace140dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:55.317921 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7c113-161f-44b2-8aa6-893ace140dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:55.319900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7c113-161f-44b2-8aa6-893ace140dcd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:55.350909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1217/2415] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:11:55 2021] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:11:55.355064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05633c57-0804-4dfd-a167-fea194998fb9 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:55.367398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05633c57-0804-4dfd-a167-fea194998fb9 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:55.440530 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64af69-69a1-4a18-aad7-b21a94933a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:55.441671 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64af69-69a1-4a18-aad7-b21a94933a09 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:55.442152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64af69-69a1-4a18-aad7-b21a94933a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:55.442647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64af69-69a1-4a18-aad7-b21a94933a09 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:55.443906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64af69-69a1-4a18-aad7-b21a94933a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:55.446286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64af69-69a1-4a18-aad7-b21a94933a09 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:55.477329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1199/2416] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:11:55 2021] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:11:55.481728 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c113-161f-44b2-8aa6-893ace140dcd admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:55.492547 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c113-161f-44b2-8aa6-893ace140dcd admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:55.499113 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa28ad-a953-4085-8672-ffccc2f2a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:55.499829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa28ad-a953-4085-8672-ffccc2f2a8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:55.500111 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa28ad-a953-4085-8672-ffccc2f2a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:55.500500 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa28ad-a953-4085-8672-ffccc2f2a8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:55.501261 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa28ad-a953-4085-8672-ffccc2f2a8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:55.502900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa28ad-a953-4085-8672-ffccc2f2a8f9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:55.515197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1218/2417] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:11:55 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:11:55.519852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64af69-69a1-4a18-aad7-b21a94933a09 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:55.531592 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64af69-69a1-4a18-aad7-b21a94933a09 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:55.537686 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c700cda-6040-49d7-895a-7da004247a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:55.538908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700cda-6040-49d7-895a-7da004247a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:55.539320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700cda-6040-49d7-895a-7da004247a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:55.539672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c700cda-6040-49d7-895a-7da004247a99 admin admin] PATH_INFO: `/v3/projects/8f6692a0c3f347daabf588549b3cebe4/users/1edb8ecbddb74245b1f4ea83256a1ba0/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:55.560876 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c700cda-6040-49d7-895a-7da004247a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6692a0c3f347daabf588549b3cebe4, user_id=1edb8ecbddb74245b1f4ea83256a1ba0, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:55.563738 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c700cda-6040-49d7-895a-7da004247a99 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:55.582077 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1200/2418] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:11:55 2021] PUT /identity/v3/projects/8f6692a0c3f347daabf588549b3cebe4/users/1edb8ecbddb74245b1f4ea83256a1ba0/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:11:55.586208 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa28ad-a953-4085-8672-ffccc2f2a8f9 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:55.597207 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa28ad-a953-4085-8672-ffccc2f2a8f9 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:55.659447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85454bea-a10b-4baf-b239-242044e3620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:55.660657 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85454bea-a10b-4baf-b239-242044e3620e admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:55.661165 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85454bea-a10b-4baf-b239-242044e3620e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:55.661742 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85454bea-a10b-4baf-b239-242044e3620e admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:55.662504 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85454bea-a10b-4baf-b239-242044e3620e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:55.664186 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85454bea-a10b-4baf-b239-242044e3620e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:55.675465 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1219/2419] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:11:55 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:11:55.680198 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c700cda-6040-49d7-895a-7da004247a99 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:11:55.691526 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c700cda-6040-49d7-895a-7da004247a99 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:11:55.697848 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cd4e6-dcc2-4a17-9ae4-92519d4b9ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:11:55.698944 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cd4e6-dcc2-4a17-9ae4-92519d4b9ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:11:55.699602 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cd4e6-dcc2-4a17-9ae4-92519d4b9ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:11:55.699954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cd4e6-dcc2-4a17-9ae4-92519d4b9ba0 admin admin] PATH_INFO: `/v3/projects/8f6692a0c3f347daabf588549b3cebe4/users/1edb8ecbddb74245b1f4ea83256a1ba0/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:11:55.702182 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cd4e6-dcc2-4a17-9ae4-92519d4b9ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6692a0c3f347daabf588549b3cebe4, user_id=1edb8ecbddb74245b1f4ea83256a1ba0, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:11:55.705129 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cd4e6-dcc2-4a17-9ae4-92519d4b9ba0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:11:55.716598 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1201/2420] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:11:55 2021] PUT /identity/v3/projects/8f6692a0c3f347daabf588549b3cebe4/users/1edb8ecbddb74245b1f4ea83256a1ba0/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:12:00.149431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f4820-cb98-4dd9-b3a9-06bdec87eb7e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:12:00.149950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f4820-cb98-4dd9-b3a9-06bdec87eb7e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:12:00.149950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f4820-cb98-4dd9-b3a9-06bdec87eb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:12:00.177484 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-a91f4820-cb98-4dd9-b3a9-06bdec87eb7e None None] MFA Rules not processed for user `1edb8ecbddb74245b1f4ea83256a1ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:12:00.178867 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a91f4820-cb98-4dd9-b3a9-06bdec87eb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:12:00.245544 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1220/2421] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:12:00 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:12:00.268343 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cd4e6-dcc2-4a17-9ae4-92519d4b9ba0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:12:00.270189 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-535cd4e6-dcc2-4a17-9ae4-92519d4b9ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:12:00.359600 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cd4e6-dcc2-4a17-9ae4-92519d4b9ba0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:12:00.365694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc986974-2df0-446b-8833-da72ea3a1874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:12:00.366363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc986974-2df0-446b-8833-da72ea3a1874 service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:12:00.372134 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc986974-2df0-446b-8833-da72ea3a1874 service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:12:00.372134 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc986974-2df0-446b-8833-da72ea3a1874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:12:00.428974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc986974-2df0-446b-8833-da72ea3a1874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:12:00.430590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc986974-2df0-446b-8833-da72ea3a1874 service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:12:00.440173 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1202/2422] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:12:00 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:12:01.869252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f476338-0238-458b-9653-2cf009cdfb5e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:12:01.869821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f476338-0238-458b-9653-2cf009cdfb5e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:12:01.869821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f476338-0238-458b-9653-2cf009cdfb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:12:01.901224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-1f476338-0238-458b-9653-2cf009cdfb5e None None] MFA Rules not processed for user `2f75c040d8dc4dbd88d0fa1ade9be724`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:12:01.906316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1f476338-0238-458b-9653-2cf009cdfb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:12:01.947019 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1221/2423] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:12:01 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:12:17.634300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc986974-2df0-446b-8833-da72ea3a1874 service nova] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:12:17.706718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc986974-2df0-446b-8833-da72ea3a1874 service nova] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:12:17.710771 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e43d1b-30ac-4f08-8216-106e2b768d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:12:17.711446 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e43d1b-30ac-4f08-8216-106e2b768d9f service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:12:17.711703 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e43d1b-30ac-4f08-8216-106e2b768d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:12:17.711971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e43d1b-30ac-4f08-8216-106e2b768d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:12:17.713844 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f7e43d1b-30ac-4f08-8216-106e2b768d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:12:17.723669 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e43d1b-30ac-4f08-8216-106e2b768d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:12:17.725031 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e43d1b-30ac-4f08-8216-106e2b768d9f service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:12:17.732939 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1203/2424] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:12:17 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:12:36.977320 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f476338-0238-458b-9653-2cf009cdfb5e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:12:36.994922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f476338-0238-458b-9653-2cf009cdfb5e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:12:37.001881 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c607b2-7cdb-4a3c-8677-379376ea69f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:12:37.002541 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c607b2-7cdb-4a3c-8677-379376ea69f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:12:37.002829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c607b2-7cdb-4a3c-8677-379376ea69f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:12:37.003110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c607b2-7cdb-4a3c-8677-379376ea69f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:12:37.005205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-51c607b2-7cdb-4a3c-8677-379376ea69f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:12:37.020541 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c607b2-7cdb-4a3c-8677-379376ea69f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:12:37.022002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c607b2-7cdb-4a3c-8677-379376ea69f6 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:12:37.033850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1222/2425] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:12:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:12:38.320411 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e43d1b-30ac-4f08-8216-106e2b768d9f service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:12:38.329353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e43d1b-30ac-4f08-8216-106e2b768d9f service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:12:38.334150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a2bb4-0afc-4523-badd-2e9b6dafdf95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:12:38.334946 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a2bb4-0afc-4523-badd-2e9b6dafdf95 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:12:38.335082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a2bb4-0afc-4523-badd-2e9b6dafdf95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:12:38.335375 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a2bb4-0afc-4523-badd-2e9b6dafdf95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:12:38.337155 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c74a2bb4-0afc-4523-badd-2e9b6dafdf95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:12:38.351269 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a2bb4-0afc-4523-badd-2e9b6dafdf95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:12:38.353006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a2bb4-0afc-4523-badd-2e9b6dafdf95 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:12:38.365027 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1204/2426] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:12:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:12:38.548976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c607b2-7cdb-4a3c-8677-379376ea69f6 service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:12:38.562530 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c607b2-7cdb-4a3c-8677-379376ea69f6 service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:12:38.570475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3c46c-4653-4d07-a8af-b6e00497f156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:12:38.571315 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c46c-4653-4d07-a8af-b6e00497f156 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:12:38.571693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c46c-4653-4d07-a8af-b6e00497f156 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:12:38.572035 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c46c-4653-4d07-a8af-b6e00497f156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:12:38.574044 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a7d3c46c-4653-4d07-a8af-b6e00497f156 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:12:38.588331 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3c46c-4653-4d07-a8af-b6e00497f156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:12:38.589950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3c46c-4653-4d07-a8af-b6e00497f156 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:12:38.602407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1223/2427] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:12:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:13:22.439311 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a2bb4-0afc-4523-badd-2e9b6dafdf95 service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:13:22.441199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c74a2bb4-0afc-4523-badd-2e9b6dafdf95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:13:22.505401 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a2bb4-0afc-4523-badd-2e9b6dafdf95 service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:13:22.510267 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73ee46-1dcb-4972-ae7e-bbf9c5f04dd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:13:22.510932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73ee46-1dcb-4972-ae7e-bbf9c5f04dd9 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:13:22.511253 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73ee46-1dcb-4972-ae7e-bbf9c5f04dd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:13:22.511532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73ee46-1dcb-4972-ae7e-bbf9c5f04dd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:13:22.513545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-bb73ee46-1dcb-4972-ae7e-bbf9c5f04dd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:13:22.607341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73ee46-1dcb-4972-ae7e-bbf9c5f04dd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:13:22.609614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73ee46-1dcb-4972-ae7e-bbf9c5f04dd9 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:13:22.623546 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1205/2428] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:13:22 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:15:12.847793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3c46c-4653-4d07-a8af-b6e00497f156 service nova] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:15:12.849866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a7d3c46c-4653-4d07-a8af-b6e00497f156 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:15:13.000557 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3c46c-4653-4d07-a8af-b6e00497f156 service nova] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:15:13.009274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11a00a-6004-4e1b-8155-2c98dbfb1471 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '642c2b97ece34d69bacd821b108bd210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:15:13.010280 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11a00a-6004-4e1b-8155-2c98dbfb1471 service placement] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:15:13.010712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11a00a-6004-4e1b-8155-2c98dbfb1471 service placement] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:15:13.011178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11a00a-6004-4e1b-8155-2c98dbfb1471 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:15:13.014723 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4d11a00a-6004-4e1b-8155-2c98dbfb1471 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:15:13.029946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11a00a-6004-4e1b-8155-2c98dbfb1471 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:15:13.031557 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11a00a-6004-4e1b-8155-2c98dbfb1471 service placement] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:15:13.041841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1224/2429] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:15:12 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:15:20.171182 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73ee46-1dcb-4972-ae7e-bbf9c5f04dd9 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:15:20.202451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73ee46-1dcb-4972-ae7e-bbf9c5f04dd9 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:15:20.206596 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da6ac2-a5b7-4cc5-8831-82c53689129d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:15:20.207278 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6ac2-a5b7-4cc5-8831-82c53689129d service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:15:20.207691 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6ac2-a5b7-4cc5-8831-82c53689129d service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:15:20.207980 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6ac2-a5b7-4cc5-8831-82c53689129d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:15:20.210458 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e4da6ac2-a5b7-4cc5-8831-82c53689129d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:15:20.311912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da6ac2-a5b7-4cc5-8831-82c53689129d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:15:20.313394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da6ac2-a5b7-4cc5-8831-82c53689129d service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:15:20.332065 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1206/2430] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:15:20 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:16:07.560821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11a00a-6004-4e1b-8155-2c98dbfb1471 service placement] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:16:07.571363 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11a00a-6004-4e1b-8155-2c98dbfb1471 service placement] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:16:07.575576 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848b906-0cd5-4b5d-bb15-28c3f3014ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:16:07.576220 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848b906-0cd5-4b5d-bb15-28c3f3014ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:16:07.576499 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848b906-0cd5-4b5d-bb15-28c3f3014ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:16:07.576836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848b906-0cd5-4b5d-bb15-28c3f3014ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:16:07.578806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7848b906-0cd5-4b5d-bb15-28c3f3014ad9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:16:07.649011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848b906-0cd5-4b5d-bb15-28c3f3014ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:16:07.650484 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848b906-0cd5-4b5d-bb15-28c3f3014ad9 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:16:07.659473 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1225/2431] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:16:07 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:16:12.969896 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da6ac2-a5b7-4cc5-8831-82c53689129d service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:16:12.971489 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e4da6ac2-a5b7-4cc5-8831-82c53689129d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:16:12.998825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da6ac2-a5b7-4cc5-8831-82c53689129d service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:16:13.002747 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd7ab1-94ae-4323-b92a-2ba3653a6b76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:16:13.003490 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd7ab1-94ae-4323-b92a-2ba3653a6b76 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:16:13.003692 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd7ab1-94ae-4323-b92a-2ba3653a6b76 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:16:13.003964 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd7ab1-94ae-4323-b92a-2ba3653a6b76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:16:13.005796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-35bd7ab1-94ae-4323-b92a-2ba3653a6b76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:16:13.086997 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd7ab1-94ae-4323-b92a-2ba3653a6b76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:16:13.089152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd7ab1-94ae-4323-b92a-2ba3653a6b76 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:16:13.099435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1207/2432] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:16:12 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:17:00.080261 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848b906-0cd5-4b5d-bb15-28c3f3014ad9 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:17:00.089420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848b906-0cd5-4b5d-bb15-28c3f3014ad9 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:17:00.094048 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206164a-e3a6-441e-b17e-fd81c35e932b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:17:00.094704 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206164a-e3a6-441e-b17e-fd81c35e932b service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:00.094985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206164a-e3a6-441e-b17e-fd81c35e932b service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:00.095291 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206164a-e3a6-441e-b17e-fd81c35e932b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:00.105181 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206164a-e3a6-441e-b17e-fd81c35e932b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:17:00.106700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206164a-e3a6-441e-b17e-fd81c35e932b service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:17:00.116651 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1226/2433] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:17:00 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:17:20.553216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd7ab1-94ae-4323-b92a-2ba3653a6b76 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:17:20.555846 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-35bd7ab1-94ae-4323-b92a-2ba3653a6b76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:17:20.676301 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd7ab1-94ae-4323-b92a-2ba3653a6b76 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:17:20.684064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e19327-8a72-4f48-85fb-1e7fec031f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:17:20.685199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e19327-8a72-4f48-85fb-1e7fec031f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:20.685549 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e19327-8a72-4f48-85fb-1e7fec031f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:20.685825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e19327-8a72-4f48-85fb-1e7fec031f0b admin admin] PATH_INFO: `/v3/users/90b810b6e3a6435e88273d0c53bf0d90` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:20.687302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e19327-8a72-4f48-85fb-1e7fec031f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=90b810b6e3a6435e88273d0c53bf0d90)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:17:20.689884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e19327-8a72-4f48-85fb-1e7fec031f0b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:17:20.747253 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e0e19327-8a72-4f48-85fb-1e7fec031f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90b810b6e3a6435e88273d0c53bf0d90'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:17:20.747890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e0e19327-8a72-4f48-85fb-1e7fec031f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90b810b6e3a6435e88273d0c53bf0d90'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:17:20.755996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e0e19327-8a72-4f48-85fb-1e7fec031f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90b810b6e3a6435e88273d0c53bf0d90'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:17:20.756700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e0e19327-8a72-4f48-85fb-1e7fec031f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90b810b6e3a6435e88273d0c53bf0d90'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:17:20.764290 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e0e19327-8a72-4f48-85fb-1e7fec031f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90b810b6e3a6435e88273d0c53bf0d90'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:17:20.781533 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1208/2434] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:17:20 2021] DELETE /identity/v3/users/90b810b6e3a6435e88273d0c53bf0d90 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:17:20.786298 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65782ad-3b2f-48f6-97a6-5b6d2ecf3825 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:20.786794 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65782ad-3b2f-48f6-97a6-5b6d2ecf3825 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:20.786912 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65782ad-3b2f-48f6-97a6-5b6d2ecf3825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:20.812493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-b65782ad-3b2f-48f6-97a6-5b6d2ecf3825 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:17:20.814151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b65782ad-3b2f-48f6-97a6-5b6d2ecf3825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:17:20.886430 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1227/2435] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:17:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:17:20.897698 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e19327-8a72-4f48-85fb-1e7fec031f0b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:17:20.899670 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e0e19327-8a72-4f48-85fb-1e7fec031f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:17:20.985905 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e19327-8a72-4f48-85fb-1e7fec031f0b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:17:20.990226 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762a71f-3acd-48a0-956d-b7e83681b5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:17:20.990878 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762a71f-3acd-48a0-956d-b7e83681b5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:20.991191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762a71f-3acd-48a0-956d-b7e83681b5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:20.991469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762a71f-3acd-48a0-956d-b7e83681b5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:21.000919 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762a71f-3acd-48a0-956d-b7e83681b5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:17:21.003506 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762a71f-3acd-48a0-956d-b7e83681b5f9 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:17:21.014618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1209/2436] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:17:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:17:21.317670 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65782ad-3b2f-48f6-97a6-5b6d2ecf3825 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:17:21.320824 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b65782ad-3b2f-48f6-97a6-5b6d2ecf3825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:17:21.337759 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65782ad-3b2f-48f6-97a6-5b6d2ecf3825 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:17:21.344397 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d167c1-ed21-41df-9ebf-26f0510f5be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:17:21.345465 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d167c1-ed21-41df-9ebf-26f0510f5be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:21.345753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d167c1-ed21-41df-9ebf-26f0510f5be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:21.346262 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d167c1-ed21-41df-9ebf-26f0510f5be5 admin admin] PATH_INFO: `/v3/projects/e2e01728aeec4f289300335f546ae49e` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:21.347791 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d167c1-ed21-41df-9ebf-26f0510f5be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e01728aeec4f289300335f546ae49e)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:17:21.350611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d167c1-ed21-41df-9ebf-26f0510f5be5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:17:21.411292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-23d167c1-ed21-41df-9ebf-26f0510f5be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e01728aeec4f289300335f546ae49e', 'request_id': 'req-23d167c1-ed21-41df-9ebf-26f0510f5be5'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:17:21.417621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-23d167c1-ed21-41df-9ebf-26f0510f5be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e01728aeec4f289300335f546ae49e', 'request_id': 'req-23d167c1-ed21-41df-9ebf-26f0510f5be5'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:17:21.427148 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-23d167c1-ed21-41df-9ebf-26f0510f5be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e01728aeec4f289300335f546ae49e', 'request_id': 'req-23d167c1-ed21-41df-9ebf-26f0510f5be5'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:17:21.444655 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-23d167c1-ed21-41df-9ebf-26f0510f5be5 admin admin] The token cache is being invalidate because project e2e01728aeec4f289300335f546ae49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:17:21.444998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-23d167c1-ed21-41df-9ebf-26f0510f5be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:17:21.445567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-23d167c1-ed21-41df-9ebf-26f0510f5be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:17:21.447185 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1228/2437] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:17:21 2021] DELETE /identity/v3/projects/e2e01728aeec4f289300335f546ae49e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:17:21.455298 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c047a0-1d17-48d6-8dbe-d4c5b5f8bf50 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:21.455841 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c047a0-1d17-48d6-8dbe-d4c5b5f8bf50 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:21.456129 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c047a0-1d17-48d6-8dbe-d4c5b5f8bf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:21.525969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-75c047a0-1d17-48d6-8dbe-d4c5b5f8bf50 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:17:21.527218 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-75c047a0-1d17-48d6-8dbe-d4c5b5f8bf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:17:21.585025 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1210/2438] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:17:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:17:21.593730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a0e37-b160-49c4-9856-0a525a42791e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:21.594079 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a0e37-b160-49c4-9856-0a525a42791e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:21.594555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a0e37-b160-49c4-9856-0a525a42791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:21.613909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-699a0e37-b160-49c4-9856-0a525a42791e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:17:21.615154 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-699a0e37-b160-49c4-9856-0a525a42791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:17:21.623642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1229/2439] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:17:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:17:21.629205 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c047a0-1d17-48d6-8dbe-d4c5b5f8bf50 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:17:21.645266 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c047a0-1d17-48d6-8dbe-d4c5b5f8bf50 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:17:21.653320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c118ea4-174c-467c-8df1-e737a880f10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:17:21.654109 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c118ea4-174c-467c-8df1-e737a880f10d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:21.654464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c118ea4-174c-467c-8df1-e737a880f10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:21.654748 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c118ea4-174c-467c-8df1-e737a880f10d admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:21.655730 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c118ea4-174c-467c-8df1-e737a880f10d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:17:21.656039 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c118ea4-174c-467c-8df1-e737a880f10d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:17:21.657835 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c118ea4-174c-467c-8df1-e737a880f10d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:17:21.670204 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1211/2440] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:17:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:17:21.675956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a0e37-b160-49c4-9856-0a525a42791e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:17:21.687784 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a0e37-b160-49c4-9856-0a525a42791e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:17:21.692913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c87589-17bf-40b6-9df2-919529745937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:17:21.693575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c87589-17bf-40b6-9df2-919529745937 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:21.693861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c87589-17bf-40b6-9df2-919529745937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:21.694137 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c87589-17bf-40b6-9df2-919529745937 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:21.694846 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c87589-17bf-40b6-9df2-919529745937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:17:21.697381 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c87589-17bf-40b6-9df2-919529745937 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:17:21.725898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1230/2441] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:17:21 2021] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:17:21.730401 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c118ea4-174c-467c-8df1-e737a880f10d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:17:21.740988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c118ea4-174c-467c-8df1-e737a880f10d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:17:21.800091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4c533-1579-4708-8735-12c724790189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:17:21.800677 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4c533-1579-4708-8735-12c724790189 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:21.800957 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4c533-1579-4708-8735-12c724790189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:21.801239 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4c533-1579-4708-8735-12c724790189 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:21.801961 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4c533-1579-4708-8735-12c724790189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:17:21.803936 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4c533-1579-4708-8735-12c724790189 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:17:21.825120 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1212/2442] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:17:21 2021] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:17:21.830270 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c87589-17bf-40b6-9df2-919529745937 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:17:21.843450 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c87589-17bf-40b6-9df2-919529745937 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:17:21.850512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbbb17-b3df-4389-836d-b526b0095d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:17:21.851588 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbbb17-b3df-4389-836d-b526b0095d91 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:21.851919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbbb17-b3df-4389-836d-b526b0095d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:21.852234 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbbb17-b3df-4389-836d-b526b0095d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:21.853298 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbbb17-b3df-4389-836d-b526b0095d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:17:21.855446 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbbb17-b3df-4389-836d-b526b0095d91 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:17:21.867749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1231/2443] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:17:21 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:17:21.872321 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4c533-1579-4708-8735-12c724790189 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:17:21.884807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4c533-1579-4708-8735-12c724790189 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:17:21.890565 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f4199-e7fc-42fa-aa3a-11259e6efd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:17:21.891925 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f4199-e7fc-42fa-aa3a-11259e6efd3f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:21.892175 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f4199-e7fc-42fa-aa3a-11259e6efd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:21.892472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f4199-e7fc-42fa-aa3a-11259e6efd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:21.893194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f4199-e7fc-42fa-aa3a-11259e6efd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:17:21.894836 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f4199-e7fc-42fa-aa3a-11259e6efd3f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:17:21.911692 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1213/2444] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:17:21 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:17:21.918157 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbbb17-b3df-4389-836d-b526b0095d91 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:17:21.928965 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbbb17-b3df-4389-836d-b526b0095d91 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:17:21.934232 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a4c6a-20a2-4b64-975c-9a169631e41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:17:21.935104 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a4c6a-20a2-4b64-975c-9a169631e41f admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:21.935408 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a4c6a-20a2-4b64-975c-9a169631e41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:21.935680 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a4c6a-20a2-4b64-975c-9a169631e41f admin admin] PATH_INFO: `/v3/projects/a64819123f12429aa1a4374d5543b71f/users/e7afbb0fd7c54712b600ae6826dd7220/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:21.950676 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a4c6a-20a2-4b64-975c-9a169631e41f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64819123f12429aa1a4374d5543b71f, user_id=e7afbb0fd7c54712b600ae6826dd7220, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:17:21.953415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a4c6a-20a2-4b64-975c-9a169631e41f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:17:21.969248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1232/2445] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:17:21 2021] PUT /identity/v3/projects/a64819123f12429aa1a4374d5543b71f/users/e7afbb0fd7c54712b600ae6826dd7220/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:17:21.985694 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7cd8e-7142-4f38-b7dd-cbc99931cdab None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:21.985981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7cd8e-7142-4f38-b7dd-cbc99931cdab None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:21.986258 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7cd8e-7142-4f38-b7dd-cbc99931cdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:22.014155 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-a0f7cd8e-7142-4f38-b7dd-cbc99931cdab None None] MFA Rules not processed for user `e7afbb0fd7c54712b600ae6826dd7220`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:17:22.015401 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-a0f7cd8e-7142-4f38-b7dd-cbc99931cdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:17:22.098421 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1214/2446] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:17:21 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:17:22.109068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a4c6a-20a2-4b64-975c-9a169631e41f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:17:22.110977 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6e7a4c6a-20a2-4b64-975c-9a169631e41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:17:22.175541 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a4c6a-20a2-4b64-975c-9a169631e41f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:17:22.179952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fead4b-4ec0-4a8e-a847-f24400cce38f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:17:22.180607 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fead4b-4ec0-4a8e-a847-f24400cce38f service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:17:22.180897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fead4b-4ec0-4a8e-a847-f24400cce38f service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:17:22.181183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fead4b-4ec0-4a8e-a847-f24400cce38f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:17:22.190110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fead4b-4ec0-4a8e-a847-f24400cce38f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:17:22.191615 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fead4b-4ec0-4a8e-a847-f24400cce38f service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:17:22.200341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1233/2447] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:17:22 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:18:02.688089 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7cd8e-7142-4f38-b7dd-cbc99931cdab None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:02.689690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-a0f7cd8e-7142-4f38-b7dd-cbc99931cdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:18:02.748772 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7cd8e-7142-4f38-b7dd-cbc99931cdab None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:02.753111 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29fb07-4d68-4b02-991d-564e23d63f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:02.753921 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29fb07-4d68-4b02-991d-564e23d63f25 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:02.754177 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29fb07-4d68-4b02-991d-564e23d63f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:02.754479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29fb07-4d68-4b02-991d-564e23d63f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:02.756982 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-4e29fb07-4d68-4b02-991d-564e23d63f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:18:02.828844 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29fb07-4d68-4b02-991d-564e23d63f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:02.830216 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29fb07-4d68-4b02-991d-564e23d63f25 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:02.841073 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1215/2448] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:18:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:18:10.005836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fead4b-4ec0-4a8e-a847-f24400cce38f service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:10.007420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-84fead4b-4ec0-4a8e-a847-f24400cce38f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:18:10.022692 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fead4b-4ec0-4a8e-a847-f24400cce38f service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:10.027659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5511a-0199-4544-a8b4-fe8add98b48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:10.028644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5511a-0199-4544-a8b4-fe8add98b48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:10.028987 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5511a-0199-4544-a8b4-fe8add98b48f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:10.029328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5511a-0199-4544-a8b4-fe8add98b48f admin admin] PATH_INFO: `/v3/users/2f75c040d8dc4dbd88d0fa1ade9be724` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:10.030588 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5511a-0199-4544-a8b4-fe8add98b48f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f75c040d8dc4dbd88d0fa1ade9be724)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:10.032637 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5511a-0199-4544-a8b4-fe8add98b48f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:10.084868 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-25d5511a-0199-4544-a8b4-fe8add98b48f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f75c040d8dc4dbd88d0fa1ade9be724'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.085511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-25d5511a-0199-4544-a8b4-fe8add98b48f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f75c040d8dc4dbd88d0fa1ade9be724'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.094483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-25d5511a-0199-4544-a8b4-fe8add98b48f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f75c040d8dc4dbd88d0fa1ade9be724'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.095085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-25d5511a-0199-4544-a8b4-fe8add98b48f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f75c040d8dc4dbd88d0fa1ade9be724'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.108047 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-25d5511a-0199-4544-a8b4-fe8add98b48f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f75c040d8dc4dbd88d0fa1ade9be724'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.121221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1234/2449] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:18:10 2021] DELETE /identity/v3/users/2f75c040d8dc4dbd88d0fa1ade9be724 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:18:10.295320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29fb07-4d68-4b02-991d-564e23d63f25 service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:10.306716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29fb07-4d68-4b02-991d-564e23d63f25 service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:10.366451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:10.367372 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:10.367695 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:10.367989 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] PATH_INFO: `/v3/projects/659fac3889964d1cad61a9db97c72ca7` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:10.369237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=659fac3889964d1cad61a9db97c72ca7)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:10.371159 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:10.420440 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659fac3889964d1cad61a9db97c72ca7', 'request_id': 'req-77088885-5468-4497-9935-045cc3dc8a34'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.426895 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659fac3889964d1cad61a9db97c72ca7', 'request_id': 'req-77088885-5468-4497-9935-045cc3dc8a34'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.433580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659fac3889964d1cad61a9db97c72ca7', 'request_id': 'req-77088885-5468-4497-9935-045cc3dc8a34'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.448741 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] The token cache is being invalidate because project 659fac3889964d1cad61a9db97c72ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:18:10.449012 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.449644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.451251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1216/2450] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:18:10 2021] DELETE /identity/v3/projects/659fac3889964d1cad61a9db97c72ca7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:18:10.455457 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5511a-0199-4544-a8b4-fe8add98b48f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:10.456873 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-25d5511a-0199-4544-a8b4-fe8add98b48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:18:10.472135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5511a-0199-4544-a8b4-fe8add98b48f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:10.541243 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fee49-7a52-4ab2-a360-f417d0969c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:10.542123 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fee49-7a52-4ab2-a360-f417d0969c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:10.542409 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fee49-7a52-4ab2-a360-f417d0969c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:10.542686 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fee49-7a52-4ab2-a360-f417d0969c34 admin admin] PATH_INFO: `/v3/users/1edb8ecbddb74245b1f4ea83256a1ba0` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:10.544122 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fee49-7a52-4ab2-a360-f417d0969c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edb8ecbddb74245b1f4ea83256a1ba0)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:10.546048 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fee49-7a52-4ab2-a360-f417d0969c34 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:10.599161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ca1fee49-7a52-4ab2-a360-f417d0969c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edb8ecbddb74245b1f4ea83256a1ba0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.599856 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ca1fee49-7a52-4ab2-a360-f417d0969c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edb8ecbddb74245b1f4ea83256a1ba0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.609955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ca1fee49-7a52-4ab2-a360-f417d0969c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edb8ecbddb74245b1f4ea83256a1ba0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.611292 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ca1fee49-7a52-4ab2-a360-f417d0969c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edb8ecbddb74245b1f4ea83256a1ba0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.625359 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ca1fee49-7a52-4ab2-a360-f417d0969c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edb8ecbddb74245b1f4ea83256a1ba0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.638080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1235/2451] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:18:10 2021] DELETE /identity/v3/users/1edb8ecbddb74245b1f4ea83256a1ba0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:18:10.821183 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:10.822746 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:18:10.842101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77088885-5468-4497-9935-045cc3dc8a34 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:10.900765 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa11b7-af9b-43d6-b087-4e52f9775c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:10.901630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa11b7-af9b-43d6-b087-4e52f9775c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:10.901894 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa11b7-af9b-43d6-b087-4e52f9775c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:10.902165 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa11b7-af9b-43d6-b087-4e52f9775c39 admin admin] PATH_INFO: `/v3/projects/8f6692a0c3f347daabf588549b3cebe4` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:10.903651 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa11b7-af9b-43d6-b087-4e52f9775c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6692a0c3f347daabf588549b3cebe4)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:10.905592 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa11b7-af9b-43d6-b087-4e52f9775c39 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:10.953453 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b1fa11b7-af9b-43d6-b087-4e52f9775c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6692a0c3f347daabf588549b3cebe4', 'request_id': 'req-b1fa11b7-af9b-43d6-b087-4e52f9775c39'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.960535 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b1fa11b7-af9b-43d6-b087-4e52f9775c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6692a0c3f347daabf588549b3cebe4', 'request_id': 'req-b1fa11b7-af9b-43d6-b087-4e52f9775c39'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.972062 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b1fa11b7-af9b-43d6-b087-4e52f9775c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6692a0c3f347daabf588549b3cebe4', 'request_id': 'req-b1fa11b7-af9b-43d6-b087-4e52f9775c39'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.998319 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b1fa11b7-af9b-43d6-b087-4e52f9775c39 admin admin] The token cache is being invalidate because project 8f6692a0c3f347daabf588549b3cebe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:18:10.998319 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b1fa11b7-af9b-43d6-b087-4e52f9775c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.998319 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b1fa11b7-af9b-43d6-b087-4e52f9775c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:18:10.998319 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1217/2452] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:18:10 2021] DELETE /identity/v3/projects/8f6692a0c3f347daabf588549b3cebe4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:18:11.001109 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64144eaf-d9b5-49d4-b459-3b450d3f1c80 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:11.001483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64144eaf-d9b5-49d4-b459-3b450d3f1c80 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:11.001821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64144eaf-d9b5-49d4-b459-3b450d3f1c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:11.023089 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-64144eaf-d9b5-49d4-b459-3b450d3f1c80 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:18:11.025637 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-64144eaf-d9b5-49d4-b459-3b450d3f1c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:18:11.091463 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1236/2453] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:18:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:18:11.100021 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e79ac9-2900-42c3-995d-cee25ca7762e None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:11.100284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e79ac9-2900-42c3-995d-cee25ca7762e None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:11.101620 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e79ac9-2900-42c3-995d-cee25ca7762e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:11.121080 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-c5e79ac9-2900-42c3-995d-cee25ca7762e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:18:11.122304 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c5e79ac9-2900-42c3-995d-cee25ca7762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:18:11.131502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1218/2454] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:18:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:18:11.136246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64144eaf-d9b5-49d4-b459-3b450d3f1c80 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:11.146201 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64144eaf-d9b5-49d4-b459-3b450d3f1c80 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:11.150932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7af9b-6bc6-48c5-b2b2-42c5edd2dc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:11.151611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7af9b-6bc6-48c5-b2b2-42c5edd2dc00 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:11.151897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7af9b-6bc6-48c5-b2b2-42c5edd2dc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:11.152174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7af9b-6bc6-48c5-b2b2-42c5edd2dc00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:11.152926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7af9b-6bc6-48c5-b2b2-42c5edd2dc00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:18:11.153233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7af9b-6bc6-48c5-b2b2-42c5edd2dc00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:11.154843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7af9b-6bc6-48c5-b2b2-42c5edd2dc00 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:11.166524 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1237/2455] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:18:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 11:18:11.171337 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e79ac9-2900-42c3-995d-cee25ca7762e None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:11.181127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e79ac9-2900-42c3-995d-cee25ca7762e None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:11.187208 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccbb96-415b-4b36-9bc9-04d7a59fceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:11.187869 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccbb96-415b-4b36-9bc9-04d7a59fceba admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:11.188153 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccbb96-415b-4b36-9bc9-04d7a59fceba admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:11.188427 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccbb96-415b-4b36-9bc9-04d7a59fceba admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:11.189139 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccbb96-415b-4b36-9bc9-04d7a59fceba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:11.191078 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccbb96-415b-4b36-9bc9-04d7a59fceba admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:11.219517 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1219/2456] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:18:11 2021] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:18:11.223916 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7af9b-6bc6-48c5-b2b2-42c5edd2dc00 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:11.234315 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7af9b-6bc6-48c5-b2b2-42c5edd2dc00 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:11.302325 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aab0a0-e77f-4c63-8aa4-366c23cc0588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:11.303178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aab0a0-e77f-4c63-8aa4-366c23cc0588 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:11.303731 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aab0a0-e77f-4c63-8aa4-366c23cc0588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:11.304026 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aab0a0-e77f-4c63-8aa4-366c23cc0588 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:11.304855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aab0a0-e77f-4c63-8aa4-366c23cc0588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:11.306845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aab0a0-e77f-4c63-8aa4-366c23cc0588 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:11.328832 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1238/2457] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:18:11 2021] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:18:11.333017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccbb96-415b-4b36-9bc9-04d7a59fceba admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:11.343498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccbb96-415b-4b36-9bc9-04d7a59fceba admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:11.348510 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77cd98-4532-4a6d-833d-1732cdad23fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:11.349213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77cd98-4532-4a6d-833d-1732cdad23fc admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:11.349497 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77cd98-4532-4a6d-833d-1732cdad23fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:11.349774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77cd98-4532-4a6d-833d-1732cdad23fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:11.350580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77cd98-4532-4a6d-833d-1732cdad23fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:11.352221 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77cd98-4532-4a6d-833d-1732cdad23fc admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:11.363934 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1220/2458] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:18:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:18:11.368627 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aab0a0-e77f-4c63-8aa4-366c23cc0588 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:11.384990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aab0a0-e77f-4c63-8aa4-366c23cc0588 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:11.394322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6620bf8-10e9-4044-ac79-c24400022559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:11.395297 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6620bf8-10e9-4044-ac79-c24400022559 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:11.395648 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6620bf8-10e9-4044-ac79-c24400022559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:11.395960 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6620bf8-10e9-4044-ac79-c24400022559 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:11.397046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6620bf8-10e9-4044-ac79-c24400022559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:11.398842 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6620bf8-10e9-4044-ac79-c24400022559 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:11.409576 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1239/2459] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:18:11 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:18:11.414804 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77cd98-4532-4a6d-833d-1732cdad23fc admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:11.430088 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77cd98-4532-4a6d-833d-1732cdad23fc admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:11.435755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016fbca-c3a0-4800-a120-6bd0dd4e22ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:11.436639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016fbca-c3a0-4800-a120-6bd0dd4e22ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:11.436916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016fbca-c3a0-4800-a120-6bd0dd4e22ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:11.437184 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016fbca-c3a0-4800-a120-6bd0dd4e22ed admin admin] PATH_INFO: `/v3/projects/86636965098a4c7d9a77d50476f46772/users/350be9489e354eeda45274e00a116108/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:11.453436 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016fbca-c3a0-4800-a120-6bd0dd4e22ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=86636965098a4c7d9a77d50476f46772, user_id=350be9489e354eeda45274e00a116108, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:11.456118 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016fbca-c3a0-4800-a120-6bd0dd4e22ed admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:11.471593 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1221/2460] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:18:11 2021] PUT /identity/v3/projects/86636965098a4c7d9a77d50476f46772/users/350be9489e354eeda45274e00a116108/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:18:11.477703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e03b9-752f-4f11-9af4-f2f91adf4aad None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:11.478097 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e03b9-752f-4f11-9af4-f2f91adf4aad None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:11.478514 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e03b9-752f-4f11-9af4-f2f91adf4aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:11.498548 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-b95e03b9-752f-4f11-9af4-f2f91adf4aad None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:18:11.499783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b95e03b9-752f-4f11-9af4-f2f91adf4aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:18:11.562651 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1240/2461] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:18:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:18:11.574877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016fbca-c3a0-4800-a120-6bd0dd4e22ed admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:11.577956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-0016fbca-c3a0-4800-a120-6bd0dd4e22ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:18:11.644532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016fbca-c3a0-4800-a120-6bd0dd4e22ed admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:11.649210 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e579aa-f73b-4c0e-bc39-ad82d08c251b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:11.649856 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e579aa-f73b-4c0e-bc39-ad82d08c251b service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:11.650140 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e579aa-f73b-4c0e-bc39-ad82d08c251b service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:11.650403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e579aa-f73b-4c0e-bc39-ad82d08c251b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:11.659795 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e579aa-f73b-4c0e-bc39-ad82d08c251b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:11.661238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e579aa-f73b-4c0e-bc39-ad82d08c251b service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:11.671190 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1222/2462] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:18:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:18:15.956598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305c5b9-1cac-4d72-aa92-ef564bfbc41d None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:15.957144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305c5b9-1cac-4d72-aa92-ef564bfbc41d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:15.957144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305c5b9-1cac-4d72-aa92-ef564bfbc41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:15.987110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-9305c5b9-1cac-4d72-aa92-ef564bfbc41d None None] MFA Rules not processed for user `350be9489e354eeda45274e00a116108`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:18:15.988368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9305c5b9-1cac-4d72-aa92-ef564bfbc41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:18:16.076961 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1241/2463] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:18:15 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:18:16.081540 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e579aa-f73b-4c0e-bc39-ad82d08c251b service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:16.093538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e579aa-f73b-4c0e-bc39-ad82d08c251b service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:16.098652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ae1c8-5bec-4421-8d24-d051b39cc53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:16.099363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ae1c8-5bec-4421-8d24-d051b39cc53f admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:16.099642 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ae1c8-5bec-4421-8d24-d051b39cc53f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:16.099915 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ae1c8-5bec-4421-8d24-d051b39cc53f admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:16.100755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ae1c8-5bec-4421-8d24-d051b39cc53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:16.102749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ae1c8-5bec-4421-8d24-d051b39cc53f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:16.133188 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1223/2464] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:18:16 2021] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:18:16.134782 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305c5b9-1cac-4d72-aa92-ef564bfbc41d None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:16.146062 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305c5b9-1cac-4d72-aa92-ef564bfbc41d None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:16.207223 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699659d4-6e9b-4805-b3c8-732fdf9babbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:16.207909 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699659d4-6e9b-4805-b3c8-732fdf9babbd admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:16.208216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699659d4-6e9b-4805-b3c8-732fdf9babbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:16.208493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699659d4-6e9b-4805-b3c8-732fdf9babbd admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:16.209210 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699659d4-6e9b-4805-b3c8-732fdf9babbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:16.211546 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699659d4-6e9b-4805-b3c8-732fdf9babbd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:16.240515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1242/2465] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:18:16 2021] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:18:16.251613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ae1c8-5bec-4421-8d24-d051b39cc53f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:16.277512 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ae1c8-5bec-4421-8d24-d051b39cc53f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:16.277512 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849e852-9fc9-42e9-9797-868879b7603b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:16.277512 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849e852-9fc9-42e9-9797-868879b7603b admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:16.277512 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849e852-9fc9-42e9-9797-868879b7603b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:16.278178 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849e852-9fc9-42e9-9797-868879b7603b admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:16.278178 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849e852-9fc9-42e9-9797-868879b7603b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:16.278178 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849e852-9fc9-42e9-9797-868879b7603b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:16.290707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1224/2466] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:18:16 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:18:16.295899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699659d4-6e9b-4805-b3c8-732fdf9babbd admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:16.308469 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699659d4-6e9b-4805-b3c8-732fdf9babbd admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:16.321330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e2ad2-7204-4365-83b6-2eb2ff319357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:16.322903 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e2ad2-7204-4365-83b6-2eb2ff319357 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:16.323570 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e2ad2-7204-4365-83b6-2eb2ff319357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:16.324632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e2ad2-7204-4365-83b6-2eb2ff319357 admin admin] PATH_INFO: `/v3/projects/f30ba26659344cb18cf7b09eae297aa4/users/6a96cbadb0b0494fb3977718dfd638ae/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:16.343938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e2ad2-7204-4365-83b6-2eb2ff319357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30ba26659344cb18cf7b09eae297aa4, user_id=6a96cbadb0b0494fb3977718dfd638ae, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:16.347033 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e2ad2-7204-4365-83b6-2eb2ff319357 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:16.370812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1243/2467] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:18:16 2021] PUT /identity/v3/projects/f30ba26659344cb18cf7b09eae297aa4/users/6a96cbadb0b0494fb3977718dfd638ae/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:18:16.374926 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849e852-9fc9-42e9-9797-868879b7603b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:16.389872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849e852-9fc9-42e9-9797-868879b7603b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:16.455414 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd268ee-8a38-4ef1-b74a-449bbdc64664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:16.456094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd268ee-8a38-4ef1-b74a-449bbdc64664 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:16.456442 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd268ee-8a38-4ef1-b74a-449bbdc64664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:16.456792 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd268ee-8a38-4ef1-b74a-449bbdc64664 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:16.457877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd268ee-8a38-4ef1-b74a-449bbdc64664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:16.461202 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd268ee-8a38-4ef1-b74a-449bbdc64664 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:16.472329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1225/2468] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:18:16 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:18:16.477426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e2ad2-7204-4365-83b6-2eb2ff319357 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:16.488559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e2ad2-7204-4365-83b6-2eb2ff319357 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:16.494428 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e4f2d-e2ba-4484-8d96-56d4bf6806fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:16.495518 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e4f2d-e2ba-4484-8d96-56d4bf6806fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:16.495922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e4f2d-e2ba-4484-8d96-56d4bf6806fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:16.496278 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e4f2d-e2ba-4484-8d96-56d4bf6806fc admin admin] PATH_INFO: `/v3/projects/f30ba26659344cb18cf7b09eae297aa4/users/6a96cbadb0b0494fb3977718dfd638ae/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:16.498445 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e4f2d-e2ba-4484-8d96-56d4bf6806fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30ba26659344cb18cf7b09eae297aa4, user_id=6a96cbadb0b0494fb3977718dfd638ae, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:16.501353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e4f2d-e2ba-4484-8d96-56d4bf6806fc admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:16.518544 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1244/2469] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:18:16 2021] PUT /identity/v3/projects/f30ba26659344cb18cf7b09eae297aa4/users/6a96cbadb0b0494fb3977718dfd638ae/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:18:21.242835 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2eb1b-dbf8-4b20-9691-5eec45d98679 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:21.243521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2eb1b-dbf8-4b20-9691-5eec45d98679 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:21.243521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2eb1b-dbf8-4b20-9691-5eec45d98679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:21.272717 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-70c2eb1b-dbf8-4b20-9691-5eec45d98679 None None] MFA Rules not processed for user `6a96cbadb0b0494fb3977718dfd638ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:18:21.274055 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-70c2eb1b-dbf8-4b20-9691-5eec45d98679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:18:21.342660 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1226/2470] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:18:21 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:18:21.356460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e4f2d-e2ba-4484-8d96-56d4bf6806fc admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:21.358446 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ef8e4f2d-e2ba-4484-8d96-56d4bf6806fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:18:21.464013 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e4f2d-e2ba-4484-8d96-56d4bf6806fc admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:21.471006 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca2f3a-6d5b-415a-8781-a110e81b9e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:21.471718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca2f3a-6d5b-415a-8781-a110e81b9e1c service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:21.471990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca2f3a-6d5b-415a-8781-a110e81b9e1c service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:21.472316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca2f3a-6d5b-415a-8781-a110e81b9e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:21.537361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca2f3a-6d5b-415a-8781-a110e81b9e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:21.539163 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca2f3a-6d5b-415a-8781-a110e81b9e1c service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:21.551493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1245/2471] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:18:21 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:18:23.155501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2eb1b-dbf8-4b20-9691-5eec45d98679 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:18:23.157054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-70c2eb1b-dbf8-4b20-9691-5eec45d98679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:18:23.221988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2eb1b-dbf8-4b20-9691-5eec45d98679 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:18:23.225690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d68d8-6c7e-46e3-9e80-64836d17b661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:18:23.226493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d68d8-6c7e-46e3-9e80-64836d17b661 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:18:23.226771 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d68d8-6c7e-46e3-9e80-64836d17b661 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:18:23.227042 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d68d8-6c7e-46e3-9e80-64836d17b661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:18:23.228952 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-601d68d8-6c7e-46e3-9e80-64836d17b661 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:18:23.292292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d68d8-6c7e-46e3-9e80-64836d17b661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:18:23.293767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d68d8-6c7e-46e3-9e80-64836d17b661 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:18:23.313331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1227/2472] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:18:23 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:20:14.868948 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca2f3a-6d5b-415a-8781-a110e81b9e1c service nova] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:20:14.870640 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e1ca2f3a-6d5b-415a-8781-a110e81b9e1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:20:14.945395 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca2f3a-6d5b-415a-8781-a110e81b9e1c service nova] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:20:14.951419 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05090b66-f5a1-457e-a710-177b728968cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '642c2b97ece34d69bacd821b108bd210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:20:14.952004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090b66-f5a1-457e-a710-177b728968cf service placement] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:20:14.952284 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090b66-f5a1-457e-a710-177b728968cf service placement] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:20:14.952538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090b66-f5a1-457e-a710-177b728968cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:20:14.954653 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-05090b66-f5a1-457e-a710-177b728968cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:20:14.966807 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05090b66-f5a1-457e-a710-177b728968cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:20:14.968447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05090b66-f5a1-457e-a710-177b728968cf service placement] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:20:14.978924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1246/2473] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:20:14 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:21:07.078202 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d68d8-6c7e-46e3-9e80-64836d17b661 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:21:07.080564 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-601d68d8-6c7e-46e3-9e80-64836d17b661 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:21:07.095738 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d68d8-6c7e-46e3-9e80-64836d17b661 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:21:07.100335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494a13e-f33a-40a0-a7cd-d66b19ff7799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:21:07.100983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494a13e-f33a-40a0-a7cd-d66b19ff7799 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:21:07.102655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494a13e-f33a-40a0-a7cd-d66b19ff7799 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:21:07.102655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494a13e-f33a-40a0-a7cd-d66b19ff7799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:21:07.103703 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6494a13e-f33a-40a0-a7cd-d66b19ff7799 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:21:07.175413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494a13e-f33a-40a0-a7cd-d66b19ff7799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:21:07.176884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494a13e-f33a-40a0-a7cd-d66b19ff7799 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:21:07.195653 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1228/2474] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:21:07 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:21:12.501255 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05090b66-f5a1-457e-a710-177b728968cf service placement] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:21:12.515230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05090b66-f5a1-457e-a710-177b728968cf service placement] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:21:12.519754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0b838-eba9-4d53-9b6e-05e13c3e707f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:21:12.520405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0b838-eba9-4d53-9b6e-05e13c3e707f service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:21:12.520724 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0b838-eba9-4d53-9b6e-05e13c3e707f service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:21:12.520999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0b838-eba9-4d53-9b6e-05e13c3e707f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:21:12.523346 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-62a0b838-eba9-4d53-9b6e-05e13c3e707f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:21:12.588182 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0b838-eba9-4d53-9b6e-05e13c3e707f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:21:12.589771 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0b838-eba9-4d53-9b6e-05e13c3e707f service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:21:12.602265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1247/2475] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:21:12 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:22:22.844428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494a13e-f33a-40a0-a7cd-d66b19ff7799 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:22:22.857225 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494a13e-f33a-40a0-a7cd-d66b19ff7799 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:22:22.861923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bd3bf-4b28-4a8a-a822-80ec6b053788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:22:22.862584 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bd3bf-4b28-4a8a-a822-80ec6b053788 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:22:22.862865 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bd3bf-4b28-4a8a-a822-80ec6b053788 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:22:22.863138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bd3bf-4b28-4a8a-a822-80ec6b053788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:22:22.865231 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-cb3bd3bf-4b28-4a8a-a822-80ec6b053788 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:22:22.940205 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bd3bf-4b28-4a8a-a822-80ec6b053788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:22:22.942850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bd3bf-4b28-4a8a-a822-80ec6b053788 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:22:22.957092 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1229/2476] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:22:22 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:23:22.560462 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0b838-eba9-4d53-9b6e-05e13c3e707f service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:23:22.570122 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0b838-eba9-4d53-9b6e-05e13c3e707f service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:23:22.574654 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda877f-306d-49f9-8cf2-1b22573b84b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:23:22.575639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda877f-306d-49f9-8cf2-1b22573b84b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:23:22.575957 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda877f-306d-49f9-8cf2-1b22573b84b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:23:22.576315 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda877f-306d-49f9-8cf2-1b22573b84b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:23:22.587667 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda877f-306d-49f9-8cf2-1b22573b84b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:23:22.589515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda877f-306d-49f9-8cf2-1b22573b84b2 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:23:22.600162 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1248/2477] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:23:22 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:23:23.056513 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bd3bf-4b28-4a8a-a822-80ec6b053788 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:23:23.058559 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-cb3bd3bf-4b28-4a8a-a822-80ec6b053788 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:23:23.150135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda877f-306d-49f9-8cf2-1b22573b84b2 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:23:23.152933 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bd3bf-4b28-4a8a-a822-80ec6b053788 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:23:23.158249 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53265768-1242-40ea-a5a1-3b9f422034ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:23:23.159170 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53265768-1242-40ea-a5a1-3b9f422034ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:23:23.159449 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53265768-1242-40ea-a5a1-3b9f422034ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:23:23.159649 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda877f-306d-49f9-8cf2-1b22573b84b2 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:23:23.159855 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53265768-1242-40ea-a5a1-3b9f422034ca admin admin] PATH_INFO: `/v3/users/e7afbb0fd7c54712b600ae6826dd7220` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:23:23.162233 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53265768-1242-40ea-a5a1-3b9f422034ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7afbb0fd7c54712b600ae6826dd7220)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:23:23.163816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36852d69-7de2-466b-9bdc-ccd4385c8506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:23:23.164817 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36852d69-7de2-466b-9bdc-ccd4385c8506 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:23:23.165309 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36852d69-7de2-466b-9bdc-ccd4385c8506 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:23:23.165803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36852d69-7de2-466b-9bdc-ccd4385c8506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:23:23.165959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53265768-1242-40ea-a5a1-3b9f422034ca admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:23:23.186136 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36852d69-7de2-466b-9bdc-ccd4385c8506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:23:23.187632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36852d69-7de2-466b-9bdc-ccd4385c8506 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:23:23.198129 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1249/2478] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:23:23 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:23:23.241984 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-53265768-1242-40ea-a5a1-3b9f422034ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7afbb0fd7c54712b600ae6826dd7220'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:23:23.242650 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-53265768-1242-40ea-a5a1-3b9f422034ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7afbb0fd7c54712b600ae6826dd7220'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:23:23.251050 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-53265768-1242-40ea-a5a1-3b9f422034ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7afbb0fd7c54712b600ae6826dd7220'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:23:23.251772 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-53265768-1242-40ea-a5a1-3b9f422034ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7afbb0fd7c54712b600ae6826dd7220'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:23:23.259790 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-53265768-1242-40ea-a5a1-3b9f422034ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7afbb0fd7c54712b600ae6826dd7220'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:23:23.278621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1230/2479] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:23:23 2021] DELETE /identity/v3/users/e7afbb0fd7c54712b600ae6826dd7220 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:23:23.284919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a3325-7281-425f-a280-a3889ba288fa None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:23:23.285235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a3325-7281-425f-a280-a3889ba288fa None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:23:23.285510 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a3325-7281-425f-a280-a3889ba288fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:23:23.305117 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-0d3a3325-7281-425f-a280-a3889ba288fa None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:23:23.306349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0d3a3325-7281-425f-a280-a3889ba288fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:23:23.374293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1250/2480] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:23:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:23:23.386906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53265768-1242-40ea-a5a1-3b9f422034ca admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:23:23.389170 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-53265768-1242-40ea-a5a1-3b9f422034ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:23:23.449756 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53265768-1242-40ea-a5a1-3b9f422034ca admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:23:23.453905 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e690c-b468-4cf9-9531-433cab908d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:23:23.454572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e690c-b468-4cf9-9531-433cab908d7f service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:23:23.454844 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e690c-b468-4cf9-9531-433cab908d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:23:23.455086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e690c-b468-4cf9-9531-433cab908d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:23:23.469381 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e690c-b468-4cf9-9531-433cab908d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:23:23.470727 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e690c-b468-4cf9-9531-433cab908d7f service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:23:23.481746 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1231/2481] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:23:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:23:23.781427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a3325-7281-425f-a280-a3889ba288fa None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:23:23.783389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0d3a3325-7281-425f-a280-a3889ba288fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:23:23.795808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a3325-7281-425f-a280-a3889ba288fa None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:23:23.809210 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:23:23.811146 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:23:23.811146 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:23:23.815783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] PATH_INFO: `/v3/projects/a64819123f12429aa1a4374d5543b71f` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:23:23.816087 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a64819123f12429aa1a4374d5543b71f)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:23:23.818056 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:23:23.871808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a64819123f12429aa1a4374d5543b71f', 'request_id': 'req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:23:23.878993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a64819123f12429aa1a4374d5543b71f', 'request_id': 'req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:23:23.885235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a64819123f12429aa1a4374d5543b71f', 'request_id': 'req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:23:23.908070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] The token cache is being invalidate because project a64819123f12429aa1a4374d5543b71f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:23:23.908348 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:23:23.909066 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:23:23.910924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1251/2482] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:23:23 2021] DELETE /identity/v3/projects/a64819123f12429aa1a4374d5543b71f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:24:41.049434 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e690c-b468-4cf9-9531-433cab908d7f service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:24:41.050969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2c5e690c-b468-4cf9-9531-433cab908d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:24:41.062435 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e690c-b468-4cf9-9531-433cab908d7f service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:24:41.110504 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c5b99-bd90-4cac-a9c3-406504ee5878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:24:41.111486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c5b99-bd90-4cac-a9c3-406504ee5878 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:41.111680 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c5b99-bd90-4cac-a9c3-406504ee5878 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:41.111848 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c5b99-bd90-4cac-a9c3-406504ee5878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:41.113746 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-7d4c5b99-bd90-4cac-a9c3-406504ee5878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:24:41.180594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c5b99-bd90-4cac-a9c3-406504ee5878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:24:41.182047 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c5b99-bd90-4cac-a9c3-406504ee5878 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:24:41.192378 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1232/2483] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:24:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:24:44.454979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:24:44.457422 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:24:44.472483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c87df-7ad4-4b85-9a95-b63b20fbb9b7 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:24:44.477344 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f812d-4495-49f1-ae57-b052ddcfe799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:24:44.478456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f812d-4495-49f1-ae57-b052ddcfe799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:44.478743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f812d-4495-49f1-ae57-b052ddcfe799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:44.479020 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f812d-4495-49f1-ae57-b052ddcfe799 admin admin] PATH_INFO: `/v3/users/fd75fa7d42a5418e87ebc4176e5a2790` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:44.480311 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f812d-4495-49f1-ae57-b052ddcfe799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd75fa7d42a5418e87ebc4176e5a2790)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:24:44.482306 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f812d-4495-49f1-ae57-b052ddcfe799 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:24:44.555400 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-478f812d-4495-49f1-ae57-b052ddcfe799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd75fa7d42a5418e87ebc4176e5a2790'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:24:44.556376 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-478f812d-4495-49f1-ae57-b052ddcfe799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd75fa7d42a5418e87ebc4176e5a2790'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:24:44.565939 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-478f812d-4495-49f1-ae57-b052ddcfe799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd75fa7d42a5418e87ebc4176e5a2790'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:24:44.566702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-478f812d-4495-49f1-ae57-b052ddcfe799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd75fa7d42a5418e87ebc4176e5a2790'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:24:44.585361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-478f812d-4495-49f1-ae57-b052ddcfe799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd75fa7d42a5418e87ebc4176e5a2790'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:24:44.600455 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1252/2484] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:24:44 2021] DELETE /identity/v3/users/fd75fa7d42a5418e87ebc4176e5a2790 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:24:44.813701 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c5b99-bd90-4cac-a9c3-406504ee5878 service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:24:44.825427 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c5b99-bd90-4cac-a9c3-406504ee5878 service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:24:44.886255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e728574-bbfb-48d3-af5f-f8ae43ef496d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:24:44.887114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e728574-bbfb-48d3-af5f-f8ae43ef496d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:44.887436 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e728574-bbfb-48d3-af5f-f8ae43ef496d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:44.887709 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e728574-bbfb-48d3-af5f-f8ae43ef496d admin admin] PATH_INFO: `/v3/projects/b19dc35017c244c9b22e6c55c3091b29` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:44.888918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e728574-bbfb-48d3-af5f-f8ae43ef496d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19dc35017c244c9b22e6c55c3091b29)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:24:44.890906 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e728574-bbfb-48d3-af5f-f8ae43ef496d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:24:44.942668 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1e728574-bbfb-48d3-af5f-f8ae43ef496d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19dc35017c244c9b22e6c55c3091b29', 'request_id': 'req-1e728574-bbfb-48d3-af5f-f8ae43ef496d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:24:44.949158 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1e728574-bbfb-48d3-af5f-f8ae43ef496d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19dc35017c244c9b22e6c55c3091b29', 'request_id': 'req-1e728574-bbfb-48d3-af5f-f8ae43ef496d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:24:44.955081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1e728574-bbfb-48d3-af5f-f8ae43ef496d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19dc35017c244c9b22e6c55c3091b29', 'request_id': 'req-1e728574-bbfb-48d3-af5f-f8ae43ef496d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:24:44.970448 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1e728574-bbfb-48d3-af5f-f8ae43ef496d admin admin] The token cache is being invalidate because project b19dc35017c244c9b22e6c55c3091b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:24:44.970448 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1e728574-bbfb-48d3-af5f-f8ae43ef496d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:24:44.971338 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1e728574-bbfb-48d3-af5f-f8ae43ef496d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:24:44.973016 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1233/2485] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:24:44 2021] DELETE /identity/v3/projects/b19dc35017c244c9b22e6c55c3091b29 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:24:44.979894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a4549-5f56-4183-8292-276546f9c5fc None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:44.980185 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a4549-5f56-4183-8292-276546f9c5fc None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:44.980466 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a4549-5f56-4183-8292-276546f9c5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:44.999388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-7c2a4549-5f56-4183-8292-276546f9c5fc None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:24:45.000704 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7c2a4549-5f56-4183-8292-276546f9c5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:24:45.063472 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1253/2486] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:24:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:24:45.071583 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e37e4-584d-4c01-b1a7-56e2eb45a61a None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:45.071865 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e37e4-584d-4c01-b1a7-56e2eb45a61a None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:45.072139 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e37e4-584d-4c01-b1a7-56e2eb45a61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:45.092411 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-2c4e37e4-584d-4c01-b1a7-56e2eb45a61a None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:24:45.093978 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-2c4e37e4-584d-4c01-b1a7-56e2eb45a61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:24:45.103246 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1234/2487] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:24:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:24:45.108085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a4549-5f56-4183-8292-276546f9c5fc None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:24:45.120129 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a4549-5f56-4183-8292-276546f9c5fc None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:24:45.125961 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed1ef3-5d39-4e2f-93a7-0e37960bc3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:24:45.126642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed1ef3-5d39-4e2f-93a7-0e37960bc3ff admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:45.126924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed1ef3-5d39-4e2f-93a7-0e37960bc3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:45.127238 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed1ef3-5d39-4e2f-93a7-0e37960bc3ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:45.128192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed1ef3-5d39-4e2f-93a7-0e37960bc3ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:24:45.128504 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed1ef3-5d39-4e2f-93a7-0e37960bc3ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:24:45.130136 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed1ef3-5d39-4e2f-93a7-0e37960bc3ff admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:24:45.143252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1254/2488] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:24:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 11:24:45.147628 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e37e4-584d-4c01-b1a7-56e2eb45a61a None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:24:45.156855 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e37e4-584d-4c01-b1a7-56e2eb45a61a None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:24:45.162642 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7b50d-dc3f-415b-bacc-75031dbb3558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:24:45.163330 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7b50d-dc3f-415b-bacc-75031dbb3558 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:45.163604 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7b50d-dc3f-415b-bacc-75031dbb3558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:45.164006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7b50d-dc3f-415b-bacc-75031dbb3558 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:45.164722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7b50d-dc3f-415b-bacc-75031dbb3558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:24:45.166717 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7b50d-dc3f-415b-bacc-75031dbb3558 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:24:45.215292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1235/2489] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:24:45 2021] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:24:45.221824 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed1ef3-5d39-4e2f-93a7-0e37960bc3ff admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:24:45.232535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed1ef3-5d39-4e2f-93a7-0e37960bc3ff admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:24:45.289021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a84f5-d9fb-4ce8-b5da-852cb61da551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:24:45.289688 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a84f5-d9fb-4ce8-b5da-852cb61da551 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:45.289968 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a84f5-d9fb-4ce8-b5da-852cb61da551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:45.290240 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a84f5-d9fb-4ce8-b5da-852cb61da551 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:45.290943 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a84f5-d9fb-4ce8-b5da-852cb61da551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:24:45.292887 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a84f5-d9fb-4ce8-b5da-852cb61da551 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:24:45.314612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1255/2490] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:24:45 2021] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:24:45.319003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7b50d-dc3f-415b-bacc-75031dbb3558 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:24:45.329863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7b50d-dc3f-415b-bacc-75031dbb3558 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:24:45.335541 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c43cf4-3f85-4be2-a0e8-a2e6372d7ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:24:45.336227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c43cf4-3f85-4be2-a0e8-a2e6372d7ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:45.336512 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c43cf4-3f85-4be2-a0e8-a2e6372d7ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:45.336815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c43cf4-3f85-4be2-a0e8-a2e6372d7ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:45.337626 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c43cf4-3f85-4be2-a0e8-a2e6372d7ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:24:45.339361 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c43cf4-3f85-4be2-a0e8-a2e6372d7ce8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:24:45.350172 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1236/2491] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:24:45 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:24:45.354123 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a84f5-d9fb-4ce8-b5da-852cb61da551 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:24:45.364228 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a84f5-d9fb-4ce8-b5da-852cb61da551 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:24:45.369174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6337e1-5163-443a-8f2a-1464f2a1cf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:24:45.369822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6337e1-5163-443a-8f2a-1464f2a1cf0a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:45.370103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6337e1-5163-443a-8f2a-1464f2a1cf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:45.370374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6337e1-5163-443a-8f2a-1464f2a1cf0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:45.371108 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6337e1-5163-443a-8f2a-1464f2a1cf0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:24:45.372873 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6337e1-5163-443a-8f2a-1464f2a1cf0a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:24:45.383579 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1256/2492] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:24:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:24:45.387923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c43cf4-3f85-4be2-a0e8-a2e6372d7ce8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:24:45.398191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c43cf4-3f85-4be2-a0e8-a2e6372d7ce8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:24:45.403653 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5151a3c-8ae2-4143-bbd6-5fd1b512bdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:24:45.404581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5151a3c-8ae2-4143-bbd6-5fd1b512bdde admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:45.404868 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5151a3c-8ae2-4143-bbd6-5fd1b512bdde admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:45.405153 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5151a3c-8ae2-4143-bbd6-5fd1b512bdde admin admin] PATH_INFO: `/v3/projects/586abeee12474f569b3056e97e1371db/users/9db81f69de554ed5994ee3f34484349e/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:45.421686 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5151a3c-8ae2-4143-bbd6-5fd1b512bdde admin admin] RBAC: Authorizing `identity:create_grant(project_id=586abeee12474f569b3056e97e1371db, user_id=9db81f69de554ed5994ee3f34484349e, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:24:45.424450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5151a3c-8ae2-4143-bbd6-5fd1b512bdde admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:24:45.440689 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1237/2493] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:24:45 2021] PUT /identity/v3/projects/586abeee12474f569b3056e97e1371db/users/9db81f69de554ed5994ee3f34484349e/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:24:45.452270 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc2d10-b349-4044-b072-94dd8053df33 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:45.452563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc2d10-b349-4044-b072-94dd8053df33 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:45.453030 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc2d10-b349-4044-b072-94dd8053df33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:45.482274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-74cc2d10-b349-4044-b072-94dd8053df33 None None] MFA Rules not processed for user `9db81f69de554ed5994ee3f34484349e`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:24:45.483707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-74cc2d10-b349-4044-b072-94dd8053df33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:24:45.549154 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1257/2494] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:24:45 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:24:45.570977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5151a3c-8ae2-4143-bbd6-5fd1b512bdde admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:24:45.572965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c5151a3c-8ae2-4143-bbd6-5fd1b512bdde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:24:45.653722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5151a3c-8ae2-4143-bbd6-5fd1b512bdde admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:24:45.660359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb1ba0-8b89-4077-98b0-835bbf6c75aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:24:45.661037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb1ba0-8b89-4077-98b0-835bbf6c75aa service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:45.661314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb1ba0-8b89-4077-98b0-835bbf6c75aa service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:45.661584 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb1ba0-8b89-4077-98b0-835bbf6c75aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:45.674237 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb1ba0-8b89-4077-98b0-835bbf6c75aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:24:45.676052 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb1ba0-8b89-4077-98b0-835bbf6c75aa service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:24:45.686462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1238/2495] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:24:45 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:24:45.706639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc2d10-b349-4044-b072-94dd8053df33 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:24:45.708166 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-74cc2d10-b349-4044-b072-94dd8053df33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:24:45.767973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc2d10-b349-4044-b072-94dd8053df33 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:24:45.772091 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a8616-7dbb-4114-a461-1a7db9631147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:24:45.772831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a8616-7dbb-4114-a461-1a7db9631147 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:45.773024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a8616-7dbb-4114-a461-1a7db9631147 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:45.773380 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a8616-7dbb-4114-a461-1a7db9631147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:45.775151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6b4a8616-7dbb-4114-a461-1a7db9631147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:24:45.790951 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a8616-7dbb-4114-a461-1a7db9631147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:24:45.792406 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a8616-7dbb-4114-a461-1a7db9631147 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:24:45.810419 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1258/2496] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:24:45 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:24:46.142945 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb1ba0-8b89-4077-98b0-835bbf6c75aa service nova] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:24:46.158901 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb1ba0-8b89-4077-98b0-835bbf6c75aa service nova] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:24:46.164721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e652f62-a282-42d0-93d0-b5fbbb999c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:24:46.166027 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e652f62-a282-42d0-93d0-b5fbbb999c94 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:24:46.166578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e652f62-a282-42d0-93d0-b5fbbb999c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:24:46.167056 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e652f62-a282-42d0-93d0-b5fbbb999c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:24:46.170633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9e652f62-a282-42d0-93d0-b5fbbb999c94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:24:46.189582 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e652f62-a282-42d0-93d0-b5fbbb999c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:24:46.195031 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e652f62-a282-42d0-93d0-b5fbbb999c94 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:24:46.204179 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1239/2497] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:24:46 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:25:07.267914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a8616-7dbb-4114-a461-1a7db9631147 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:07.269569 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6b4a8616-7dbb-4114-a461-1a7db9631147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:07.330130 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a8616-7dbb-4114-a461-1a7db9631147 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:07.334678 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe9c39-94a7-44f1-9874-142159861c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:07.335391 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe9c39-94a7-44f1-9874-142159861c6f service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:07.335676 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe9c39-94a7-44f1-9874-142159861c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:07.335993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe9c39-94a7-44f1-9874-142159861c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:07.338130 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f9fe9c39-94a7-44f1-9874-142159861c6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:07.405229 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe9c39-94a7-44f1-9874-142159861c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:07.406691 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe9c39-94a7-44f1-9874-142159861c6f service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:07.424728 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1259/2498] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:25:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:25:10.995416 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e652f62-a282-42d0-93d0-b5fbbb999c94 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:10.997109 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9e652f62-a282-42d0-93d0-b5fbbb999c94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:11.012761 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e652f62-a282-42d0-93d0-b5fbbb999c94 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:11.018224 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58054a2e-7892-4475-9373-1f839abfc1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:11.019202 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58054a2e-7892-4475-9373-1f839abfc1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:11.019453 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58054a2e-7892-4475-9373-1f839abfc1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:11.019732 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58054a2e-7892-4475-9373-1f839abfc1e1 admin admin] PATH_INFO: `/v3/users/763c552499cc4f2ca8e7070f822f51b9` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:11.021045 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58054a2e-7892-4475-9373-1f839abfc1e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=763c552499cc4f2ca8e7070f822f51b9)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:11.022992 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58054a2e-7892-4475-9373-1f839abfc1e1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:11.074152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-58054a2e-7892-4475-9373-1f839abfc1e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763c552499cc4f2ca8e7070f822f51b9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:11.075071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-58054a2e-7892-4475-9373-1f839abfc1e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763c552499cc4f2ca8e7070f822f51b9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:11.083465 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-58054a2e-7892-4475-9373-1f839abfc1e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763c552499cc4f2ca8e7070f822f51b9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:11.084186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-58054a2e-7892-4475-9373-1f839abfc1e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763c552499cc4f2ca8e7070f822f51b9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:11.093765 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-58054a2e-7892-4475-9373-1f839abfc1e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763c552499cc4f2ca8e7070f822f51b9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:11.112630 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1240/2499] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:25:10 2021] DELETE /identity/v3/users/763c552499cc4f2ca8e7070f822f51b9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:25:11.306772 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe9c39-94a7-44f1-9874-142159861c6f service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:11.322330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe9c39-94a7-44f1-9874-142159861c6f service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:11.388632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256904b-e107-40bd-8b46-83ab79f2067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:11.389507 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256904b-e107-40bd-8b46-83ab79f2067f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:11.389789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256904b-e107-40bd-8b46-83ab79f2067f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:11.390067 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256904b-e107-40bd-8b46-83ab79f2067f admin admin] PATH_INFO: `/v3/projects/d06106d622254aaf928e1fb487c101fa` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:11.402355 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256904b-e107-40bd-8b46-83ab79f2067f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06106d622254aaf928e1fb487c101fa)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:11.404322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256904b-e107-40bd-8b46-83ab79f2067f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:11.457313 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2256904b-e107-40bd-8b46-83ab79f2067f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06106d622254aaf928e1fb487c101fa', 'request_id': 'req-2256904b-e107-40bd-8b46-83ab79f2067f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:11.464643 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2256904b-e107-40bd-8b46-83ab79f2067f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06106d622254aaf928e1fb487c101fa', 'request_id': 'req-2256904b-e107-40bd-8b46-83ab79f2067f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:11.471308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2256904b-e107-40bd-8b46-83ab79f2067f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06106d622254aaf928e1fb487c101fa', 'request_id': 'req-2256904b-e107-40bd-8b46-83ab79f2067f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:11.486432 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2256904b-e107-40bd-8b46-83ab79f2067f admin admin] The token cache is being invalidate because project d06106d622254aaf928e1fb487c101fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:25:11.486973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2256904b-e107-40bd-8b46-83ab79f2067f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:11.487760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2256904b-e107-40bd-8b46-83ab79f2067f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:11.489426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1260/2500] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:25:11 2021] DELETE /identity/v3/projects/d06106d622254aaf928e1fb487c101fa => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:25:11.496215 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478ddc-cc42-41d7-ad77-f4eecbc69ef4 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:11.496508 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478ddc-cc42-41d7-ad77-f4eecbc69ef4 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:11.496782 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478ddc-cc42-41d7-ad77-f4eecbc69ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:11.516810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-37478ddc-cc42-41d7-ad77-f4eecbc69ef4 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:25:11.518425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-37478ddc-cc42-41d7-ad77-f4eecbc69ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:11.594762 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1241/2501] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:25:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:25:11.606216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c45f48-c6c5-4e3a-b9fd-be55d55d179f None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:11.606489 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c45f48-c6c5-4e3a-b9fd-be55d55d179f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:11.606767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c45f48-c6c5-4e3a-b9fd-be55d55d179f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:11.626729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-49c45f48-c6c5-4e3a-b9fd-be55d55d179f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:25:11.627978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-49c45f48-c6c5-4e3a-b9fd-be55d55d179f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:11.637374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1261/2502] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:25:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:25:11.641833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478ddc-cc42-41d7-ad77-f4eecbc69ef4 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:11.652572 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478ddc-cc42-41d7-ad77-f4eecbc69ef4 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:11.657373 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aa209-3c92-4fb5-ab4b-bc021e8c8cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:11.658247 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aa209-3c92-4fb5-ab4b-bc021e8c8cbc admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:11.658539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aa209-3c92-4fb5-ab4b-bc021e8c8cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:11.658829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aa209-3c92-4fb5-ab4b-bc021e8c8cbc admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:11.659768 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aa209-3c92-4fb5-ab4b-bc021e8c8cbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:25:11.660061 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aa209-3c92-4fb5-ab4b-bc021e8c8cbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:11.661702 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aa209-3c92-4fb5-ab4b-bc021e8c8cbc admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:11.674737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1242/2503] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:25:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:25:11.679242 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c45f48-c6c5-4e3a-b9fd-be55d55d179f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:11.691296 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c45f48-c6c5-4e3a-b9fd-be55d55d179f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:11.696316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f89ac-5db2-4f11-8168-72d825ca0bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:11.696979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f89ac-5db2-4f11-8168-72d825ca0bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:11.697259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f89ac-5db2-4f11-8168-72d825ca0bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:11.697534 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f89ac-5db2-4f11-8168-72d825ca0bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:11.698250 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f89ac-5db2-4f11-8168-72d825ca0bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:11.700205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f89ac-5db2-4f11-8168-72d825ca0bd2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:11.730103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1262/2504] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:25:11 2021] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:25:11.734542 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aa209-3c92-4fb5-ab4b-bc021e8c8cbc admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:11.745543 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aa209-3c92-4fb5-ab4b-bc021e8c8cbc admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:11.812854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0c097-a328-43a6-99d1-4bb4b74ded72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:11.813560 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0c097-a328-43a6-99d1-4bb4b74ded72 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:11.813844 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0c097-a328-43a6-99d1-4bb4b74ded72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:11.814384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0c097-a328-43a6-99d1-4bb4b74ded72 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:11.815194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0c097-a328-43a6-99d1-4bb4b74ded72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:11.817305 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0c097-a328-43a6-99d1-4bb4b74ded72 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:11.860644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1243/2505] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:25:11 2021] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:25:11.862257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f89ac-5db2-4f11-8168-72d825ca0bd2 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:11.876273 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f89ac-5db2-4f11-8168-72d825ca0bd2 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:11.883441 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd46456-eba0-4aaa-89bf-dfb47cb53b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:11.884349 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd46456-eba0-4aaa-89bf-dfb47cb53b7a admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:11.884790 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd46456-eba0-4aaa-89bf-dfb47cb53b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:11.885183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd46456-eba0-4aaa-89bf-dfb47cb53b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:11.886098 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd46456-eba0-4aaa-89bf-dfb47cb53b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:11.888390 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd46456-eba0-4aaa-89bf-dfb47cb53b7a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:11.905395 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1263/2506] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:25:11 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:25:11.909981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0c097-a328-43a6-99d1-4bb4b74ded72 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:11.920658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0c097-a328-43a6-99d1-4bb4b74ded72 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:11.927479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969275c-7a7f-48dd-86cb-83c42db1911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:11.928676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969275c-7a7f-48dd-86cb-83c42db1911e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:11.928964 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969275c-7a7f-48dd-86cb-83c42db1911e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:11.929277 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969275c-7a7f-48dd-86cb-83c42db1911e admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:11.929987 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969275c-7a7f-48dd-86cb-83c42db1911e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:11.932134 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969275c-7a7f-48dd-86cb-83c42db1911e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:11.943686 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1244/2507] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:25:11 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:25:11.948664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd46456-eba0-4aaa-89bf-dfb47cb53b7a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:11.961922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd46456-eba0-4aaa-89bf-dfb47cb53b7a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:11.966691 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8599e66-3360-4cd1-ac2b-3b741de9131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:11.967621 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8599e66-3360-4cd1-ac2b-3b741de9131d admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:11.967902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8599e66-3360-4cd1-ac2b-3b741de9131d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:11.968205 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8599e66-3360-4cd1-ac2b-3b741de9131d admin admin] PATH_INFO: `/v3/projects/0f88c678b226446d97b75011ca866f9e/users/0a284e84297a411198edd9279ae50c95/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:11.984673 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8599e66-3360-4cd1-ac2b-3b741de9131d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f88c678b226446d97b75011ca866f9e, user_id=0a284e84297a411198edd9279ae50c95, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:11.987934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8599e66-3360-4cd1-ac2b-3b741de9131d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:12.003748 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1264/2508] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:25:11 2021] PUT /identity/v3/projects/0f88c678b226446d97b75011ca866f9e/users/0a284e84297a411198edd9279ae50c95/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:25:12.014791 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c205-6ef1-4291-ba85-ffb1e39786c2 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:12.015387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c205-6ef1-4291-ba85-ffb1e39786c2 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:12.015387 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c205-6ef1-4291-ba85-ffb1e39786c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:12.050378 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-cb93c205-6ef1-4291-ba85-ffb1e39786c2 None None] MFA Rules not processed for user `0a284e84297a411198edd9279ae50c95`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:25:12.051648 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-cb93c205-6ef1-4291-ba85-ffb1e39786c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:12.121707 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1245/2509] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:25:12 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:25:12.126600 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8599e66-3360-4cd1-ac2b-3b741de9131d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:12.192213 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8599e66-3360-4cd1-ac2b-3b741de9131d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:12.197541 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dd250-6c5a-4a4e-a38d-13d53db0cc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:12.198199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dd250-6c5a-4a4e-a38d-13d53db0cc9c admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:12.198479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dd250-6c5a-4a4e-a38d-13d53db0cc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:12.198749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dd250-6c5a-4a4e-a38d-13d53db0cc9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:12.199471 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dd250-6c5a-4a4e-a38d-13d53db0cc9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:12.201379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dd250-6c5a-4a4e-a38d-13d53db0cc9c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:12.230431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1265/2510] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:25:12 2021] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:25:12.235070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93c205-6ef1-4291-ba85-ffb1e39786c2 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:12.247744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93c205-6ef1-4291-ba85-ffb1e39786c2 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:12.305815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1e9d4-c4aa-4adc-84da-b0cce7273749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:12.306498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1e9d4-c4aa-4adc-84da-b0cce7273749 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:12.306782 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1e9d4-c4aa-4adc-84da-b0cce7273749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:12.307055 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1e9d4-c4aa-4adc-84da-b0cce7273749 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:12.307808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1e9d4-c4aa-4adc-84da-b0cce7273749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:12.309749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1e9d4-c4aa-4adc-84da-b0cce7273749 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:12.333934 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1246/2511] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:25:12 2021] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:25:12.338244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dd250-6c5a-4a4e-a38d-13d53db0cc9c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:12.350373 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dd250-6c5a-4a4e-a38d-13d53db0cc9c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:12.356058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad0e2a-1976-4335-af6c-db62693426b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:12.356768 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0e2a-1976-4335-af6c-db62693426b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:12.357048 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0e2a-1976-4335-af6c-db62693426b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:12.357321 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0e2a-1976-4335-af6c-db62693426b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:12.358075 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad0e2a-1976-4335-af6c-db62693426b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:12.359785 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad0e2a-1976-4335-af6c-db62693426b5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:12.378613 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1266/2512] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:25:12 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:25:12.382856 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1e9d4-c4aa-4adc-84da-b0cce7273749 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:12.394339 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1e9d4-c4aa-4adc-84da-b0cce7273749 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:12.400172 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e079c-f8fa-455c-9efa-1f989fba6a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:12.401098 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e079c-f8fa-455c-9efa-1f989fba6a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:12.401368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e079c-f8fa-455c-9efa-1f989fba6a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:12.401645 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e079c-f8fa-455c-9efa-1f989fba6a8f admin admin] PATH_INFO: `/v3/projects/df9944ac81e945958888c4b5a3749fb7/users/5d0ecd1a76b14978bcac72b421f7e6f0/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:12.418965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e079c-f8fa-455c-9efa-1f989fba6a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9944ac81e945958888c4b5a3749fb7, user_id=5d0ecd1a76b14978bcac72b421f7e6f0, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:12.421691 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e079c-f8fa-455c-9efa-1f989fba6a8f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:12.440604 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1247/2513] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:25:12 2021] PUT /identity/v3/projects/df9944ac81e945958888c4b5a3749fb7/users/5d0ecd1a76b14978bcac72b421f7e6f0/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:25:12.445039 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad0e2a-1976-4335-af6c-db62693426b5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:12.460199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad0e2a-1976-4335-af6c-db62693426b5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:12.520132 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d5fed-4077-48b2-91e0-396585bf45c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:12.520873 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d5fed-4077-48b2-91e0-396585bf45c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:12.521254 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d5fed-4077-48b2-91e0-396585bf45c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:12.521628 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d5fed-4077-48b2-91e0-396585bf45c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:12.522591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d5fed-4077-48b2-91e0-396585bf45c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:12.524420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d5fed-4077-48b2-91e0-396585bf45c0 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:12.535675 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1267/2514] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:25:12 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:25:12.540090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e079c-f8fa-455c-9efa-1f989fba6a8f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:12.557626 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e079c-f8fa-455c-9efa-1f989fba6a8f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:12.563951 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef562e3b-5871-4c61-bb31-8145322fea07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:12.565479 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef562e3b-5871-4c61-bb31-8145322fea07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:12.565760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef562e3b-5871-4c61-bb31-8145322fea07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:12.566036 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef562e3b-5871-4c61-bb31-8145322fea07 admin admin] PATH_INFO: `/v3/projects/df9944ac81e945958888c4b5a3749fb7/users/5d0ecd1a76b14978bcac72b421f7e6f0/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:12.568193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef562e3b-5871-4c61-bb31-8145322fea07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9944ac81e945958888c4b5a3749fb7, user_id=5d0ecd1a76b14978bcac72b421f7e6f0, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:12.570873 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef562e3b-5871-4c61-bb31-8145322fea07 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:12.582334 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1248/2515] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:25:12 2021] PUT /identity/v3/projects/df9944ac81e945958888c4b5a3749fb7/users/5d0ecd1a76b14978bcac72b421f7e6f0/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:25:12.594773 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c3b4e-678a-4c54-a12b-179cc8c75c4d None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:12.595070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c3b4e-678a-4c54-a12b-179cc8c75c4d None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:12.595616 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c3b4e-678a-4c54-a12b-179cc8c75c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:12.637800 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-f69c3b4e-678a-4c54-a12b-179cc8c75c4d None None] MFA Rules not processed for user `5d0ecd1a76b14978bcac72b421f7e6f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:25:12.639036 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f69c3b4e-678a-4c54-a12b-179cc8c75c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:12.721795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1268/2516] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:25:12 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:25:12.728367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef562e3b-5871-4c61-bb31-8145322fea07 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:12.806751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef562e3b-5871-4c61-bb31-8145322fea07 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:12.811783 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2602deb-389e-4acb-8815-3606e6279eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:12.812684 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2602deb-389e-4acb-8815-3606e6279eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:12.812971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2602deb-389e-4acb-8815-3606e6279eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:12.813257 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2602deb-389e-4acb-8815-3606e6279eda admin admin] PATH_INFO: `/v3/users/0a284e84297a411198edd9279ae50c95` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:12.814997 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2602deb-389e-4acb-8815-3606e6279eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a284e84297a411198edd9279ae50c95)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:12.816966 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2602deb-389e-4acb-8815-3606e6279eda admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:12.879727 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f2602deb-389e-4acb-8815-3606e6279eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a284e84297a411198edd9279ae50c95'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:12.880685 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f2602deb-389e-4acb-8815-3606e6279eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a284e84297a411198edd9279ae50c95'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:12.893009 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f2602deb-389e-4acb-8815-3606e6279eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a284e84297a411198edd9279ae50c95'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:12.893974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f2602deb-389e-4acb-8815-3606e6279eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a284e84297a411198edd9279ae50c95'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:12.907382 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f2602deb-389e-4acb-8815-3606e6279eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a284e84297a411198edd9279ae50c95'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:12.932328 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1249/2517] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:25:12 2021] DELETE /identity/v3/users/0a284e84297a411198edd9279ae50c95 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:25:12.937806 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c045b0-c0e2-46e1-96a8-db4a9613aeec None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:12.938324 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c045b0-c0e2-46e1-96a8-db4a9613aeec None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:12.938695 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c045b0-c0e2-46e1-96a8-db4a9613aeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:12.970556 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-11c045b0-c0e2-46e1-96a8-db4a9613aeec None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:25:12.971857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-11c045b0-c0e2-46e1-96a8-db4a9613aeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:13.067331 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1269/2518] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:25:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:25:13.077685 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2602deb-389e-4acb-8815-3606e6279eda admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:13.079302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f2602deb-389e-4acb-8815-3606e6279eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:13.152368 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2602deb-389e-4acb-8815-3606e6279eda admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:13.156907 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c29fe-a6db-4faf-a7ba-5e04284e231c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:13.157602 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c29fe-a6db-4faf-a7ba-5e04284e231c service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:13.157888 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c29fe-a6db-4faf-a7ba-5e04284e231c service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:13.158167 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c29fe-a6db-4faf-a7ba-5e04284e231c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:13.169486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c29fe-a6db-4faf-a7ba-5e04284e231c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:13.170982 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c29fe-a6db-4faf-a7ba-5e04284e231c service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:13.182398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1250/2519] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:25:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:25:13.482207 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c045b0-c0e2-46e1-96a8-db4a9613aeec None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:13.483805 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-11c045b0-c0e2-46e1-96a8-db4a9613aeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:13.496493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c045b0-c0e2-46e1-96a8-db4a9613aeec None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:13.502640 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:13.503743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:13.504032 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:13.504308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] PATH_INFO: `/v3/projects/0f88c678b226446d97b75011ca866f9e` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:13.505642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f88c678b226446d97b75011ca866f9e)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:13.508821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:13.562958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f88c678b226446d97b75011ca866f9e', 'request_id': 'req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:13.570580 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f88c678b226446d97b75011ca866f9e', 'request_id': 'req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:13.576768 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f88c678b226446d97b75011ca866f9e', 'request_id': 'req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:13.590180 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] The token cache is being invalidate because project 0f88c678b226446d97b75011ca866f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:25:13.590387 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:13.591027 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:13.593312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1270/2520] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:25:13 2021] DELETE /identity/v3/projects/0f88c678b226446d97b75011ca866f9e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:25:13.598859 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c29fe-a6db-4faf-a7ba-5e04284e231c service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:13.609551 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c29fe-a6db-4faf-a7ba-5e04284e231c service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:13.678124 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1b839-4b8f-4607-9005-fcebb3bc99e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:13.679212 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1b839-4b8f-4607-9005-fcebb3bc99e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:13.679586 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1b839-4b8f-4607-9005-fcebb3bc99e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:13.679940 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1b839-4b8f-4607-9005-fcebb3bc99e5 admin admin] PATH_INFO: `/v3/users/5d0ecd1a76b14978bcac72b421f7e6f0` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:13.681671 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1b839-4b8f-4607-9005-fcebb3bc99e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0ecd1a76b14978bcac72b421f7e6f0)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:13.683808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1b839-4b8f-4607-9005-fcebb3bc99e5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:13.746395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c9e1b839-4b8f-4607-9005-fcebb3bc99e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0ecd1a76b14978bcac72b421f7e6f0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:13.747108 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c9e1b839-4b8f-4607-9005-fcebb3bc99e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0ecd1a76b14978bcac72b421f7e6f0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:13.756148 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c9e1b839-4b8f-4607-9005-fcebb3bc99e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0ecd1a76b14978bcac72b421f7e6f0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:13.756781 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c9e1b839-4b8f-4607-9005-fcebb3bc99e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0ecd1a76b14978bcac72b421f7e6f0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:13.764635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c9e1b839-4b8f-4607-9005-fcebb3bc99e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0ecd1a76b14978bcac72b421f7e6f0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:13.785786 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1251/2521] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:25:13 2021] DELETE /identity/v3/users/5d0ecd1a76b14978bcac72b421f7e6f0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:25:14.128771 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:14.130323 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:14.146161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29166d31-fae6-4ba8-bac2-8dfb1cfbb00c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:14.205236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:14.206128 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:14.206406 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:14.206677 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb admin admin] PATH_INFO: `/v3/projects/df9944ac81e945958888c4b5a3749fb7` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:14.207942 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9944ac81e945958888c4b5a3749fb7)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:14.209850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:14.263326 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9944ac81e945958888c4b5a3749fb7', 'request_id': 'req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:14.270374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9944ac81e945958888c4b5a3749fb7', 'request_id': 'req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:14.276446 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9944ac81e945958888c4b5a3749fb7', 'request_id': 'req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:14.290236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb admin admin] The token cache is being invalidate because project df9944ac81e945958888c4b5a3749fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:25:14.290616 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:14.291299 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-8ebbf3dc-a0f0-47fb-88ca-eac741cb22fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:25:14.293030 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1271/2522] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:25:14 2021] DELETE /identity/v3/projects/df9944ac81e945958888c4b5a3749fb7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:25:14.302644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66655005-150d-4389-9d07-b106c5ea40ca None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:14.303244 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66655005-150d-4389-9d07-b106c5ea40ca None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:14.303373 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66655005-150d-4389-9d07-b106c5ea40ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:14.322264 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-66655005-150d-4389-9d07-b106c5ea40ca None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:25:14.323569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-66655005-150d-4389-9d07-b106c5ea40ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:14.390279 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1252/2523] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:25:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:25:14.398879 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6f685-5b47-427f-a5f9-e0e1d8c1afa3 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:14.399189 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6f685-5b47-427f-a5f9-e0e1d8c1afa3 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:14.399490 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6f685-5b47-427f-a5f9-e0e1d8c1afa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:14.423491 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-aca6f685-5b47-427f-a5f9-e0e1d8c1afa3 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:25:14.425203 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-aca6f685-5b47-427f-a5f9-e0e1d8c1afa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:14.434095 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1272/2524] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:25:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:25:14.438539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66655005-150d-4389-9d07-b106c5ea40ca None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:14.449253 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66655005-150d-4389-9d07-b106c5ea40ca None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:14.454205 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb11271-23ad-4b3e-8383-c77bfc384fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:14.455064 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb11271-23ad-4b3e-8383-c77bfc384fac admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:14.455655 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb11271-23ad-4b3e-8383-c77bfc384fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:14.456075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb11271-23ad-4b3e-8383-c77bfc384fac admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:14.457099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb11271-23ad-4b3e-8383-c77bfc384fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:25:14.457411 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb11271-23ad-4b3e-8383-c77bfc384fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:14.459086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb11271-23ad-4b3e-8383-c77bfc384fac admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:14.472463 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1253/2525] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:25:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:25:14.476839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6f685-5b47-427f-a5f9-e0e1d8c1afa3 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:14.486852 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6f685-5b47-427f-a5f9-e0e1d8c1afa3 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:14.499087 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871aee6-34cf-4dfb-9d99-0ca44e76e8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:14.499781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871aee6-34cf-4dfb-9d99-0ca44e76e8ff admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:14.500056 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871aee6-34cf-4dfb-9d99-0ca44e76e8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:14.500323 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871aee6-34cf-4dfb-9d99-0ca44e76e8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:14.501037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871aee6-34cf-4dfb-9d99-0ca44e76e8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:14.502942 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871aee6-34cf-4dfb-9d99-0ca44e76e8ff admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:14.531187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1273/2526] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:25:14 2021] POST /identity/v3/projects => generated 357 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:25:14.537449 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb11271-23ad-4b3e-8383-c77bfc384fac admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:14.548798 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb11271-23ad-4b3e-8383-c77bfc384fac admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:14.610837 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ce748-d22b-4639-814b-db17422cda89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:14.611661 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ce748-d22b-4639-814b-db17422cda89 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:14.611913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ce748-d22b-4639-814b-db17422cda89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:14.612836 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ce748-d22b-4639-814b-db17422cda89 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:14.613529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ce748-d22b-4639-814b-db17422cda89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:14.615529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ce748-d22b-4639-814b-db17422cda89 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:14.637003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1254/2527] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:25:14 2021] POST /identity/v3/users => generated 279 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:25:14.641556 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871aee6-34cf-4dfb-9d99-0ca44e76e8ff admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:14.653369 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871aee6-34cf-4dfb-9d99-0ca44e76e8ff admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:14.658552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2d9a8-5af3-4ec9-98ce-188f9bc56c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:14.659199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2d9a8-5af3-4ec9-98ce-188f9bc56c53 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:14.659484 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2d9a8-5af3-4ec9-98ce-188f9bc56c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:14.659757 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2d9a8-5af3-4ec9-98ce-188f9bc56c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:14.660530 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2d9a8-5af3-4ec9-98ce-188f9bc56c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:14.662136 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2d9a8-5af3-4ec9-98ce-188f9bc56c53 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:14.673934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1274/2528] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:25:14 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:25:14.678300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ce748-d22b-4639-814b-db17422cda89 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:14.693635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ce748-d22b-4639-814b-db17422cda89 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:14.698433 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218955a6-2c31-42c9-a31c-d7b61838ca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:14.699114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218955a6-2c31-42c9-a31c-d7b61838ca5f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:14.699430 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218955a6-2c31-42c9-a31c-d7b61838ca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:14.699699 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218955a6-2c31-42c9-a31c-d7b61838ca5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:14.700570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218955a6-2c31-42c9-a31c-d7b61838ca5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:14.703067 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218955a6-2c31-42c9-a31c-d7b61838ca5f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:14.716167 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1255/2529] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:25:14 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:25:14.720709 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2d9a8-5af3-4ec9-98ce-188f9bc56c53 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:14.731167 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2d9a8-5af3-4ec9-98ce-188f9bc56c53 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:14.736495 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d141ffa-7ea2-436d-9ad4-690791e2f91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:14.737445 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d141ffa-7ea2-436d-9ad4-690791e2f91d admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:14.737726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d141ffa-7ea2-436d-9ad4-690791e2f91d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:14.737997 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d141ffa-7ea2-436d-9ad4-690791e2f91d admin admin] PATH_INFO: `/v3/projects/10de37dd02104fd2bd342847ba09203a/users/f40310cd51314cc49284a5f9a5246b0b/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:14.754803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d141ffa-7ea2-436d-9ad4-690791e2f91d admin admin] RBAC: Authorizing `identity:create_grant(project_id=10de37dd02104fd2bd342847ba09203a, user_id=f40310cd51314cc49284a5f9a5246b0b, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:14.757995 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d141ffa-7ea2-436d-9ad4-690791e2f91d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:14.776138 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1275/2530] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:25:14 2021] PUT /identity/v3/projects/10de37dd02104fd2bd342847ba09203a/users/f40310cd51314cc49284a5f9a5246b0b/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:25:14.787195 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c54f65-5b8f-41ab-a8c7-409497c56ca4 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:14.791941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c54f65-5b8f-41ab-a8c7-409497c56ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:14.791941 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c54f65-5b8f-41ab-a8c7-409497c56ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:14.816660 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-25c54f65-5b8f-41ab-a8c7-409497c56ca4 None None] MFA Rules not processed for user `f40310cd51314cc49284a5f9a5246b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:25:14.817885 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-25c54f65-5b8f-41ab-a8c7-409497c56ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:14.888633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1256/2531] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:25:14 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:25:14.894519 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d141ffa-7ea2-436d-9ad4-690791e2f91d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:14.971816 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d141ffa-7ea2-436d-9ad4-690791e2f91d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:14.976982 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea373115-7147-4df2-b8ef-b467da4101c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:14.977661 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea373115-7147-4df2-b8ef-b467da4101c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:14.977946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea373115-7147-4df2-b8ef-b467da4101c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:14.978853 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea373115-7147-4df2-b8ef-b467da4101c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:14.978963 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea373115-7147-4df2-b8ef-b467da4101c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:14.980920 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea373115-7147-4df2-b8ef-b467da4101c1 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:15.014986 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1276/2532] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:25:14 2021] POST /identity/v3/projects => generated 357 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:25:15.016254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c54f65-5b8f-41ab-a8c7-409497c56ca4 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:15.028210 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c54f65-5b8f-41ab-a8c7-409497c56ca4 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:15.089950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480d50-2c5d-4f38-96a6-a2c36243c9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:15.090640 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480d50-2c5d-4f38-96a6-a2c36243c9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:15.090947 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480d50-2c5d-4f38-96a6-a2c36243c9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:15.091228 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480d50-2c5d-4f38-96a6-a2c36243c9f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:15.091955 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6480d50-2c5d-4f38-96a6-a2c36243c9f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:15.093900 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6480d50-2c5d-4f38-96a6-a2c36243c9f7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:15.116863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1257/2533] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:25:15 2021] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:25:15.121206 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea373115-7147-4df2-b8ef-b467da4101c1 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:15.132658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea373115-7147-4df2-b8ef-b467da4101c1 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:15.137808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c0f41-9300-4a9f-91f6-c0cfc59a0313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:15.138477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c0f41-9300-4a9f-91f6-c0cfc59a0313 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:15.138785 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c0f41-9300-4a9f-91f6-c0cfc59a0313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:15.139076 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c0f41-9300-4a9f-91f6-c0cfc59a0313 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:15.139829 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c0f41-9300-4a9f-91f6-c0cfc59a0313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:15.141418 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c0f41-9300-4a9f-91f6-c0cfc59a0313 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:15.153926 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1277/2534] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:25:15 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:25:15.159183 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480d50-2c5d-4f38-96a6-a2c36243c9f7 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:15.169398 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480d50-2c5d-4f38-96a6-a2c36243c9f7 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:15.176712 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43def5af-872f-4ef7-9376-9ec309ff9349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:15.177887 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43def5af-872f-4ef7-9376-9ec309ff9349 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:15.178169 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43def5af-872f-4ef7-9376-9ec309ff9349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:15.178444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43def5af-872f-4ef7-9376-9ec309ff9349 admin admin] PATH_INFO: `/v3/projects/af9737666c9c40e391852026208565b4/users/ad93a917e34949bdadbaa644d22677d0/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:15.195094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43def5af-872f-4ef7-9376-9ec309ff9349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9737666c9c40e391852026208565b4, user_id=ad93a917e34949bdadbaa644d22677d0, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:15.197786 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43def5af-872f-4ef7-9376-9ec309ff9349 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:15.213472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1258/2535] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:25:15 2021] PUT /identity/v3/projects/af9737666c9c40e391852026208565b4/users/ad93a917e34949bdadbaa644d22677d0/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:25:15.218717 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c0f41-9300-4a9f-91f6-c0cfc59a0313 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:15.227802 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c0f41-9300-4a9f-91f6-c0cfc59a0313 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:15.291191 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e70744-0862-4875-be09-49f9f2686087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:15.291957 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e70744-0862-4875-be09-49f9f2686087 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:15.292294 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e70744-0862-4875-be09-49f9f2686087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:15.292671 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e70744-0862-4875-be09-49f9f2686087 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:15.293724 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e70744-0862-4875-be09-49f9f2686087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:15.296111 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e70744-0862-4875-be09-49f9f2686087 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:15.307848 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1278/2536] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:25:15 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:25:15.312252 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43def5af-872f-4ef7-9376-9ec309ff9349 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:15.324001 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43def5af-872f-4ef7-9376-9ec309ff9349 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:15.329001 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046eaaa1-279e-4e0b-a710-1d46bafc39ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:15.329945 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046eaaa1-279e-4e0b-a710-1d46bafc39ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:15.330551 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046eaaa1-279e-4e0b-a710-1d46bafc39ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:15.330768 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046eaaa1-279e-4e0b-a710-1d46bafc39ea admin admin] PATH_INFO: `/v3/projects/af9737666c9c40e391852026208565b4/users/ad93a917e34949bdadbaa644d22677d0/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:15.332937 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046eaaa1-279e-4e0b-a710-1d46bafc39ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9737666c9c40e391852026208565b4, user_id=ad93a917e34949bdadbaa644d22677d0, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:15.336731 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046eaaa1-279e-4e0b-a710-1d46bafc39ea admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:15.349621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1259/2537] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:25:15 2021] PUT /identity/v3/projects/af9737666c9c40e391852026208565b4/users/ad93a917e34949bdadbaa644d22677d0/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:25:15.367279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10dcfe-8cd8-43f8-863a-c487a7c6cd43 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:15.367550 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10dcfe-8cd8-43f8-863a-c487a7c6cd43 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:15.367831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10dcfe-8cd8-43f8-863a-c487a7c6cd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:15.400200 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-1f10dcfe-8cd8-43f8-863a-c487a7c6cd43 None None] MFA Rules not processed for user `ad93a917e34949bdadbaa644d22677d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:25:15.401441 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1f10dcfe-8cd8-43f8-863a-c487a7c6cd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:15.489315 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1279/2538] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:25:15 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:25:15.500852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046eaaa1-279e-4e0b-a710-1d46bafc39ea admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:15.503622 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-046eaaa1-279e-4e0b-a710-1d46bafc39ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:15.568046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046eaaa1-279e-4e0b-a710-1d46bafc39ea admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:15.572303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d8014-df56-485c-a7cc-0ebf6c803ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:15.572969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d8014-df56-485c-a7cc-0ebf6c803ffc service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:15.573289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d8014-df56-485c-a7cc-0ebf6c803ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:15.573565 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d8014-df56-485c-a7cc-0ebf6c803ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:15.584267 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d8014-df56-485c-a7cc-0ebf6c803ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:15.585742 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d8014-df56-485c-a7cc-0ebf6c803ffc service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:15.596350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1260/2539] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:25:15 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:25:15.679969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10dcfe-8cd8-43f8-863a-c487a7c6cd43 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:15.690404 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10dcfe-8cd8-43f8-863a-c487a7c6cd43 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:15.694098 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970aa85-69bb-4751-97e4-0fb13c6ded3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:15.694750 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970aa85-69bb-4751-97e4-0fb13c6ded3c service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:15.695032 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970aa85-69bb-4751-97e4-0fb13c6ded3c service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:15.695334 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970aa85-69bb-4751-97e4-0fb13c6ded3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:15.762747 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970aa85-69bb-4751-97e4-0fb13c6ded3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:15.764150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970aa85-69bb-4751-97e4-0fb13c6ded3c service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:15.774472 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1280/2540] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:25:15 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:25:21.873528 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d8014-df56-485c-a7cc-0ebf6c803ffc service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:25:21.875006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e76d8014-df56-485c-a7cc-0ebf6c803ffc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:21.999839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d8014-df56-485c-a7cc-0ebf6c803ffc service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:25:22.005203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbd53e-fca2-40f0-8d92-73a22fd019be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '642c2b97ece34d69bacd821b108bd210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:25:22.005865 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbd53e-fca2-40f0-8d92-73a22fd019be service placement] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:25:22.006140 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbd53e-fca2-40f0-8d92-73a22fd019be service placement] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:25:22.006410 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbd53e-fca2-40f0-8d92-73a22fd019be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:25:22.008736 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-abdbd53e-fca2-40f0-8d92-73a22fd019be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:25:22.020932 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbd53e-fca2-40f0-8d92-73a22fd019be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:25:22.022531 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbd53e-fca2-40f0-8d92-73a22fd019be service placement] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:25:22.033022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1261/2541] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:25:21 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:28:22.973144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970aa85-69bb-4751-97e4-0fb13c6ded3c service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:28:23.015389 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970aa85-69bb-4751-97e4-0fb13c6ded3c service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:28:23.022327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f96b1-b6cb-42b5-8342-fbd0c8160a3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:28:23.022966 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f96b1-b6cb-42b5-8342-fbd0c8160a3b service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:28:23.023309 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f96b1-b6cb-42b5-8342-fbd0c8160a3b service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:28:23.023582 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f96b1-b6cb-42b5-8342-fbd0c8160a3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:28:23.025764 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6c4f96b1-b6cb-42b5-8342-fbd0c8160a3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:28:23.109986 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f96b1-b6cb-42b5-8342-fbd0c8160a3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:28:23.111494 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f96b1-b6cb-42b5-8342-fbd0c8160a3b service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:28:23.125556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbd53e-fca2-40f0-8d92-73a22fd019be service placement] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:28:23.127307 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-abdbd53e-fca2-40f0-8d92-73a22fd019be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:28:23.130597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1281/2542] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:28:22 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:28:23.153566 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbd53e-fca2-40f0-8d92-73a22fd019be service placement] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:28:23.157498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b48d7c-2298-453c-8418-b7226e1edc9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:28:23.158573 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b48d7c-2298-453c-8418-b7226e1edc9b service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:28:23.158573 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b48d7c-2298-453c-8418-b7226e1edc9b service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:28:23.158822 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b48d7c-2298-453c-8418-b7226e1edc9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:28:23.160833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-44b48d7c-2298-453c-8418-b7226e1edc9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:28:23.240300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b48d7c-2298-453c-8418-b7226e1edc9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:28:23.241745 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b48d7c-2298-453c-8418-b7226e1edc9b service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:28:23.251447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1262/2543] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:28:23 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:29:44.808445 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f96b1-b6cb-42b5-8342-fbd0c8160a3b service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:29:44.810043 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6c4f96b1-b6cb-42b5-8342-fbd0c8160a3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:29:44.940253 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f96b1-b6cb-42b5-8342-fbd0c8160a3b service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:29:44.947358 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57721926-e86d-4178-9646-a3da89b88d36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:29:44.948021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57721926-e86d-4178-9646-a3da89b88d36 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:29:44.948307 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57721926-e86d-4178-9646-a3da89b88d36 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:29:44.948584 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57721926-e86d-4178-9646-a3da89b88d36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:29:44.950740 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-57721926-e86d-4178-9646-a3da89b88d36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:29:45.017441 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57721926-e86d-4178-9646-a3da89b88d36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:29:45.019665 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57721926-e86d-4178-9646-a3da89b88d36 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:29:45.029612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1282/2544] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:29:44 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:29:46.125521 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b48d7c-2298-453c-8418-b7226e1edc9b service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:29:46.136200 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b48d7c-2298-453c-8418-b7226e1edc9b service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:29:46.140840 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e1b30-1383-467a-9b5d-d5e0aec68378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:29:46.141519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e1b30-1383-467a-9b5d-d5e0aec68378 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:29:46.141831 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e1b30-1383-467a-9b5d-d5e0aec68378 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:29:46.142104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e1b30-1383-467a-9b5d-d5e0aec68378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:29:46.144472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6a6e1b30-1383-467a-9b5d-d5e0aec68378 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:29:46.158461 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e1b30-1383-467a-9b5d-d5e0aec68378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:29:46.160114 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e1b30-1383-467a-9b5d-d5e0aec68378 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:29:46.171096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1263/2545] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:29:46 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:29:47.249506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57721926-e86d-4178-9646-a3da89b88d36 service nova] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:29:47.262394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57721926-e86d-4178-9646-a3da89b88d36 service nova] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:29:47.267749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28606ee-9986-4238-82a2-0850992dec6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:29:47.268394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28606ee-9986-4238-82a2-0850992dec6c service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:29:47.268702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28606ee-9986-4238-82a2-0850992dec6c service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:29:47.269072 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28606ee-9986-4238-82a2-0850992dec6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:29:47.271748 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d28606ee-9986-4238-82a2-0850992dec6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:29:47.286503 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28606ee-9986-4238-82a2-0850992dec6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:29:47.287963 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28606ee-9986-4238-82a2-0850992dec6c service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:29:47.298877 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1283/2546] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:29:47 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:30:16.032894 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e1b30-1383-467a-9b5d-d5e0aec68378 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:30:16.043431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e1b30-1383-467a-9b5d-d5e0aec68378 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:30:16.048308 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31417ca0-6080-4022-bc99-30dacb139a76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:30:16.048923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31417ca0-6080-4022-bc99-30dacb139a76 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:30:16.049538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31417ca0-6080-4022-bc99-30dacb139a76 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:30:16.049538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31417ca0-6080-4022-bc99-30dacb139a76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:30:16.059379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31417ca0-6080-4022-bc99-30dacb139a76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:30:16.060698 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31417ca0-6080-4022-bc99-30dacb139a76 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:30:16.070648 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1264/2547] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:30:16 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:30:23.632966 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28606ee-9986-4238-82a2-0850992dec6c service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:30:23.634439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d28606ee-9986-4238-82a2-0850992dec6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:30:23.717260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28606ee-9986-4238-82a2-0850992dec6c service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:30:23.721970 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a3799-fcfb-4044-85d5-57de84218d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:30:23.722619 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a3799-fcfb-4044-85d5-57de84218d4c service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:30:23.722898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a3799-fcfb-4044-85d5-57de84218d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:30:23.723174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a3799-fcfb-4044-85d5-57de84218d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:30:23.725265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-db6a3799-fcfb-4044-85d5-57de84218d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:30:23.818813 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a3799-fcfb-4044-85d5-57de84218d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:30:23.820400 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a3799-fcfb-4044-85d5-57de84218d4c service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:30:23.839163 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1284/2548] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:30:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:30:26.977996 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31417ca0-6080-4022-bc99-30dacb139a76 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:30:26.979609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-31417ca0-6080-4022-bc99-30dacb139a76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:30:26.995955 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31417ca0-6080-4022-bc99-30dacb139a76 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:30:27.001907 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcb92a-0446-49e4-a1e5-1ce1d28b17b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '642c2b97ece34d69bacd821b108bd210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:30:27.002580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcb92a-0446-49e4-a1e5-1ce1d28b17b6 service placement] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:30:27.002863 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcb92a-0446-49e4-a1e5-1ce1d28b17b6 service placement] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:30:27.003167 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcb92a-0446-49e4-a1e5-1ce1d28b17b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:30:27.014536 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcb92a-0446-49e4-a1e5-1ce1d28b17b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:30:27.016254 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcb92a-0446-49e4-a1e5-1ce1d28b17b6 service placement] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:30:27.030152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1265/2549] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:30:26 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:30:30.352381 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a3799-fcfb-4044-85d5-57de84218d4c service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:30:30.353851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-db6a3799-fcfb-4044-85d5-57de84218d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:30:30.367153 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a3799-fcfb-4044-85d5-57de84218d4c service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:30:30.372035 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8606e-d924-4742-83d0-061f61fec278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:30:30.372972 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8606e-d924-4742-83d0-061f61fec278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:30:30.373307 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8606e-d924-4742-83d0-061f61fec278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:30:30.373532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8606e-d924-4742-83d0-061f61fec278 admin admin] PATH_INFO: `/v3/users/350be9489e354eeda45274e00a116108` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:30:30.374761 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8606e-d924-4742-83d0-061f61fec278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=350be9489e354eeda45274e00a116108)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:30:30.376960 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8606e-d924-4742-83d0-061f61fec278 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:30:30.427684 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-80b8606e-d924-4742-83d0-061f61fec278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350be9489e354eeda45274e00a116108'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:30.428528 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-80b8606e-d924-4742-83d0-061f61fec278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350be9489e354eeda45274e00a116108'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:30.437494 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-80b8606e-d924-4742-83d0-061f61fec278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350be9489e354eeda45274e00a116108'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:30.438216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-80b8606e-d924-4742-83d0-061f61fec278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350be9489e354eeda45274e00a116108'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:30.451886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-80b8606e-d924-4742-83d0-061f61fec278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350be9489e354eeda45274e00a116108'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:30.468135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1285/2550] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:30:30 2021] DELETE /identity/v3/users/350be9489e354eeda45274e00a116108 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:30:30.644601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcb92a-0446-49e4-a1e5-1ce1d28b17b6 service placement] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:30:30.655937 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcb92a-0446-49e4-a1e5-1ce1d28b17b6 service placement] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:30:30.714950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:30:30.715813 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:30:30.716096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:30:30.716373 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] PATH_INFO: `/v3/projects/86636965098a4c7d9a77d50476f46772` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:30:30.717723 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86636965098a4c7d9a77d50476f46772)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:30:30.719713 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:30:30.779642 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86636965098a4c7d9a77d50476f46772', 'request_id': 'req-5da0f380-d926-464c-88d4-b381f05ae9b3'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:30.788937 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86636965098a4c7d9a77d50476f46772', 'request_id': 'req-5da0f380-d926-464c-88d4-b381f05ae9b3'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:30.798444 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86636965098a4c7d9a77d50476f46772', 'request_id': 'req-5da0f380-d926-464c-88d4-b381f05ae9b3'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:30.815778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] The token cache is being invalidate because project 86636965098a4c7d9a77d50476f46772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:30:30.816085 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:30.816738 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:30.818374 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1266/2551] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:30:30 2021] DELETE /identity/v3/projects/86636965098a4c7d9a77d50476f46772 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:30:30.822627 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8606e-d924-4742-83d0-061f61fec278 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:30:30.824233 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-80b8606e-d924-4742-83d0-061f61fec278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:30:30.839390 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8606e-d924-4742-83d0-061f61fec278 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:30:30.903477 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3ffda-04cf-4dbf-aa4a-a1f7c7920b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:30:30.904355 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3ffda-04cf-4dbf-aa4a-a1f7c7920b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:30:30.904636 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3ffda-04cf-4dbf-aa4a-a1f7c7920b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:30:30.904906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3ffda-04cf-4dbf-aa4a-a1f7c7920b00 admin admin] PATH_INFO: `/v3/users/6a96cbadb0b0494fb3977718dfd638ae` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:30:30.918863 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3ffda-04cf-4dbf-aa4a-a1f7c7920b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a96cbadb0b0494fb3977718dfd638ae)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:30:30.920817 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3ffda-04cf-4dbf-aa4a-a1f7c7920b00 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:30:30.967921 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-60b3ffda-04cf-4dbf-aa4a-a1f7c7920b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a96cbadb0b0494fb3977718dfd638ae'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:30.968578 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-60b3ffda-04cf-4dbf-aa4a-a1f7c7920b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a96cbadb0b0494fb3977718dfd638ae'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:30.976542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-60b3ffda-04cf-4dbf-aa4a-a1f7c7920b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a96cbadb0b0494fb3977718dfd638ae'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:30.977160 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-60b3ffda-04cf-4dbf-aa4a-a1f7c7920b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a96cbadb0b0494fb3977718dfd638ae'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:30.989093 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-60b3ffda-04cf-4dbf-aa4a-a1f7c7920b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a96cbadb0b0494fb3977718dfd638ae'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:31.002739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1286/2552] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:30:30 2021] DELETE /identity/v3/users/6a96cbadb0b0494fb3977718dfd638ae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:30:31.188993 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:30:31.190756 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:30:31.204481 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0f380-d926-464c-88d4-b381f05ae9b3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:30:31.265119 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:30:31.265991 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:30:31.266274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:30:31.266549 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] PATH_INFO: `/v3/projects/f30ba26659344cb18cf7b09eae297aa4` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:30:31.278245 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30ba26659344cb18cf7b09eae297aa4)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:30:31.280218 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:30:31.329414 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30ba26659344cb18cf7b09eae297aa4', 'request_id': 'req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:31.336437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30ba26659344cb18cf7b09eae297aa4', 'request_id': 'req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:31.343153 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30ba26659344cb18cf7b09eae297aa4', 'request_id': 'req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:31.356627 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] The token cache is being invalidate because project f30ba26659344cb18cf7b09eae297aa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:30:31.356911 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:31.357551 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:30:31.359138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1267/2553] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:30:31 2021] DELETE /identity/v3/projects/f30ba26659344cb18cf7b09eae297aa4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:33:22.254177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3ffda-04cf-4dbf-aa4a-a1f7c7920b00 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:33:22.256894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-60b3ffda-04cf-4dbf-aa4a-a1f7c7920b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:33:22.327081 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3ffda-04cf-4dbf-aa4a-a1f7c7920b00 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:33:22.382375 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da2221-db36-44ec-9de7-f0fd42981268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:33:22.383996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da2221-db36-44ec-9de7-f0fd42981268 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:33:22.383996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da2221-db36-44ec-9de7-f0fd42981268 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:33:22.384152 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da2221-db36-44ec-9de7-f0fd42981268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:33:22.386961 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-67da2221-db36-44ec-9de7-f0fd42981268 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:33:22.450351 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da2221-db36-44ec-9de7-f0fd42981268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:33:22.451868 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da2221-db36-44ec-9de7-f0fd42981268 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:33:22.471221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1287/2554] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:33:22 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:34:44.733756 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:34:44.736263 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:34:44.825070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02c6ea-3e6e-4f28-bdbb-30c17ebf46fb admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:34:44.831318 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598985a7-7013-43a6-b342-6e15b5763007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:34:44.831975 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598985a7-7013-43a6-b342-6e15b5763007 service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:34:44.832255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598985a7-7013-43a6-b342-6e15b5763007 service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:34:44.832525 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598985a7-7013-43a6-b342-6e15b5763007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:34:44.834503 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-598985a7-7013-43a6-b342-6e15b5763007 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:34:44.901678 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598985a7-7013-43a6-b342-6e15b5763007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:34:44.904124 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598985a7-7013-43a6-b342-6e15b5763007 service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:34:44.917349 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1268/2555] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:34:44 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:34:47.067078 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da2221-db36-44ec-9de7-f0fd42981268 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:34:47.068751 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-67da2221-db36-44ec-9de7-f0fd42981268 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:34:47.080237 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da2221-db36-44ec-9de7-f0fd42981268 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:34:47.085187 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d06db-b483-463c-9cb1-c08f3ad929d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:34:47.086022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d06db-b483-463c-9cb1-c08f3ad929d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:34:47.086297 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d06db-b483-463c-9cb1-c08f3ad929d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:34:47.086574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d06db-b483-463c-9cb1-c08f3ad929d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:34:47.088707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-753d06db-b483-463c-9cb1-c08f3ad929d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:34:47.106850 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d06db-b483-463c-9cb1-c08f3ad929d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:34:47.109099 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d06db-b483-463c-9cb1-c08f3ad929d2 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:34:47.122859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1288/2556] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:34:47 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:34:48.192676 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598985a7-7013-43a6-b342-6e15b5763007 service nova] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:34:48.194401 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-598985a7-7013-43a6-b342-6e15b5763007 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:34:48.207445 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598985a7-7013-43a6-b342-6e15b5763007 service nova] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:34:48.212180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51020f-b5e4-4daf-ae9e-5caff795e501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:34:48.212823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51020f-b5e4-4daf-ae9e-5caff795e501 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:34:48.213113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51020f-b5e4-4daf-ae9e-5caff795e501 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:34:48.213379 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51020f-b5e4-4daf-ae9e-5caff795e501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:34:48.215354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6e51020f-b5e4-4daf-ae9e-5caff795e501 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:34:48.229812 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51020f-b5e4-4daf-ae9e-5caff795e501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:34:48.231283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51020f-b5e4-4daf-ae9e-5caff795e501 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:34:48.242324 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1269/2557] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:34:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:35:16.316139 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d06db-b483-463c-9cb1-c08f3ad929d2 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:16.329501 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d06db-b483-463c-9cb1-c08f3ad929d2 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:16.334158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f324f-c648-4bd3-b67b-c6d4d13849c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:16.334803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f324f-c648-4bd3-b67b-c6d4d13849c2 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:16.335083 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f324f-c648-4bd3-b67b-c6d4d13849c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:16.335380 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f324f-c648-4bd3-b67b-c6d4d13849c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:16.337554 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b13f324f-c648-4bd3-b67b-c6d4d13849c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:16.455763 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f324f-c648-4bd3-b67b-c6d4d13849c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:16.457243 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f324f-c648-4bd3-b67b-c6d4d13849c2 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:16.478214 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1289/2558] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:35:16 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:35:32.876337 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51020f-b5e4-4daf-ae9e-5caff795e501 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:32.877925 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6e51020f-b5e4-4daf-ae9e-5caff795e501 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:33.024100 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51020f-b5e4-4daf-ae9e-5caff795e501 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:33.029918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3a06f-f20a-46f9-9116-aaaef3aec73e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '642c2b97ece34d69bacd821b108bd210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:33.030569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3a06f-f20a-46f9-9116-aaaef3aec73e service placement] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:33.030861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3a06f-f20a-46f9-9116-aaaef3aec73e service placement] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:33.031151 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3a06f-f20a-46f9-9116-aaaef3aec73e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:33.033393 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-a7b3a06f-f20a-46f9-9116-aaaef3aec73e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:33.045335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3a06f-f20a-46f9-9116-aaaef3aec73e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:33.046923 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3a06f-f20a-46f9-9116-aaaef3aec73e service placement] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:33.057330 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1270/2559] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:35:32 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:35:45.033204 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3a06f-f20a-46f9-9116-aaaef3aec73e service placement] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:45.034118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f324f-c648-4bd3-b67b-c6d4d13849c2 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:45.035371 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-a7b3a06f-f20a-46f9-9116-aaaef3aec73e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:45.035574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b13f324f-c648-4bd3-b67b-c6d4d13849c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:45.119538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f324f-c648-4bd3-b67b-c6d4d13849c2 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:45.122551 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3a06f-f20a-46f9-9116-aaaef3aec73e service placement] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:45.123716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2cf5a-1863-4322-acda-49e4c5136924 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a71b8adef243049d3b055e66566a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:45.125506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2cf5a-1863-4322-acda-49e4c5136924 service glance] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:45.125506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2cf5a-1863-4322-acda-49e4c5136924 service glance] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:45.125506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2cf5a-1863-4322-acda-49e4c5136924 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:45.126770 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8351de-e36e-4bf4-ac71-678702272b51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a71b8adef243049d3b055e66566a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:45.126897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-32f2cf5a-1863-4322-acda-49e4c5136924 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:45.127441 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8351de-e36e-4bf4-ac71-678702272b51 service glance] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:45.127719 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8351de-e36e-4bf4-ac71-678702272b51 service glance] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:45.127988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8351de-e36e-4bf4-ac71-678702272b51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:45.130238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-da8351de-e36e-4bf4-ac71-678702272b51 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:45.139190 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: WARNING keystone.server.flask.application [None req-32f2cf5a-1863-4322-acda-49e4c5136924 service glance] Could not find project: 86636965098a4c7d9a77d50476f46772.: keystone.exception.ProjectNotFound: Could not find project: 86636965098a4c7d9a77d50476f46772. Nov 08 11:35:45.140467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1290/2560] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:35:45 2021] GET /identity/v3/auth/tokens => generated 113 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 08 11:35:45.144782 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: WARNING keystone.server.flask.application [None req-da8351de-e36e-4bf4-ac71-678702272b51 service glance] Could not find project: 659fac3889964d1cad61a9db97c72ca7.: keystone.exception.ProjectNotFound: Could not find project: 659fac3889964d1cad61a9db97c72ca7. Nov 08 11:35:45.146061 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1271/2561] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:35:45 2021] GET /identity/v3/auth/tokens => generated 113 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 08 11:35:46.578520 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2cf5a-1863-4322-acda-49e4c5136924 service glance] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:46.580094 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-32f2cf5a-1863-4322-acda-49e4c5136924 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:46.587500 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8351de-e36e-4bf4-ac71-678702272b51 service glance] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:46.597369 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8351de-e36e-4bf4-ac71-678702272b51 service glance] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:46.601619 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928c3bd-db6b-450a-8cc1-964dc4c066b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:46.602265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928c3bd-db6b-450a-8cc1-964dc4c066b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:46.602546 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928c3bd-db6b-450a-8cc1-964dc4c066b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:46.602821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928c3bd-db6b-450a-8cc1-964dc4c066b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:46.604734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1928c3bd-db6b-450a-8cc1-964dc4c066b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:46.639865 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2cf5a-1863-4322-acda-49e4c5136924 service glance] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:46.643558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b64ef1-4418-4d34-bd14-0a6851a059e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:46.644452 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b64ef1-4418-4d34-bd14-0a6851a059e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:46.644728 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b64ef1-4418-4d34-bd14-0a6851a059e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:46.644998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b64ef1-4418-4d34-bd14-0a6851a059e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:46.646823 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-33b64ef1-4418-4d34-bd14-0a6851a059e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:46.686632 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928c3bd-db6b-450a-8cc1-964dc4c066b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:46.688246 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928c3bd-db6b-450a-8cc1-964dc4c066b9 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:46.705945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b64ef1-4418-4d34-bd14-0a6851a059e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:46.706767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1272/2562] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:35:46 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:35:46.707473 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b64ef1-4418-4d34-bd14-0a6851a059e9 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:46.717257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1291/2563] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:35:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:35:47.228281 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928c3bd-db6b-450a-8cc1-964dc4c066b9 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:47.229960 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1928c3bd-db6b-450a-8cc1-964dc4c066b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:47.244666 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928c3bd-db6b-450a-8cc1-964dc4c066b9 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:47.249609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa747c-fc3c-4750-a9ea-88b334e74d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:47.250607 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa747c-fc3c-4750-a9ea-88b334e74d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:47.250912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa747c-fc3c-4750-a9ea-88b334e74d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:47.251168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa747c-fc3c-4750-a9ea-88b334e74d71 admin admin] PATH_INFO: `/v3/users/2e336e1a35de4e5780c3c460d9a4ddd0` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:47.252626 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa747c-fc3c-4750-a9ea-88b334e74d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e336e1a35de4e5780c3c460d9a4ddd0)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:47.255057 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa747c-fc3c-4750-a9ea-88b334e74d71 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:47.308400 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b2aa747c-fc3c-4750-a9ea-88b334e74d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e336e1a35de4e5780c3c460d9a4ddd0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:47.309149 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b2aa747c-fc3c-4750-a9ea-88b334e74d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e336e1a35de4e5780c3c460d9a4ddd0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:47.319880 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b2aa747c-fc3c-4750-a9ea-88b334e74d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e336e1a35de4e5780c3c460d9a4ddd0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:47.320888 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b2aa747c-fc3c-4750-a9ea-88b334e74d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e336e1a35de4e5780c3c460d9a4ddd0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:47.329307 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-b2aa747c-fc3c-4750-a9ea-88b334e74d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e336e1a35de4e5780c3c460d9a4ddd0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:47.350081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1273/2564] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:35:47 2021] DELETE /identity/v3/users/2e336e1a35de4e5780c3c460d9a4ddd0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:35:47.528693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b64ef1-4418-4d34-bd14-0a6851a059e9 service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:47.539536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b64ef1-4418-4d34-bd14-0a6851a059e9 service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:47.597741 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:47.598606 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:47.598884 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:47.599150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4 admin admin] PATH_INFO: `/v3/projects/1cdbc9d0ca85418cbf8cdf6ff34e8cd0` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:47.600401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cdbc9d0ca85418cbf8cdf6ff34e8cd0)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:47.602308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:47.648627 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cdbc9d0ca85418cbf8cdf6ff34e8cd0', 'request_id': 'req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:47.654589 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cdbc9d0ca85418cbf8cdf6ff34e8cd0', 'request_id': 'req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:47.660508 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cdbc9d0ca85418cbf8cdf6ff34e8cd0', 'request_id': 'req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:47.674393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4 admin admin] The token cache is being invalidate because project 1cdbc9d0ca85418cbf8cdf6ff34e8cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:35:47.674703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:47.675517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-b16cac8f-22c6-40cb-b6b6-7c42e931f7b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:47.677222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1292/2565] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:35:47 2021] DELETE /identity/v3/projects/1cdbc9d0ca85418cbf8cdf6ff34e8cd0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:35:47.685554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363f48c-0ae9-4d10-a58d-e642adbaf947 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:47.686034 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363f48c-0ae9-4d10-a58d-e642adbaf947 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:47.686232 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363f48c-0ae9-4d10-a58d-e642adbaf947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:47.754842 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-5363f48c-0ae9-4d10-a58d-e642adbaf947 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:35:47.756090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5363f48c-0ae9-4d10-a58d-e642adbaf947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:47.829606 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1274/2566] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:35:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:35:47.838338 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465770c-7c11-47d6-879d-1091686e097c None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:47.838629 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465770c-7c11-47d6-879d-1091686e097c None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:47.838911 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465770c-7c11-47d6-879d-1091686e097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:47.858782 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-0465770c-7c11-47d6-879d-1091686e097c None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:35:47.860080 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0465770c-7c11-47d6-879d-1091686e097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:47.869765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1293/2567] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:35:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:35:47.874116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363f48c-0ae9-4d10-a58d-e642adbaf947 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:47.884766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363f48c-0ae9-4d10-a58d-e642adbaf947 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:47.890847 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d2078-8416-4a16-80c0-aac41400a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:47.891538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d2078-8416-4a16-80c0-aac41400a40e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:47.891816 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d2078-8416-4a16-80c0-aac41400a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:47.892085 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d2078-8416-4a16-80c0-aac41400a40e admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:47.892818 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d2078-8416-4a16-80c0-aac41400a40e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:35:47.893124 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d2078-8416-4a16-80c0-aac41400a40e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:47.895022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d2078-8416-4a16-80c0-aac41400a40e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:47.911745 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1275/2568] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:35:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:35:47.913027 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465770c-7c11-47d6-879d-1091686e097c None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:47.924118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465770c-7c11-47d6-879d-1091686e097c None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:47.929952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac186865-ccad-45ff-ae9b-b42ae15656bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:47.930635 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186865-ccad-45ff-ae9b-b42ae15656bf admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:47.930914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186865-ccad-45ff-ae9b-b42ae15656bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:47.931222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186865-ccad-45ff-ae9b-b42ae15656bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:47.931956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac186865-ccad-45ff-ae9b-b42ae15656bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:47.933902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac186865-ccad-45ff-ae9b-b42ae15656bf admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:47.976995 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1294/2569] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:35:47 2021] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:35:47.983447 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d2078-8416-4a16-80c0-aac41400a40e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:47.995850 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d2078-8416-4a16-80c0-aac41400a40e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:48.058930 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27e155-b4d6-4959-aa3e-1860ff14f486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:48.059924 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27e155-b4d6-4959-aa3e-1860ff14f486 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:48.060410 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27e155-b4d6-4959-aa3e-1860ff14f486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:48.060699 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27e155-b4d6-4959-aa3e-1860ff14f486 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:48.061416 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27e155-b4d6-4959-aa3e-1860ff14f486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:48.064573 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27e155-b4d6-4959-aa3e-1860ff14f486 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:48.087781 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1276/2570] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:35:47 2021] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:35:48.091797 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac186865-ccad-45ff-ae9b-b42ae15656bf admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:48.102360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac186865-ccad-45ff-ae9b-b42ae15656bf admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:48.107421 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c327d7-59f2-4d6a-91f6-35018ddaffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:48.108114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c327d7-59f2-4d6a-91f6-35018ddaffa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:48.108395 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c327d7-59f2-4d6a-91f6-35018ddaffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:48.108827 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c327d7-59f2-4d6a-91f6-35018ddaffa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:48.109563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c327d7-59f2-4d6a-91f6-35018ddaffa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:48.111296 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c327d7-59f2-4d6a-91f6-35018ddaffa9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:48.121495 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1295/2571] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:35:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:35:48.125544 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27e155-b4d6-4959-aa3e-1860ff14f486 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:48.136328 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27e155-b4d6-4959-aa3e-1860ff14f486 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:48.141325 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21698774-5a1b-43d1-ad9c-441704e898f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:48.142005 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698774-5a1b-43d1-ad9c-441704e898f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:48.142286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698774-5a1b-43d1-ad9c-441704e898f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:48.142555 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698774-5a1b-43d1-ad9c-441704e898f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:48.143363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21698774-5a1b-43d1-ad9c-441704e898f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:48.145090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21698774-5a1b-43d1-ad9c-441704e898f7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:48.155393 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1277/2572] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:35:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:35:48.159899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c327d7-59f2-4d6a-91f6-35018ddaffa9 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:48.169970 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c327d7-59f2-4d6a-91f6-35018ddaffa9 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:48.174783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6778831-60d3-428e-95da-be01751c7a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:48.175852 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778831-60d3-428e-95da-be01751c7a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:48.176137 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778831-60d3-428e-95da-be01751c7a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:48.176414 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778831-60d3-428e-95da-be01751c7a4c admin admin] PATH_INFO: `/v3/projects/6da9f81f345a4196815339ba37ecaa76/users/53a58fd5d15c43a188c03cbad34d9e79/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:48.192219 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6778831-60d3-428e-95da-be01751c7a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da9f81f345a4196815339ba37ecaa76, user_id=53a58fd5d15c43a188c03cbad34d9e79, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:48.194432 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6778831-60d3-428e-95da-be01751c7a4c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:48.209945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1296/2573] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:35:48 2021] PUT /identity/v3/projects/6da9f81f345a4196815339ba37ecaa76/users/53a58fd5d15c43a188c03cbad34d9e79/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:35:48.215623 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59cf28-b4b4-4f75-9079-f559f05ca4d4 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:48.216004 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59cf28-b4b4-4f75-9079-f559f05ca4d4 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:48.216389 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59cf28-b4b4-4f75-9079-f559f05ca4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:48.236111 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-fe59cf28-b4b4-4f75-9079-f559f05ca4d4 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:35:48.237427 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-fe59cf28-b4b4-4f75-9079-f559f05ca4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:48.298840 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1278/2574] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:35:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:35:48.309359 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6778831-60d3-428e-95da-be01751c7a4c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:48.311244 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e6778831-60d3-428e-95da-be01751c7a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:48.389033 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6778831-60d3-428e-95da-be01751c7a4c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:48.393454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61a0d-a10b-4b71-846a-15ca5be9565a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:48.394199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61a0d-a10b-4b71-846a-15ca5be9565a service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:48.394468 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61a0d-a10b-4b71-846a-15ca5be9565a service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:48.394722 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61a0d-a10b-4b71-846a-15ca5be9565a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:48.409330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b61a0d-a10b-4b71-846a-15ca5be9565a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:48.410792 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b61a0d-a10b-4b71-846a-15ca5be9565a service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:48.420319 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1297/2575] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:35:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:35:52.563475 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd25d5-1e7b-4c1e-82f1-a88db7de6228 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:52.563475 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd25d5-1e7b-4c1e-82f1-a88db7de6228 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:52.564091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd25d5-1e7b-4c1e-82f1-a88db7de6228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:52.599798 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-f0cd25d5-1e7b-4c1e-82f1-a88db7de6228 None None] MFA Rules not processed for user `53a58fd5d15c43a188c03cbad34d9e79`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:35:52.601034 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f0cd25d5-1e7b-4c1e-82f1-a88db7de6228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:52.680343 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1279/2576] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:35:52 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:35:52.681620 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61a0d-a10b-4b71-846a-15ca5be9565a service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:52.692493 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61a0d-a10b-4b71-846a-15ca5be9565a service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:52.697575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5646d-a2b9-47b5-b72e-9de59b1f9268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:52.698252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5646d-a2b9-47b5-b72e-9de59b1f9268 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:52.698536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5646d-a2b9-47b5-b72e-9de59b1f9268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:52.698813 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5646d-a2b9-47b5-b72e-9de59b1f9268 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:52.699598 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5646d-a2b9-47b5-b72e-9de59b1f9268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:52.701559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5646d-a2b9-47b5-b72e-9de59b1f9268 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:52.732402 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1298/2577] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:35:52 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:35:52.733461 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd25d5-1e7b-4c1e-82f1-a88db7de6228 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:52.744971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd25d5-1e7b-4c1e-82f1-a88db7de6228 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:52.804412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92296448-793b-4bd5-a98d-caea3807615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:52.805030 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92296448-793b-4bd5-a98d-caea3807615e admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:52.805314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92296448-793b-4bd5-a98d-caea3807615e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:52.805591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92296448-793b-4bd5-a98d-caea3807615e admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:52.806329 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92296448-793b-4bd5-a98d-caea3807615e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:52.808450 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92296448-793b-4bd5-a98d-caea3807615e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:52.830214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1280/2578] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:35:52 2021] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:35:52.834467 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5646d-a2b9-47b5-b72e-9de59b1f9268 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:52.845313 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5646d-a2b9-47b5-b72e-9de59b1f9268 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:52.850739 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef2f74-a22f-47e2-8cdb-eedf6ea7d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:52.851140 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef2f74-a22f-47e2-8cdb-eedf6ea7d927 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:52.851443 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef2f74-a22f-47e2-8cdb-eedf6ea7d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:52.851719 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef2f74-a22f-47e2-8cdb-eedf6ea7d927 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:52.852466 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef2f74-a22f-47e2-8cdb-eedf6ea7d927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:52.854157 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef2f74-a22f-47e2-8cdb-eedf6ea7d927 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:52.866836 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1299/2579] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:35:52 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:35:52.871113 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92296448-793b-4bd5-a98d-caea3807615e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:52.882356 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92296448-793b-4bd5-a98d-caea3807615e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:52.887903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db65188-c4b5-4c75-9d6f-4e30e8e261d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:52.888817 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db65188-c4b5-4c75-9d6f-4e30e8e261d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:52.889101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db65188-c4b5-4c75-9d6f-4e30e8e261d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:52.889376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db65188-c4b5-4c75-9d6f-4e30e8e261d7 admin admin] PATH_INFO: `/v3/projects/b002430895784ad2b2e15396765a5a0b/users/35fe6260bdc24eb996a5f52f8a7b61d6/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:52.906203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db65188-c4b5-4c75-9d6f-4e30e8e261d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b002430895784ad2b2e15396765a5a0b, user_id=35fe6260bdc24eb996a5f52f8a7b61d6, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:52.909904 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db65188-c4b5-4c75-9d6f-4e30e8e261d7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:52.931258 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1281/2580] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:35:52 2021] PUT /identity/v3/projects/b002430895784ad2b2e15396765a5a0b/users/35fe6260bdc24eb996a5f52f8a7b61d6/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:35:52.935404 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef2f74-a22f-47e2-8cdb-eedf6ea7d927 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:52.947253 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef2f74-a22f-47e2-8cdb-eedf6ea7d927 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:53.021071 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719053-ebeb-46fc-b25d-785577578e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:53.021767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719053-ebeb-46fc-b25d-785577578e2b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:53.022055 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719053-ebeb-46fc-b25d-785577578e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:53.022332 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719053-ebeb-46fc-b25d-785577578e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:53.023088 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e719053-ebeb-46fc-b25d-785577578e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:53.024749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e719053-ebeb-46fc-b25d-785577578e2b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:53.036102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1300/2581] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:35:52 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:35:53.040364 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db65188-c4b5-4c75-9d6f-4e30e8e261d7 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:53.051974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db65188-c4b5-4c75-9d6f-4e30e8e261d7 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:53.056687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58486d-5ab0-4545-9b86-5027f81e1be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:53.057590 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58486d-5ab0-4545-9b86-5027f81e1be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:53.057873 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58486d-5ab0-4545-9b86-5027f81e1be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:53.058150 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58486d-5ab0-4545-9b86-5027f81e1be3 admin admin] PATH_INFO: `/v3/projects/b002430895784ad2b2e15396765a5a0b/users/35fe6260bdc24eb996a5f52f8a7b61d6/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:53.060185 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58486d-5ab0-4545-9b86-5027f81e1be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b002430895784ad2b2e15396765a5a0b, user_id=35fe6260bdc24eb996a5f52f8a7b61d6, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:53.062853 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58486d-5ab0-4545-9b86-5027f81e1be3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:53.075001 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1282/2582] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:35:53 2021] PUT /identity/v3/projects/b002430895784ad2b2e15396765a5a0b/users/35fe6260bdc24eb996a5f52f8a7b61d6/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:35:55.210476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719053-ebeb-46fc-b25d-785577578e2b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:55.212798 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-5e719053-ebeb-46fc-b25d-785577578e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:55.226846 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719053-ebeb-46fc-b25d-785577578e2b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:55.291463 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e5556-bf5c-420b-ab48-bcc59e9693f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:55.292607 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e5556-bf5c-420b-ab48-bcc59e9693f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:55.293090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e5556-bf5c-420b-ab48-bcc59e9693f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:55.293375 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e5556-bf5c-420b-ab48-bcc59e9693f2 admin admin] PATH_INFO: `/v3/users/f40310cd51314cc49284a5f9a5246b0b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:55.295059 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e5556-bf5c-420b-ab48-bcc59e9693f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40310cd51314cc49284a5f9a5246b0b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:55.297058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e5556-bf5c-420b-ab48-bcc59e9693f2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:55.364881 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ad3e5556-bf5c-420b-ab48-bcc59e9693f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40310cd51314cc49284a5f9a5246b0b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:55.365688 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ad3e5556-bf5c-420b-ab48-bcc59e9693f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40310cd51314cc49284a5f9a5246b0b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:55.384388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ad3e5556-bf5c-420b-ab48-bcc59e9693f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40310cd51314cc49284a5f9a5246b0b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:55.385107 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ad3e5556-bf5c-420b-ab48-bcc59e9693f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40310cd51314cc49284a5f9a5246b0b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:55.412707 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ad3e5556-bf5c-420b-ab48-bcc59e9693f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40310cd51314cc49284a5f9a5246b0b'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:55.441439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1301/2583] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:35:55 2021] DELETE /identity/v3/users/f40310cd51314cc49284a5f9a5246b0b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:35:55.446025 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4640-e489-42ec-b25d-fa0b3fc57419 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:55.446849 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4640-e489-42ec-b25d-fa0b3fc57419 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:55.447332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4640-e489-42ec-b25d-fa0b3fc57419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:55.472483 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-427c4640-e489-42ec-b25d-fa0b3fc57419 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:35:55.473946 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-427c4640-e489-42ec-b25d-fa0b3fc57419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:55.567992 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1283/2584] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:35:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:35:55.578391 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e5556-bf5c-420b-ab48-bcc59e9693f2 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:55.580357 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ad3e5556-bf5c-420b-ab48-bcc59e9693f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:55.745744 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e5556-bf5c-420b-ab48-bcc59e9693f2 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:55.750158 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96db3b6-77b0-42f9-b6cd-7e27c53648cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:55.750843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96db3b6-77b0-42f9-b6cd-7e27c53648cc service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:55.751144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96db3b6-77b0-42f9-b6cd-7e27c53648cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:55.751425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96db3b6-77b0-42f9-b6cd-7e27c53648cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:55.775567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96db3b6-77b0-42f9-b6cd-7e27c53648cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:55.777032 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96db3b6-77b0-42f9-b6cd-7e27c53648cc service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:55.797268 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1302/2585] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:35:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:35:56.339612 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c4640-e489-42ec-b25d-fa0b3fc57419 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:56.341164 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-427c4640-e489-42ec-b25d-fa0b3fc57419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:56.356287 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c4640-e489-42ec-b25d-fa0b3fc57419 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:56.380834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:56.382321 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:56.383168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:56.384344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] PATH_INFO: `/v3/projects/10de37dd02104fd2bd342847ba09203a` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:56.388893 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] RBAC: Authorizing `identity:delete_project(project_id=10de37dd02104fd2bd342847ba09203a)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:56.396890 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:56.509218 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10de37dd02104fd2bd342847ba09203a', 'request_id': 'req-c3fd0a03-f8de-4068-ab51-06190f52a1be'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:56.519796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10de37dd02104fd2bd342847ba09203a', 'request_id': 'req-c3fd0a03-f8de-4068-ab51-06190f52a1be'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:56.530310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10de37dd02104fd2bd342847ba09203a', 'request_id': 'req-c3fd0a03-f8de-4068-ab51-06190f52a1be'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:56.557549 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] The token cache is being invalidate because project 10de37dd02104fd2bd342847ba09203a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:35:56.559618 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:56.561634 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:56.567384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1284/2586] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:35:56 2021] DELETE /identity/v3/projects/10de37dd02104fd2bd342847ba09203a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:35:56.568169 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96db3b6-77b0-42f9-b6cd-7e27c53648cc service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:56.581374 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96db3b6-77b0-42f9-b6cd-7e27c53648cc service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:56.674901 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9422b-89fc-44ba-bf79-60e802ee229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:56.676194 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9422b-89fc-44ba-bf79-60e802ee229f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:56.676963 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9422b-89fc-44ba-bf79-60e802ee229f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:56.677407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9422b-89fc-44ba-bf79-60e802ee229f admin admin] PATH_INFO: `/v3/users/ad93a917e34949bdadbaa644d22677d0` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:56.679018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9422b-89fc-44ba-bf79-60e802ee229f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad93a917e34949bdadbaa644d22677d0)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:56.682517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9422b-89fc-44ba-bf79-60e802ee229f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:56.771002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6ff9422b-89fc-44ba-bf79-60e802ee229f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad93a917e34949bdadbaa644d22677d0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:56.774548 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6ff9422b-89fc-44ba-bf79-60e802ee229f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad93a917e34949bdadbaa644d22677d0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:56.789203 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6ff9422b-89fc-44ba-bf79-60e802ee229f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad93a917e34949bdadbaa644d22677d0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:56.790643 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6ff9422b-89fc-44ba-bf79-60e802ee229f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad93a917e34949bdadbaa644d22677d0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:56.809897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-6ff9422b-89fc-44ba-bf79-60e802ee229f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad93a917e34949bdadbaa644d22677d0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:56.830312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1303/2587] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:35:56 2021] DELETE /identity/v3/users/ad93a917e34949bdadbaa644d22677d0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:35:57.455059 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:57.456960 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:57.480053 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd0a03-f8de-4068-ab51-06190f52a1be admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:57.553658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:57.555041 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:57.555394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:57.555679 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9 admin admin] PATH_INFO: `/v3/projects/af9737666c9c40e391852026208565b4` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:57.557047 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9737666c9c40e391852026208565b4)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:57.559322 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:57.624600 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9737666c9c40e391852026208565b4', 'request_id': 'req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:57.632188 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9737666c9c40e391852026208565b4', 'request_id': 'req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:57.642474 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9737666c9c40e391852026208565b4', 'request_id': 'req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:57.663386 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9 admin admin] The token cache is being invalidate because project af9737666c9c40e391852026208565b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:35:57.663386 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:57.665132 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d240b97a-23b8-4afd-8993-e6b4c9f64fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:35:57.670987 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1285/2588] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:35:57 2021] DELETE /identity/v3/projects/af9737666c9c40e391852026208565b4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:35:57.672672 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e2eb9-b44e-4fcd-a69b-63f5c8e0d755 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:57.673611 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e2eb9-b44e-4fcd-a69b-63f5c8e0d755 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:57.674140 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e2eb9-b44e-4fcd-a69b-63f5c8e0d755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:57.698199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-260e2eb9-b44e-4fcd-a69b-63f5c8e0d755 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:35:57.700121 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-260e2eb9-b44e-4fcd-a69b-63f5c8e0d755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:57.793360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1304/2589] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:35:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:35:57.802143 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81d067-dc0c-41bc-8043-d4d088b267d1 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:57.802484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81d067-dc0c-41bc-8043-d4d088b267d1 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:57.802584 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81d067-dc0c-41bc-8043-d4d088b267d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:57.844974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8d81d067-dc0c-41bc-8043-d4d088b267d1 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:35:57.846225 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8d81d067-dc0c-41bc-8043-d4d088b267d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:57.857724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1286/2590] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:35:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:35:57.862199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e2eb9-b44e-4fcd-a69b-63f5c8e0d755 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:57.879753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e2eb9-b44e-4fcd-a69b-63f5c8e0d755 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:57.894976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0692eb-9295-45ac-bf06-59ad5b702a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:57.895902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0692eb-9295-45ac-bf06-59ad5b702a17 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:57.896189 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0692eb-9295-45ac-bf06-59ad5b702a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:57.896468 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0692eb-9295-45ac-bf06-59ad5b702a17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:57.897229 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0692eb-9295-45ac-bf06-59ad5b702a17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:35:57.897542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0692eb-9295-45ac-bf06-59ad5b702a17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:57.899184 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0692eb-9295-45ac-bf06-59ad5b702a17 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:57.933713 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1305/2591] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:35:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:35:57.935018 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81d067-dc0c-41bc-8043-d4d088b267d1 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:57.946632 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81d067-dc0c-41bc-8043-d4d088b267d1 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:57.952826 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab1752-f819-4320-a408-f7bd0fd70f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:57.954664 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab1752-f819-4320-a408-f7bd0fd70f3c admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:57.955220 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab1752-f819-4320-a408-f7bd0fd70f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:57.956165 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab1752-f819-4320-a408-f7bd0fd70f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:57.958127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab1752-f819-4320-a408-f7bd0fd70f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:57.960455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab1752-f819-4320-a408-f7bd0fd70f3c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:57.999213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1287/2592] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:35:57 2021] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:35:58.002025 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0692eb-9295-45ac-bf06-59ad5b702a17 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:58.013757 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0692eb-9295-45ac-bf06-59ad5b702a17 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:58.085354 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb3c69-0eb2-42e8-81c3-758b79a6bae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:58.086044 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3c69-0eb2-42e8-81c3-758b79a6bae5 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.086323 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3c69-0eb2-42e8-81c3-758b79a6bae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.086597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb3c69-0eb2-42e8-81c3-758b79a6bae5 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.087407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb3c69-0eb2-42e8-81c3-758b79a6bae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:58.089405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb3c69-0eb2-42e8-81c3-758b79a6bae5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:58.115174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1306/2593] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:35:58 2021] POST /identity/v3/users => generated 282 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:35:58.117703 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab1752-f819-4320-a408-f7bd0fd70f3c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:58.129469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab1752-f819-4320-a408-f7bd0fd70f3c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:58.134303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe58e6-87c3-4da0-972f-79c9685ba209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:58.134998 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe58e6-87c3-4da0-972f-79c9685ba209 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.135340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe58e6-87c3-4da0-972f-79c9685ba209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.135629 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe58e6-87c3-4da0-972f-79c9685ba209 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.136384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe58e6-87c3-4da0-972f-79c9685ba209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:58.138023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe58e6-87c3-4da0-972f-79c9685ba209 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:58.150188 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1288/2594] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:35:58 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:35:58.154122 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb3c69-0eb2-42e8-81c3-758b79a6bae5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:58.166347 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb3c69-0eb2-42e8-81c3-758b79a6bae5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:58.171869 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185deff-e3c0-420b-bf58-3ed6b5809583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:58.172856 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185deff-e3c0-420b-bf58-3ed6b5809583 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.173223 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185deff-e3c0-420b-bf58-3ed6b5809583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.173554 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185deff-e3c0-420b-bf58-3ed6b5809583 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.175033 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185deff-e3c0-420b-bf58-3ed6b5809583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:58.176955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185deff-e3c0-420b-bf58-3ed6b5809583 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:58.196016 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1307/2595] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:35:58 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:35:58.200085 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7aca-5381-4943-844e-c432a3805c2f None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.200373 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7aca-5381-4943-844e-c432a3805c2f None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.200920 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7aca-5381-4943-844e-c432a3805c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.212212 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185deff-e3c0-420b-bf58-3ed6b5809583 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:58.227293 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185deff-e3c0-420b-bf58-3ed6b5809583 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:58.232842 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c2da6-5517-475f-a60f-4208de0d1106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:58.233741 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c2da6-5517-475f-a60f-4208de0d1106 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.234022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c2da6-5517-475f-a60f-4208de0d1106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.234899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c2da6-5517-475f-a60f-4208de0d1106 admin admin] PATH_INFO: `/v3/projects/20b0bedaae9c4bdaac7ab4db564c8bd7/users/b709cbe1facc4d659f1cc6b1ebd4cbda/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.241672 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-9fed7aca-5381-4943-844e-c432a3805c2f None None] MFA Rules not processed for user `35fe6260bdc24eb996a5f52f8a7b61d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:35:58.243265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9fed7aca-5381-4943-844e-c432a3805c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:58.255435 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c2da6-5517-475f-a60f-4208de0d1106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b0bedaae9c4bdaac7ab4db564c8bd7, user_id=b709cbe1facc4d659f1cc6b1ebd4cbda, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:58.260561 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c2da6-5517-475f-a60f-4208de0d1106 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:58.283559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1308/2596] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:35:58 2021] PUT /identity/v3/projects/20b0bedaae9c4bdaac7ab4db564c8bd7/users/b709cbe1facc4d659f1cc6b1ebd4cbda/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:35:58.293819 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b15a1-40a9-4fb3-85b9-0c378d44fbbc None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.294456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b15a1-40a9-4fb3-85b9-0c378d44fbbc None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.294934 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b15a1-40a9-4fb3-85b9-0c378d44fbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.323957 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-441b15a1-40a9-4fb3-85b9-0c378d44fbbc None None] MFA Rules not processed for user `b709cbe1facc4d659f1cc6b1ebd4cbda`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:35:58.325431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-441b15a1-40a9-4fb3-85b9-0c378d44fbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:58.333807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1289/2597] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:35:58 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:35:58.346821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed7aca-5381-4943-844e-c432a3805c2f None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:58.348547 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9fed7aca-5381-4943-844e-c432a3805c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:58.405329 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1309/2598] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:35:58 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:35:58.407361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b15a1-40a9-4fb3-85b9-0c378d44fbbc None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:58.415221 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed7aca-5381-4943-844e-c432a3805c2f None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:58.467860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ccdf7-3192-4975-833c-15295aa85fc4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07a71b8adef243049d3b055e66566a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:58.468988 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ccdf7-3192-4975-833c-15295aa85fc4 service glance] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.469458 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ccdf7-3192-4975-833c-15295aa85fc4 service glance] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.471285 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ccdf7-3192-4975-833c-15295aa85fc4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.473592 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b15a1-40a9-4fb3-85b9-0c378d44fbbc None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:58.473778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-cd9ccdf7-3192-4975-833c-15295aa85fc4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:58.480878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a6947-7660-4f09-b2f4-36ca5fd6a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:58.482325 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6947-7660-4f09-b2f4-36ca5fd6a110 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.482681 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6947-7660-4f09-b2f4-36ca5fd6a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.483009 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6947-7660-4f09-b2f4-36ca5fd6a110 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.483820 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a6947-7660-4f09-b2f4-36ca5fd6a110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:58.485974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a6947-7660-4f09-b2f4-36ca5fd6a110 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:58.513908 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1310/2599] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:35:58 2021] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:35:58.519483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a6947-7660-4f09-b2f4-36ca5fd6a110 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:58.538635 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ccdf7-3192-4975-833c-15295aa85fc4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:58.540684 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ccdf7-3192-4975-833c-15295aa85fc4 service glance] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:58.550235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1290/2600] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:35:58 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:35:58.601817 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a6947-7660-4f09-b2f4-36ca5fd6a110 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:58.610279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea74df-0e5d-45f6-97fc-f08aa62d0e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:58.611618 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea74df-0e5d-45f6-97fc-f08aa62d0e03 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.612073 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea74df-0e5d-45f6-97fc-f08aa62d0e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.612614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea74df-0e5d-45f6-97fc-f08aa62d0e03 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.613670 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea74df-0e5d-45f6-97fc-f08aa62d0e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:58.616117 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea74df-0e5d-45f6-97fc-f08aa62d0e03 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:58.646557 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1311/2601] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:35:58 2021] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:35:58.649548 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ccdf7-3192-4975-833c-15295aa85fc4 service glance] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:58.662407 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ccdf7-3192-4975-833c-15295aa85fc4 service glance] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:58.670240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d794a-6728-4ec8-97bc-4328ffbd9107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:58.672248 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d794a-6728-4ec8-97bc-4328ffbd9107 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.672532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d794a-6728-4ec8-97bc-4328ffbd9107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.672860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d794a-6728-4ec8-97bc-4328ffbd9107 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.673727 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d794a-6728-4ec8-97bc-4328ffbd9107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:58.675538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d794a-6728-4ec8-97bc-4328ffbd9107 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:58.691383 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1291/2602] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:35:58 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:35:58.692691 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea74df-0e5d-45f6-97fc-f08aa62d0e03 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:58.702358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182fc3a-892b-4591-b449-8db4e2070905 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.702651 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182fc3a-892b-4591-b449-8db4e2070905 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.702935 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182fc3a-892b-4591-b449-8db4e2070905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.704145 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea74df-0e5d-45f6-97fc-f08aa62d0e03 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:58.710944 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c59189-4e53-4442-9916-b9220a644dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:58.711948 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c59189-4e53-4442-9916-b9220a644dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.712238 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c59189-4e53-4442-9916-b9220a644dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.712511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c59189-4e53-4442-9916-b9220a644dbf admin admin] PATH_INFO: `/v3/projects/29b9e4178450446c9b9873fe7d5b8341/users/c267e5a1b12d4824ba160d8113d4349d/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.731890 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c59189-4e53-4442-9916-b9220a644dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b9e4178450446c9b9873fe7d5b8341, user_id=c267e5a1b12d4824ba160d8113d4349d, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:58.735176 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c59189-4e53-4442-9916-b9220a644dbf admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:58.758581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1312/2603] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:35:58 2021] PUT /identity/v3/projects/29b9e4178450446c9b9873fe7d5b8341/users/c267e5a1b12d4824ba160d8113d4349d/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:35:58.762470 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c59189-4e53-4442-9916-b9220a644dbf admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:58.795678 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-c182fc3a-892b-4591-b449-8db4e2070905 None None] MFA Rules not processed for user `f9fc539f38364a648b9a4c25d3dbea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:35:58.797651 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c182fc3a-892b-4591-b449-8db4e2070905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:58.855365 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c59189-4e53-4442-9916-b9220a644dbf admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:58.860411 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318e33d-068b-44c5-99e2-599de39e7fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:58.861284 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318e33d-068b-44c5-99e2-599de39e7fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.861571 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318e33d-068b-44c5-99e2-599de39e7fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.861935 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318e33d-068b-44c5-99e2-599de39e7fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.863267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318e33d-068b-44c5-99e2-599de39e7fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:58.864889 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318e33d-068b-44c5-99e2-599de39e7fa7 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:58.871778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1292/2604] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Nov 8 11:35:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:35:58.879198 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1313/2605] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:35:58 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:35:58.880499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182fc3a-892b-4591-b449-8db4e2070905 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:58.895074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182fc3a-892b-4591-b449-8db4e2070905 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:58.900231 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a3279-13be-46c4-8ccc-4d38c1ea30ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:58.901094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a3279-13be-46c4-8ccc-4d38c1ea30ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.901378 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a3279-13be-46c4-8ccc-4d38c1ea30ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.901656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a3279-13be-46c4-8ccc-4d38c1ea30ab admin admin] PATH_INFO: `/v3/projects/29b9e4178450446c9b9873fe7d5b8341/users/c267e5a1b12d4824ba160d8113d4349d/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.903813 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a3279-13be-46c4-8ccc-4d38c1ea30ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b9e4178450446c9b9873fe7d5b8341, user_id=c267e5a1b12d4824ba160d8113d4349d, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:58.907514 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a3279-13be-46c4-8ccc-4d38c1ea30ab admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:58.921171 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1293/2606] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:35:58 2021] PUT /identity/v3/projects/29b9e4178450446c9b9873fe7d5b8341/users/c267e5a1b12d4824ba160d8113d4349d/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:35:58.927927 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318e33d-068b-44c5-99e2-599de39e7fa7 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:58.929928 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6318e33d-068b-44c5-99e2-599de39e7fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:58.931945 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b378d2a-63af-47c5-95bf-3887493b2e34 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:58.932449 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b378d2a-63af-47c5-95bf-3887493b2e34 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:58.932962 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b378d2a-63af-47c5-95bf-3887493b2e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:58.967018 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-6b378d2a-63af-47c5-95bf-3887493b2e34 None None] MFA Rules not processed for user `c267e5a1b12d4824ba160d8113d4349d`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:35:58.969179 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6b378d2a-63af-47c5-95bf-3887493b2e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:59.046750 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318e33d-068b-44c5-99e2-599de39e7fa7 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:59.047978 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1294/2607] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:35:58 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:35:59.058742 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b378d2a-63af-47c5-95bf-3887493b2e34 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:59.060333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6b378d2a-63af-47c5-95bf-3887493b2e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:35:59.122010 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05cb24-cdcb-4c99-9b98-d2e90c132a87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '029506cc966a44c9bbe83eb084ac6feb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:59.122846 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05cb24-cdcb-4c99-9b98-d2e90c132a87 service swift] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:59.123155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05cb24-cdcb-4c99-9b98-d2e90c132a87 service swift] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:59.123679 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05cb24-cdcb-4c99-9b98-d2e90c132a87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:59.124715 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b378d2a-63af-47c5-95bf-3887493b2e34 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:59.129116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b97202-a047-405b-8d59-8b17d888ea23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:59.129774 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b97202-a047-405b-8d59-8b17d888ea23 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:59.130075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b97202-a047-405b-8d59-8b17d888ea23 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:59.130352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b97202-a047-405b-8d59-8b17d888ea23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:59.140289 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b97202-a047-405b-8d59-8b17d888ea23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:59.141755 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b97202-a047-405b-8d59-8b17d888ea23 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:59.152409 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1295/2608] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:35:59 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:35:59.187204 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05cb24-cdcb-4c99-9b98-d2e90c132a87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:59.188893 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05cb24-cdcb-4c99-9b98-d2e90c132a87 service swift] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:59.198757 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1314/2609] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Nov 8 11:35:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 11:35:59.274602 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b97202-a047-405b-8d59-8b17d888ea23 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:35:59.284441 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b97202-a047-405b-8d59-8b17d888ea23 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:35:59.288918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8ff79-4e9f-49b3-9377-e0b863971b32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:35:59.289990 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8ff79-4e9f-49b3-9377-e0b863971b32 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:35:59.290290 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8ff79-4e9f-49b3-9377-e0b863971b32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:35:59.290571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8ff79-4e9f-49b3-9377-e0b863971b32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:35:59.368848 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8ff79-4e9f-49b3-9377-e0b863971b32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:35:59.370325 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8ff79-4e9f-49b3-9377-e0b863971b32 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:35:59.380986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1296/2610] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:35:59 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:08.523480 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3897f-9efd-43cd-b7bc-c6482ac58497 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:08.524040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3897f-9efd-43cd-b7bc-c6482ac58497 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:08.524040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3897f-9efd-43cd-b7bc-c6482ac58497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:08.543022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-c3f3897f-9efd-43cd-b7bc-c6482ac58497 None None] MFA Rules not processed for user `53a58fd5d15c43a188c03cbad34d9e79`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:08.544236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c3f3897f-9efd-43cd-b7bc-c6482ac58497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:08.607999 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1315/2611] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:08 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:08.907003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8ff79-4e9f-49b3-9377-e0b863971b32 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:08.908475 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-84a8ff79-4e9f-49b3-9377-e0b863971b32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:08.965805 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8ff79-4e9f-49b3-9377-e0b863971b32 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:08.969656 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870774f-709e-4dad-8c5d-62f89f978ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:08.970310 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870774f-709e-4dad-8c5d-62f89f978ddf service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:08.970708 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870774f-709e-4dad-8c5d-62f89f978ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:08.970989 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870774f-709e-4dad-8c5d-62f89f978ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:08.973001 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-c870774f-709e-4dad-8c5d-62f89f978ddf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:08.982683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870774f-709e-4dad-8c5d-62f89f978ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:08.984414 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870774f-709e-4dad-8c5d-62f89f978ddf service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:08.993263 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1297/2612] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:08 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:09.561102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3897f-9efd-43cd-b7bc-c6482ac58497 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:09.562608 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c3f3897f-9efd-43cd-b7bc-c6482ac58497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:09.636582 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3897f-9efd-43cd-b7bc-c6482ac58497 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:09.642155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1620f-608e-4c82-af0c-8e76efadd29a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '642c2b97ece34d69bacd821b108bd210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:09.642803 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1620f-608e-4c82-af0c-8e76efadd29a service placement] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:09.643089 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1620f-608e-4c82-af0c-8e76efadd29a service placement] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:09.643403 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1620f-608e-4c82-af0c-8e76efadd29a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:09.645500 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-22f1620f-608e-4c82-af0c-8e76efadd29a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:09.656769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1620f-608e-4c82-af0c-8e76efadd29a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:09.658338 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1620f-608e-4c82-af0c-8e76efadd29a service placement] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:09.672866 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1316/2613] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:09 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:10.238427 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870774f-709e-4dad-8c5d-62f89f978ddf service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:10.313077 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870774f-709e-4dad-8c5d-62f89f978ddf service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:10.318759 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fe819-5e57-4281-8d34-7f9717563528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:10.319688 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fe819-5e57-4281-8d34-7f9717563528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:10.319969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fe819-5e57-4281-8d34-7f9717563528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:10.320238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fe819-5e57-4281-8d34-7f9717563528 admin admin] PATH_INFO: `/v3/users/b709cbe1facc4d659f1cc6b1ebd4cbda` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:10.321571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fe819-5e57-4281-8d34-7f9717563528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b709cbe1facc4d659f1cc6b1ebd4cbda)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:10.323614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fe819-5e57-4281-8d34-7f9717563528 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:10.374207 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-981fe819-5e57-4281-8d34-7f9717563528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b709cbe1facc4d659f1cc6b1ebd4cbda'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:10.374926 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-981fe819-5e57-4281-8d34-7f9717563528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b709cbe1facc4d659f1cc6b1ebd4cbda'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:10.384787 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-981fe819-5e57-4281-8d34-7f9717563528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b709cbe1facc4d659f1cc6b1ebd4cbda'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:10.385501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-981fe819-5e57-4281-8d34-7f9717563528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b709cbe1facc4d659f1cc6b1ebd4cbda'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:10.392302 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-981fe819-5e57-4281-8d34-7f9717563528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b709cbe1facc4d659f1cc6b1ebd4cbda'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:10.410123 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1298/2614] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:36:10 2021] DELETE /identity/v3/users/b709cbe1facc4d659f1cc6b1ebd4cbda => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:10.415021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5230c64-e018-46a2-9312-e8ab8a9614cd None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:10.415341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5230c64-e018-46a2-9312-e8ab8a9614cd None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:10.415613 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5230c64-e018-46a2-9312-e8ab8a9614cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:10.434344 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-e5230c64-e018-46a2-9312-e8ab8a9614cd None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:10.435628 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e5230c64-e018-46a2-9312-e8ab8a9614cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:10.497261 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1317/2615] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:10.507816 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fe819-5e57-4281-8d34-7f9717563528 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:10.509393 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-981fe819-5e57-4281-8d34-7f9717563528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:10.570604 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fe819-5e57-4281-8d34-7f9717563528 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:10.575247 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2c682-aa49-4bfc-8031-e36a8084e846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:10.575960 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2c682-aa49-4bfc-8031-e36a8084e846 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:10.576241 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2c682-aa49-4bfc-8031-e36a8084e846 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:10.576525 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2c682-aa49-4bfc-8031-e36a8084e846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:10.586916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2c682-aa49-4bfc-8031-e36a8084e846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:10.588403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2c682-aa49-4bfc-8031-e36a8084e846 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:10.600049 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1299/2616] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:10.923001 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906c822-b8e1-49c9-adf7-a71011b1b631 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:10.923891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906c822-b8e1-49c9-adf7-a71011b1b631 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:10.924305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906c822-b8e1-49c9-adf7-a71011b1b631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:10.958103 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-f906c822-b8e1-49c9-adf7-a71011b1b631 None None] MFA Rules not processed for user `f9fc539f38364a648b9a4c25d3dbea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:10.959998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f906c822-b8e1-49c9-adf7-a71011b1b631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:11.026615 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1318/2617] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Nov 8 11:36:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:11.040715 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2c682-aa49-4bfc-8031-e36a8084e846 service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:11.042316 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-98a2c682-aa49-4bfc-8031-e36a8084e846 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:11.078905 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906c822-b8e1-49c9-adf7-a71011b1b631 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:11.080743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f906c822-b8e1-49c9-adf7-a71011b1b631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:11.108081 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906c822-b8e1-49c9-adf7-a71011b1b631 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:11.114425 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:11.116860 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:11.117143 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:11.117917 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] PATH_INFO: `/v3/projects/20b0bedaae9c4bdaac7ab4db564c8bd7` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:11.120017 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b0bedaae9c4bdaac7ab4db564c8bd7)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:11.122138 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:11.127454 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2c682-aa49-4bfc-8031-e36a8084e846 service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:11.137587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054f031-17a3-45f9-941a-83ab6ebda018 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '029506cc966a44c9bbe83eb084ac6feb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:11.138275 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054f031-17a3-45f9-941a-83ab6ebda018 service swift] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:11.138553 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054f031-17a3-45f9-941a-83ab6ebda018 service swift] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:11.139432 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054f031-17a3-45f9-941a-83ab6ebda018 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:11.149341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054f031-17a3-45f9-941a-83ab6ebda018 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:11.151038 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054f031-17a3-45f9-941a-83ab6ebda018 service swift] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:11.160552 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1300/2618] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Nov 8 11:36:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 11:36:11.198833 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b0bedaae9c4bdaac7ab4db564c8bd7', 'request_id': 'req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:11.206653 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b0bedaae9c4bdaac7ab4db564c8bd7', 'request_id': 'req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:11.212581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b0bedaae9c4bdaac7ab4db564c8bd7', 'request_id': 'req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:11.231028 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] The token cache is being invalidate because project 20b0bedaae9c4bdaac7ab4db564c8bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:36:11.231885 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:11.232949 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:11.235980 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1319/2619] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:36:11 2021] DELETE /identity/v3/projects/20b0bedaae9c4bdaac7ab4db564c8bd7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:36:11.240108 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054f031-17a3-45f9-941a-83ab6ebda018 service swift] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:11.258425 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054f031-17a3-45f9-941a-83ab6ebda018 service swift] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:11.388116 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375497f-d463-48e2-a55b-7398f7b0d6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:11.389476 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375497f-d463-48e2-a55b-7398f7b0d6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:11.389815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375497f-d463-48e2-a55b-7398f7b0d6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:11.390275 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375497f-d463-48e2-a55b-7398f7b0d6ef admin admin] PATH_INFO: `/v3/users/c267e5a1b12d4824ba160d8113d4349d` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:11.394855 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375497f-d463-48e2-a55b-7398f7b0d6ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=c267e5a1b12d4824ba160d8113d4349d)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:11.401734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375497f-d463-48e2-a55b-7398f7b0d6ef admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:11.506714 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-8375497f-d463-48e2-a55b-7398f7b0d6ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c267e5a1b12d4824ba160d8113d4349d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:11.508324 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-8375497f-d463-48e2-a55b-7398f7b0d6ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c267e5a1b12d4824ba160d8113d4349d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:11.530595 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-8375497f-d463-48e2-a55b-7398f7b0d6ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c267e5a1b12d4824ba160d8113d4349d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:11.536802 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-8375497f-d463-48e2-a55b-7398f7b0d6ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c267e5a1b12d4824ba160d8113d4349d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:11.552190 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-8375497f-d463-48e2-a55b-7398f7b0d6ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c267e5a1b12d4824ba160d8113d4349d'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:11.602705 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1301/2620] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:36:11 2021] DELETE /identity/v3/users/c267e5a1b12d4824ba160d8113d4349d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:36:12.021433 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:12.023182 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:12.041500 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a0166-fbd3-4ce8-ae4a-44bdb7f9f373 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:12.132638 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:12.133516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:12.133798 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:12.134068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110 admin admin] PATH_INFO: `/v3/projects/29b9e4178450446c9b9873fe7d5b8341` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:12.135361 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b9e4178450446c9b9873fe7d5b8341)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:12.137279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:12.192840 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b9e4178450446c9b9873fe7d5b8341', 'request_id': 'req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:12.200370 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b9e4178450446c9b9873fe7d5b8341', 'request_id': 'req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:12.207593 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b9e4178450446c9b9873fe7d5b8341', 'request_id': 'req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:12.228411 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110 admin admin] The token cache is being invalidate because project 29b9e4178450446c9b9873fe7d5b8341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:36:12.228941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:12.230084 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-4ec5519f-dfaa-4bc2-b06c-fa27d6404110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:12.232566 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1320/2621] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:36:12 2021] DELETE /identity/v3/projects/29b9e4178450446c9b9873fe7d5b8341 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:12.239887 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683f9fe-d9f0-4f44-8c67-094455319fcb None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:12.240180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683f9fe-d9f0-4f44-8c67-094455319fcb None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:12.240733 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683f9fe-d9f0-4f44-8c67-094455319fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:12.266065 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-b683f9fe-d9f0-4f44-8c67-094455319fcb None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:12.267926 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b683f9fe-d9f0-4f44-8c67-094455319fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:12.332350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1302/2622] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:12.340995 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32286e4c-8ef4-4519-9583-39421d2f009e None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:12.341230 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32286e4c-8ef4-4519-9583-39421d2f009e None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:12.341552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32286e4c-8ef4-4519-9583-39421d2f009e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:12.362011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-32286e4c-8ef4-4519-9583-39421d2f009e None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:12.363666 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-32286e4c-8ef4-4519-9583-39421d2f009e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:12.372222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1321/2623] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:12.376509 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683f9fe-d9f0-4f44-8c67-094455319fcb None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:12.387467 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683f9fe-d9f0-4f44-8c67-094455319fcb None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:12.392578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383af05b-0113-4bab-94bd-314eff9f1e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:12.393230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383af05b-0113-4bab-94bd-314eff9f1e63 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:12.393678 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383af05b-0113-4bab-94bd-314eff9f1e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:12.393981 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383af05b-0113-4bab-94bd-314eff9f1e63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:12.394721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383af05b-0113-4bab-94bd-314eff9f1e63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:36:12.395061 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383af05b-0113-4bab-94bd-314eff9f1e63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:12.396722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383af05b-0113-4bab-94bd-314eff9f1e63 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:12.409448 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1303/2624] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:36:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:36:12.414115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32286e4c-8ef4-4519-9583-39421d2f009e None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:12.424946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32286e4c-8ef4-4519-9583-39421d2f009e None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:12.430672 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27504e2-19b8-446f-8850-c1328b167a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:12.431578 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27504e2-19b8-446f-8850-c1328b167a9a admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:12.431869 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27504e2-19b8-446f-8850-c1328b167a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:12.432145 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27504e2-19b8-446f-8850-c1328b167a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:12.432882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27504e2-19b8-446f-8850-c1328b167a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:12.434864 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27504e2-19b8-446f-8850-c1328b167a9a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:12.469329 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1322/2625] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:36:12 2021] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:12.474169 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383af05b-0113-4bab-94bd-314eff9f1e63 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:12.488718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383af05b-0113-4bab-94bd-314eff9f1e63 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:12.558184 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57d1a3-6384-44f2-a13c-4c278586a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:12.558851 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57d1a3-6384-44f2-a13c-4c278586a09f admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:12.559147 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57d1a3-6384-44f2-a13c-4c278586a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:12.559459 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57d1a3-6384-44f2-a13c-4c278586a09f admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:12.560166 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57d1a3-6384-44f2-a13c-4c278586a09f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:12.562078 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57d1a3-6384-44f2-a13c-4c278586a09f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:12.586159 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1304/2626] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:36:12 2021] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:12.590702 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27504e2-19b8-446f-8850-c1328b167a9a admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:12.604508 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27504e2-19b8-446f-8850-c1328b167a9a admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:12.610884 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dca06-81f5-4694-8251-d9ffe8ff3898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:12.611718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dca06-81f5-4694-8251-d9ffe8ff3898 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:12.612070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dca06-81f5-4694-8251-d9ffe8ff3898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:12.612606 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dca06-81f5-4694-8251-d9ffe8ff3898 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:12.613439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dca06-81f5-4694-8251-d9ffe8ff3898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:12.615146 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dca06-81f5-4694-8251-d9ffe8ff3898 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:12.627305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1323/2627] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:12 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:12.632366 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57d1a3-6384-44f2-a13c-4c278586a09f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:12.642178 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57d1a3-6384-44f2-a13c-4c278586a09f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:12.646807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828e45c-acda-4787-bb00-412b9e711c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:12.647578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828e45c-acda-4787-bb00-412b9e711c7d admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:12.647857 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828e45c-acda-4787-bb00-412b9e711c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:12.648127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828e45c-acda-4787-bb00-412b9e711c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:12.648872 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828e45c-acda-4787-bb00-412b9e711c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:12.650474 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828e45c-acda-4787-bb00-412b9e711c7d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:12.664449 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1305/2628] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:12.665668 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dca06-81f5-4694-8251-d9ffe8ff3898 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:12.677563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dca06-81f5-4694-8251-d9ffe8ff3898 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:12.682563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d536475-0313-4af2-97d4-10bd309eb608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:12.683622 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d536475-0313-4af2-97d4-10bd309eb608 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:12.683899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d536475-0313-4af2-97d4-10bd309eb608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:12.684166 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d536475-0313-4af2-97d4-10bd309eb608 admin admin] PATH_INFO: `/v3/projects/fb5a3f72b30f442c97dec47d7bd9a825/users/4627da72d1da40c6b9d6f54e8d293738/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:12.700753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d536475-0313-4af2-97d4-10bd309eb608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5a3f72b30f442c97dec47d7bd9a825, user_id=4627da72d1da40c6b9d6f54e8d293738, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:12.703539 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d536475-0313-4af2-97d4-10bd309eb608 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:12.717601 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1324/2629] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:12 2021] PUT /identity/v3/projects/fb5a3f72b30f442c97dec47d7bd9a825/users/4627da72d1da40c6b9d6f54e8d293738/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:36:12.728783 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd1506-3835-4b61-8046-c24dffed522e None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:12.729069 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd1506-3835-4b61-8046-c24dffed522e None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:12.729365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd1506-3835-4b61-8046-c24dffed522e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:12.757830 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-a6dd1506-3835-4b61-8046-c24dffed522e None None] MFA Rules not processed for user `4627da72d1da40c6b9d6f54e8d293738`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:12.759265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-a6dd1506-3835-4b61-8046-c24dffed522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:12.825240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1306/2630] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:12 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:12.829865 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d536475-0313-4af2-97d4-10bd309eb608 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:12.901005 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d536475-0313-4af2-97d4-10bd309eb608 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:12.905989 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91968bf7-3fb3-4287-8199-d356b7dd59cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:12.906730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91968bf7-3fb3-4287-8199-d356b7dd59cf admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:12.907022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91968bf7-3fb3-4287-8199-d356b7dd59cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:12.907353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91968bf7-3fb3-4287-8199-d356b7dd59cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:12.908060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91968bf7-3fb3-4287-8199-d356b7dd59cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:12.910226 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91968bf7-3fb3-4287-8199-d356b7dd59cf admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:12.959513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1325/2631] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:36:12 2021] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:12.964545 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd1506-3835-4b61-8046-c24dffed522e None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:12.977344 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd1506-3835-4b61-8046-c24dffed522e None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:13.038320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52306b-23f8-4793-ba7b-a38ded23ffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:13.039017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52306b-23f8-4793-ba7b-a38ded23ffdc admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:13.039468 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52306b-23f8-4793-ba7b-a38ded23ffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:13.039748 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52306b-23f8-4793-ba7b-a38ded23ffdc admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:13.040468 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52306b-23f8-4793-ba7b-a38ded23ffdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:13.042471 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52306b-23f8-4793-ba7b-a38ded23ffdc admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:13.064093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1307/2632] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:36:12 2021] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:13.069052 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91968bf7-3fb3-4287-8199-d356b7dd59cf admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:13.079774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91968bf7-3fb3-4287-8199-d356b7dd59cf admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:13.084633 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fe34e-defe-4c27-89c6-02bec5bebf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:13.085328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe34e-defe-4c27-89c6-02bec5bebf1f admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:13.085612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe34e-defe-4c27-89c6-02bec5bebf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:13.085893 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe34e-defe-4c27-89c6-02bec5bebf1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:13.086620 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fe34e-defe-4c27-89c6-02bec5bebf1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:13.088535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fe34e-defe-4c27-89c6-02bec5bebf1f admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:13.105328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1326/2633] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:13 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:36:13.107427 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52306b-23f8-4793-ba7b-a38ded23ffdc admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:13.123728 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52306b-23f8-4793-ba7b-a38ded23ffdc admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:13.140641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde1fa5-768f-4d39-8140-3fff5f174a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:13.141717 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde1fa5-768f-4d39-8140-3fff5f174a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:13.142280 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde1fa5-768f-4d39-8140-3fff5f174a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:13.142770 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde1fa5-768f-4d39-8140-3fff5f174a52 admin admin] PATH_INFO: `/v3/projects/8b9827f902c6454186af59c222a7d9d6/users/65e556f5f04b41d1a0dd298577e58aeb/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:13.158554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde1fa5-768f-4d39-8140-3fff5f174a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b9827f902c6454186af59c222a7d9d6, user_id=65e556f5f04b41d1a0dd298577e58aeb, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:13.164856 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde1fa5-768f-4d39-8140-3fff5f174a52 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:13.179349 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1308/2634] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:13 2021] PUT /identity/v3/projects/8b9827f902c6454186af59c222a7d9d6/users/65e556f5f04b41d1a0dd298577e58aeb/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:13.183574 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fe34e-defe-4c27-89c6-02bec5bebf1f admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:13.193843 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fe34e-defe-4c27-89c6-02bec5bebf1f admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:13.256729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0252f-a0bb-4a2f-a9ce-ded3a5c7de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:13.257595 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0252f-a0bb-4a2f-a9ce-ded3a5c7de81 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:13.257944 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0252f-a0bb-4a2f-a9ce-ded3a5c7de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:13.258290 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0252f-a0bb-4a2f-a9ce-ded3a5c7de81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:13.259367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0252f-a0bb-4a2f-a9ce-ded3a5c7de81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:13.261902 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0252f-a0bb-4a2f-a9ce-ded3a5c7de81 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:13.276879 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1327/2635] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:13 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:13.281007 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde1fa5-768f-4d39-8140-3fff5f174a52 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:13.291598 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde1fa5-768f-4d39-8140-3fff5f174a52 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:13.296253 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12672af-ed28-4771-854a-6efdb4534653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:13.297173 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12672af-ed28-4771-854a-6efdb4534653 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:13.297452 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12672af-ed28-4771-854a-6efdb4534653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:13.297722 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12672af-ed28-4771-854a-6efdb4534653 admin admin] PATH_INFO: `/v3/projects/8b9827f902c6454186af59c222a7d9d6/users/65e556f5f04b41d1a0dd298577e58aeb/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:13.300105 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12672af-ed28-4771-854a-6efdb4534653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b9827f902c6454186af59c222a7d9d6, user_id=65e556f5f04b41d1a0dd298577e58aeb, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:13.302771 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12672af-ed28-4771-854a-6efdb4534653 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:13.316913 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1309/2636] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:13 2021] PUT /identity/v3/projects/8b9827f902c6454186af59c222a7d9d6/users/65e556f5f04b41d1a0dd298577e58aeb/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:36:13.372718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff919-11f0-4630-be1d-bfc6a0816850 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:13.373004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff919-11f0-4630-be1d-bfc6a0816850 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:13.373279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff919-11f0-4630-be1d-bfc6a0816850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:13.406857 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-6b0ff919-11f0-4630-be1d-bfc6a0816850 None None] MFA Rules not processed for user `65e556f5f04b41d1a0dd298577e58aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:13.408139 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-6b0ff919-11f0-4630-be1d-bfc6a0816850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:13.481452 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1328/2637] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:13 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:13.493115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12672af-ed28-4771-854a-6efdb4534653 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:13.496825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-b12672af-ed28-4771-854a-6efdb4534653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:13.557087 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12672af-ed28-4771-854a-6efdb4534653 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:13.560793 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18c100-018a-4c79-a360-1117dc1afa7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:13.561440 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c100-018a-4c79-a360-1117dc1afa7d service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:13.561724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c100-018a-4c79-a360-1117dc1afa7d service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:13.562002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c100-018a-4c79-a360-1117dc1afa7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:13.574933 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18c100-018a-4c79-a360-1117dc1afa7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:13.574933 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18c100-018a-4c79-a360-1117dc1afa7d service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:13.586249 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1310/2638] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:13 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:15.010624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ff919-11f0-4630-be1d-bfc6a0816850 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:15.077331 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ff919-11f0-4630-be1d-bfc6a0816850 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:15.082546 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd1887-d6d8-484a-9b92-8a3fea14e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:15.083438 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd1887-d6d8-484a-9b92-8a3fea14e97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:15.083721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd1887-d6d8-484a-9b92-8a3fea14e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:15.083998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd1887-d6d8-484a-9b92-8a3fea14e97e admin admin] PATH_INFO: `/v3/users/4627da72d1da40c6b9d6f54e8d293738` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:15.085206 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd1887-d6d8-484a-9b92-8a3fea14e97e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4627da72d1da40c6b9d6f54e8d293738)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:15.087236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd1887-d6d8-484a-9b92-8a3fea14e97e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:15.148859 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-72bd1887-d6d8-484a-9b92-8a3fea14e97e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4627da72d1da40c6b9d6f54e8d293738'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.149530 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-72bd1887-d6d8-484a-9b92-8a3fea14e97e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4627da72d1da40c6b9d6f54e8d293738'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.157720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-72bd1887-d6d8-484a-9b92-8a3fea14e97e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4627da72d1da40c6b9d6f54e8d293738'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.158338 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-72bd1887-d6d8-484a-9b92-8a3fea14e97e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4627da72d1da40c6b9d6f54e8d293738'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.170095 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-72bd1887-d6d8-484a-9b92-8a3fea14e97e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4627da72d1da40c6b9d6f54e8d293738'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.181914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1329/2639] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:36:15 2021] DELETE /identity/v3/users/4627da72d1da40c6b9d6f54e8d293738 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:36:15.186633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17908-f138-420a-b8a3-349067521716 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:15.187160 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17908-f138-420a-b8a3-349067521716 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:15.187269 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17908-f138-420a-b8a3-349067521716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:15.206843 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-d9b17908-f138-420a-b8a3-349067521716 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:15.208133 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d9b17908-f138-420a-b8a3-349067521716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:15.270674 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1311/2640] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:15.280955 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd1887-d6d8-484a-9b92-8a3fea14e97e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:15.282432 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-72bd1887-d6d8-484a-9b92-8a3fea14e97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:15.350419 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd1887-d6d8-484a-9b92-8a3fea14e97e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:15.356538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68781d6d-9233-439d-9ac7-0cec05fe1ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:15.357479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68781d6d-9233-439d-9ac7-0cec05fe1ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:15.357879 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68781d6d-9233-439d-9ac7-0cec05fe1ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:15.358288 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68781d6d-9233-439d-9ac7-0cec05fe1ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:15.369335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68781d6d-9233-439d-9ac7-0cec05fe1ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:15.370761 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68781d6d-9233-439d-9ac7-0cec05fe1ca7 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:15.380809 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1330/2641] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:15.681115 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b17908-f138-420a-b8a3-349067521716 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:15.692462 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d9b17908-f138-420a-b8a3-349067521716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:15.705335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b17908-f138-420a-b8a3-349067521716 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:15.711025 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:15.711942 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:15.712225 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:15.712501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] PATH_INFO: `/v3/projects/fb5a3f72b30f442c97dec47d7bd9a825` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:15.713759 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5a3f72b30f442c97dec47d7bd9a825)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:15.715751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:15.765095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5a3f72b30f442c97dec47d7bd9a825', 'request_id': 'req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.772847 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5a3f72b30f442c97dec47d7bd9a825', 'request_id': 'req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.778739 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5a3f72b30f442c97dec47d7bd9a825', 'request_id': 'req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.794603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] The token cache is being invalidate because project fb5a3f72b30f442c97dec47d7bd9a825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:36:15.795779 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.796559 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.798607 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1312/2642] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:36:15 2021] DELETE /identity/v3/projects/fb5a3f72b30f442c97dec47d7bd9a825 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:15.802917 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68781d6d-9233-439d-9ac7-0cec05fe1ca7 service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:15.813037 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68781d6d-9233-439d-9ac7-0cec05fe1ca7 service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:15.868199 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69305aa4-4cf7-4eb5-a09f-ec827ba748ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:15.869154 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69305aa4-4cf7-4eb5-a09f-ec827ba748ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:15.869453 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69305aa4-4cf7-4eb5-a09f-ec827ba748ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:15.869731 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69305aa4-4cf7-4eb5-a09f-ec827ba748ff admin admin] PATH_INFO: `/v3/users/65e556f5f04b41d1a0dd298577e58aeb` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:15.870990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69305aa4-4cf7-4eb5-a09f-ec827ba748ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e556f5f04b41d1a0dd298577e58aeb)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:15.872969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69305aa4-4cf7-4eb5-a09f-ec827ba748ff admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:15.922093 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-69305aa4-4cf7-4eb5-a09f-ec827ba748ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e556f5f04b41d1a0dd298577e58aeb'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.922733 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-69305aa4-4cf7-4eb5-a09f-ec827ba748ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e556f5f04b41d1a0dd298577e58aeb'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.929625 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-69305aa4-4cf7-4eb5-a09f-ec827ba748ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e556f5f04b41d1a0dd298577e58aeb'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.930327 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-69305aa4-4cf7-4eb5-a09f-ec827ba748ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e556f5f04b41d1a0dd298577e58aeb'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.942787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-69305aa4-4cf7-4eb5-a09f-ec827ba748ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e556f5f04b41d1a0dd298577e58aeb'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:15.966110 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1331/2643] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:36:15 2021] DELETE /identity/v3/users/65e556f5f04b41d1a0dd298577e58aeb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:16.337094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:16.338659 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:16.352539 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01248c5d-8240-4e4b-8eb4-896c3afdf0c0 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:16.434400 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:16.435455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:16.435746 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:16.436051 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5 admin admin] PATH_INFO: `/v3/projects/8b9827f902c6454186af59c222a7d9d6` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:16.437303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b9827f902c6454186af59c222a7d9d6)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:16.439780 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:16.492826 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b9827f902c6454186af59c222a7d9d6', 'request_id': 'req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:16.500668 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b9827f902c6454186af59c222a7d9d6', 'request_id': 'req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:16.507242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b9827f902c6454186af59c222a7d9d6', 'request_id': 'req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:16.526504 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5 admin admin] The token cache is being invalidate because project 8b9827f902c6454186af59c222a7d9d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:36:16.527397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:16.528154 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-49aea8e6-2abf-47ce-8eef-5c29a08c08c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:16.530221 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1313/2644] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:36:16 2021] DELETE /identity/v3/projects/8b9827f902c6454186af59c222a7d9d6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:16.536777 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99fcd4-5c3f-4f6e-bcb3-c9c7969e9c67 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:16.537360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99fcd4-5c3f-4f6e-bcb3-c9c7969e9c67 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:16.537360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99fcd4-5c3f-4f6e-bcb3-c9c7969e9c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:16.555918 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-dd99fcd4-5c3f-4f6e-bcb3-c9c7969e9c67 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:16.557140 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-dd99fcd4-5c3f-4f6e-bcb3-c9c7969e9c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:16.619599 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1332/2645] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:16.628060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccae88-8b08-483d-96f3-89afb195faf7 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:16.628869 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccae88-8b08-483d-96f3-89afb195faf7 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:16.629309 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccae88-8b08-483d-96f3-89afb195faf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:16.657359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-6eccae88-8b08-483d-96f3-89afb195faf7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:16.659709 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6eccae88-8b08-483d-96f3-89afb195faf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:16.669025 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1314/2646] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:16.673603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99fcd4-5c3f-4f6e-bcb3-c9c7969e9c67 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:16.684328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99fcd4-5c3f-4f6e-bcb3-c9c7969e9c67 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:16.689994 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456462a-66e7-421e-b575-a6354f58230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:16.690758 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456462a-66e7-421e-b575-a6354f58230e admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:16.692945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456462a-66e7-421e-b575-a6354f58230e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:16.692945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456462a-66e7-421e-b575-a6354f58230e admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:16.692945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456462a-66e7-421e-b575-a6354f58230e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:36:16.692945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456462a-66e7-421e-b575-a6354f58230e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:16.695036 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456462a-66e7-421e-b575-a6354f58230e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:16.708530 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1333/2647] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:36:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:36:16.713299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccae88-8b08-483d-96f3-89afb195faf7 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:16.722780 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccae88-8b08-483d-96f3-89afb195faf7 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:16.727581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2f662-c675-49c5-9249-0ed16063d988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:16.728244 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2f662-c675-49c5-9249-0ed16063d988 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:16.728523 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2f662-c675-49c5-9249-0ed16063d988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:16.728796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2f662-c675-49c5-9249-0ed16063d988 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:16.729511 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2f662-c675-49c5-9249-0ed16063d988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:16.731436 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2f662-c675-49c5-9249-0ed16063d988 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:16.780175 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1315/2648] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:36:16 2021] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:16.784009 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456462a-66e7-421e-b575-a6354f58230e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:16.797851 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456462a-66e7-421e-b575-a6354f58230e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:16.877504 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c4474-443d-40f0-837e-96b8e9f7154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:16.878879 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c4474-443d-40f0-837e-96b8e9f7154e admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:16.879355 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c4474-443d-40f0-837e-96b8e9f7154e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:16.879628 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c4474-443d-40f0-837e-96b8e9f7154e admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:16.880512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c4474-443d-40f0-837e-96b8e9f7154e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:16.882475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c4474-443d-40f0-837e-96b8e9f7154e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:16.907730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1334/2649] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:36:16 2021] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:36:16.912080 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2f662-c675-49c5-9249-0ed16063d988 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:16.922697 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2f662-c675-49c5-9249-0ed16063d988 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:16.927392 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f96643-03ab-467f-9f9f-7cd84694f448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:16.928055 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f96643-03ab-467f-9f9f-7cd84694f448 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:16.928332 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f96643-03ab-467f-9f9f-7cd84694f448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:16.928601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f96643-03ab-467f-9f9f-7cd84694f448 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:16.929347 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f96643-03ab-467f-9f9f-7cd84694f448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:16.930976 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f96643-03ab-467f-9f9f-7cd84694f448 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:16.941896 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1316/2650] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:16 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:36:16.945979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c4474-443d-40f0-837e-96b8e9f7154e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:16.955906 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c4474-443d-40f0-837e-96b8e9f7154e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:16.960756 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc2a6f-0e20-4dd8-9219-c06ba6b5a2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:16.961383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc2a6f-0e20-4dd8-9219-c06ba6b5a2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:16.961663 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc2a6f-0e20-4dd8-9219-c06ba6b5a2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:16.961935 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc2a6f-0e20-4dd8-9219-c06ba6b5a2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:16.962722 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc2a6f-0e20-4dd8-9219-c06ba6b5a2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:16.964379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc2a6f-0e20-4dd8-9219-c06ba6b5a2d4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:16.975367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1335/2651] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:16 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:16.979711 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f96643-03ab-467f-9f9f-7cd84694f448 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:16.990087 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f96643-03ab-467f-9f9f-7cd84694f448 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:16.994688 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb957ab-9664-4897-b4d6-86794664791f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:16.995622 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb957ab-9664-4897-b4d6-86794664791f admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:16.995901 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb957ab-9664-4897-b4d6-86794664791f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:16.996175 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb957ab-9664-4897-b4d6-86794664791f admin admin] PATH_INFO: `/v3/projects/9a0bceafd8ed4859bcf4fec79695f518/users/e9e94b7f8c6a4476b10bae3b3bf1b7d0/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:17.011028 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb957ab-9664-4897-b4d6-86794664791f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0bceafd8ed4859bcf4fec79695f518, user_id=e9e94b7f8c6a4476b10bae3b3bf1b7d0, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:17.013738 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb957ab-9664-4897-b4d6-86794664791f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:17.032240 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1317/2652] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:16 2021] PUT /identity/v3/projects/9a0bceafd8ed4859bcf4fec79695f518/users/e9e94b7f8c6a4476b10bae3b3bf1b7d0/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:17.043252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa271a5-6983-428c-98c0-d5566f0ae3ae None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:17.043549 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa271a5-6983-428c-98c0-d5566f0ae3ae None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:17.043981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa271a5-6983-428c-98c0-d5566f0ae3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:17.073634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-7fa271a5-6983-428c-98c0-d5566f0ae3ae None None] MFA Rules not processed for user `e9e94b7f8c6a4476b10bae3b3bf1b7d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:17.074965 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7fa271a5-6983-428c-98c0-d5566f0ae3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:17.145512 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1336/2653] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:17 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:17.150488 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb957ab-9664-4897-b4d6-86794664791f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:17.221640 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb957ab-9664-4897-b4d6-86794664791f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:17.241542 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e1075-3ed0-446a-bede-5eab70e6ce32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:17.242263 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e1075-3ed0-446a-bede-5eab70e6ce32 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:17.242542 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e1075-3ed0-446a-bede-5eab70e6ce32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:17.242820 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e1075-3ed0-446a-bede-5eab70e6ce32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:17.243579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e1075-3ed0-446a-bede-5eab70e6ce32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:17.245744 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e1075-3ed0-446a-bede-5eab70e6ce32 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:17.277731 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1318/2654] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:36:17 2021] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:17.279002 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa271a5-6983-428c-98c0-d5566f0ae3ae None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:17.289821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa271a5-6983-428c-98c0-d5566f0ae3ae None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:17.352826 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6870ae9-6975-4135-8702-72d3822b248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:17.353532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870ae9-6975-4135-8702-72d3822b248e admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:17.353811 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870ae9-6975-4135-8702-72d3822b248e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:17.354084 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870ae9-6975-4135-8702-72d3822b248e admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:17.354812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6870ae9-6975-4135-8702-72d3822b248e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:17.356845 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6870ae9-6975-4135-8702-72d3822b248e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:17.377442 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1337/2655] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:36:17 2021] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:36:17.381973 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e1075-3ed0-446a-bede-5eab70e6ce32 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:17.392918 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e1075-3ed0-446a-bede-5eab70e6ce32 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:17.398610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a4156-7060-4b8e-98e6-5d21c8d42423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:17.399709 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a4156-7060-4b8e-98e6-5d21c8d42423 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:17.400063 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a4156-7060-4b8e-98e6-5d21c8d42423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:17.400453 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a4156-7060-4b8e-98e6-5d21c8d42423 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:17.401271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a4156-7060-4b8e-98e6-5d21c8d42423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:17.402935 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a4156-7060-4b8e-98e6-5d21c8d42423 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:17.417602 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1319/2656] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:17 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:17.420475 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6870ae9-6975-4135-8702-72d3822b248e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:17.435088 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6870ae9-6975-4135-8702-72d3822b248e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:17.441559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb8a95-c95a-4be6-be8a-35567a10222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:17.442466 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb8a95-c95a-4be6-be8a-35567a10222b admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:17.442749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb8a95-c95a-4be6-be8a-35567a10222b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:17.443024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb8a95-c95a-4be6-be8a-35567a10222b admin admin] PATH_INFO: `/v3/projects/57b9c7d2b555435f821067f3dec505a8/users/bdc62e54bb2d40c390718c638d7b8b67/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:17.458312 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb8a95-c95a-4be6-be8a-35567a10222b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b9c7d2b555435f821067f3dec505a8, user_id=bdc62e54bb2d40c390718c638d7b8b67, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:17.461018 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb8a95-c95a-4be6-be8a-35567a10222b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:17.474849 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1338/2657] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:17 2021] PUT /identity/v3/projects/57b9c7d2b555435f821067f3dec505a8/users/bdc62e54bb2d40c390718c638d7b8b67/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:17.478915 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a4156-7060-4b8e-98e6-5d21c8d42423 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:17.492102 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a4156-7060-4b8e-98e6-5d21c8d42423 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:17.575495 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa864c0-7ce6-4b84-b05c-5ae0dce54fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:17.576198 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa864c0-7ce6-4b84-b05c-5ae0dce54fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:17.576481 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa864c0-7ce6-4b84-b05c-5ae0dce54fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:17.576761 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa864c0-7ce6-4b84-b05c-5ae0dce54fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:17.577520 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa864c0-7ce6-4b84-b05c-5ae0dce54fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:17.579658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa864c0-7ce6-4b84-b05c-5ae0dce54fc4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:17.596006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1320/2658] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:17 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:17.600054 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb8a95-c95a-4be6-be8a-35567a10222b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:17.611079 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb8a95-c95a-4be6-be8a-35567a10222b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:17.616054 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b8b52-3c12-4ff7-9c3f-7fcb75b5279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:17.616983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b8b52-3c12-4ff7-9c3f-7fcb75b5279b admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:17.617268 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b8b52-3c12-4ff7-9c3f-7fcb75b5279b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:17.617543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b8b52-3c12-4ff7-9c3f-7fcb75b5279b admin admin] PATH_INFO: `/v3/projects/57b9c7d2b555435f821067f3dec505a8/users/bdc62e54bb2d40c390718c638d7b8b67/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:17.619566 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b8b52-3c12-4ff7-9c3f-7fcb75b5279b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b9c7d2b555435f821067f3dec505a8, user_id=bdc62e54bb2d40c390718c638d7b8b67, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:17.622216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b8b52-3c12-4ff7-9c3f-7fcb75b5279b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:17.632941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1339/2659] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:17 2021] PUT /identity/v3/projects/57b9c7d2b555435f821067f3dec505a8/users/bdc62e54bb2d40c390718c638d7b8b67/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:17.644449 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f52b0-e8fb-4e54-bfb0-64be43f5aa15 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:17.644810 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f52b0-e8fb-4e54-bfb0-64be43f5aa15 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:17.645101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f52b0-e8fb-4e54-bfb0-64be43f5aa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:17.680853 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-da5f52b0-e8fb-4e54-bfb0-64be43f5aa15 None None] MFA Rules not processed for user `bdc62e54bb2d40c390718c638d7b8b67`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:17.682101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-da5f52b0-e8fb-4e54-bfb0-64be43f5aa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:17.778377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1321/2660] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:17 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:36:17.785050 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b8b52-3c12-4ff7-9c3f-7fcb75b5279b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:17.787042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a25b8b52-3c12-4ff7-9c3f-7fcb75b5279b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:17.862959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b8b52-3c12-4ff7-9c3f-7fcb75b5279b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:17.868105 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42ad27-c60e-443a-b010-cb209fbadabf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:17.868841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42ad27-c60e-443a-b010-cb209fbadabf service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:17.869127 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42ad27-c60e-443a-b010-cb209fbadabf service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:17.869538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42ad27-c60e-443a-b010-cb209fbadabf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:17.882669 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42ad27-c60e-443a-b010-cb209fbadabf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:17.884163 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42ad27-c60e-443a-b010-cb209fbadabf service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:17.895183 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1340/2661] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:17 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:17.970245 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f52b0-e8fb-4e54-bfb0-64be43f5aa15 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:18.038578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f52b0-e8fb-4e54-bfb0-64be43f5aa15 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:18.043680 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ed3d9-a8a1-414f-9427-f40ddb75a1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:18.044566 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ed3d9-a8a1-414f-9427-f40ddb75a1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:18.044971 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ed3d9-a8a1-414f-9427-f40ddb75a1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:18.045104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ed3d9-a8a1-414f-9427-f40ddb75a1aa admin admin] PATH_INFO: `/v3/users/e9e94b7f8c6a4476b10bae3b3bf1b7d0` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:18.046407 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ed3d9-a8a1-414f-9427-f40ddb75a1aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e94b7f8c6a4476b10bae3b3bf1b7d0)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:18.051019 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ed3d9-a8a1-414f-9427-f40ddb75a1aa admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:18.123381 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-094ed3d9-a8a1-414f-9427-f40ddb75a1aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e94b7f8c6a4476b10bae3b3bf1b7d0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.124088 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-094ed3d9-a8a1-414f-9427-f40ddb75a1aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e94b7f8c6a4476b10bae3b3bf1b7d0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.134128 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-094ed3d9-a8a1-414f-9427-f40ddb75a1aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e94b7f8c6a4476b10bae3b3bf1b7d0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.135016 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-094ed3d9-a8a1-414f-9427-f40ddb75a1aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e94b7f8c6a4476b10bae3b3bf1b7d0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.146883 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-094ed3d9-a8a1-414f-9427-f40ddb75a1aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e94b7f8c6a4476b10bae3b3bf1b7d0'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.171096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1322/2662] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:36:17 2021] DELETE /identity/v3/users/e9e94b7f8c6a4476b10bae3b3bf1b7d0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:18.176063 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfe910-2589-4222-9087-dda85a780210 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:18.177255 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfe910-2589-4222-9087-dda85a780210 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:18.177703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfe910-2589-4222-9087-dda85a780210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:18.199024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-63bfe910-2589-4222-9087-dda85a780210 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:18.200303 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-63bfe910-2589-4222-9087-dda85a780210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:18.265556 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1341/2663] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:36:18.278494 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ed3d9-a8a1-414f-9427-f40ddb75a1aa admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:18.280218 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-094ed3d9-a8a1-414f-9427-f40ddb75a1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:18.352375 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ed3d9-a8a1-414f-9427-f40ddb75a1aa admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:18.357336 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8d8d1-88c9-4a67-8e1d-9782f8e39eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:18.358010 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8d8d1-88c9-4a67-8e1d-9782f8e39eaa service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:18.358300 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8d8d1-88c9-4a67-8e1d-9782f8e39eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:18.358581 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8d8d1-88c9-4a67-8e1d-9782f8e39eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:18.372324 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8d8d1-88c9-4a67-8e1d-9782f8e39eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:18.373884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8d8d1-88c9-4a67-8e1d-9782f8e39eaa service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:18.385090 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1323/2664] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:18.682405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfe910-2589-4222-9087-dda85a780210 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:18.683898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-63bfe910-2589-4222-9087-dda85a780210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:18.702386 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfe910-2589-4222-9087-dda85a780210 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:18.716407 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:18.717600 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:18.718060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:18.718499 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] PATH_INFO: `/v3/projects/9a0bceafd8ed4859bcf4fec79695f518` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:18.720279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0bceafd8ed4859bcf4fec79695f518)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:18.722330 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:18.774983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0bceafd8ed4859bcf4fec79695f518', 'request_id': 'req-2d55169a-ed8d-44d8-9406-818b1be2ba60'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.784117 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0bceafd8ed4859bcf4fec79695f518', 'request_id': 'req-2d55169a-ed8d-44d8-9406-818b1be2ba60'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.792396 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0bceafd8ed4859bcf4fec79695f518', 'request_id': 'req-2d55169a-ed8d-44d8-9406-818b1be2ba60'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.806536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] The token cache is being invalidate because project 9a0bceafd8ed4859bcf4fec79695f518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:36:18.806817 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.808634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.811718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1342/2665] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:36:18 2021] DELETE /identity/v3/projects/9a0bceafd8ed4859bcf4fec79695f518 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:18.815957 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8d8d1-88c9-4a67-8e1d-9782f8e39eaa service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:18.826644 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8d8d1-88c9-4a67-8e1d-9782f8e39eaa service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:18.885212 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11356b2d-f42e-4ec7-8593-e54c72c7e242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:18.886469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356b2d-f42e-4ec7-8593-e54c72c7e242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:18.886902 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356b2d-f42e-4ec7-8593-e54c72c7e242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:18.887354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356b2d-f42e-4ec7-8593-e54c72c7e242 admin admin] PATH_INFO: `/v3/users/bdc62e54bb2d40c390718c638d7b8b67` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:18.888750 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11356b2d-f42e-4ec7-8593-e54c72c7e242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc62e54bb2d40c390718c638d7b8b67)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:18.890851 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11356b2d-f42e-4ec7-8593-e54c72c7e242 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:18.939151 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-11356b2d-f42e-4ec7-8593-e54c72c7e242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc62e54bb2d40c390718c638d7b8b67'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.939799 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-11356b2d-f42e-4ec7-8593-e54c72c7e242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc62e54bb2d40c390718c638d7b8b67'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.951230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-11356b2d-f42e-4ec7-8593-e54c72c7e242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc62e54bb2d40c390718c638d7b8b67'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.951230 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-11356b2d-f42e-4ec7-8593-e54c72c7e242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc62e54bb2d40c390718c638d7b8b67'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.959059 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-11356b2d-f42e-4ec7-8593-e54c72c7e242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc62e54bb2d40c390718c638d7b8b67'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:18.977675 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1324/2666] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:36:18 2021] DELETE /identity/v3/users/bdc62e54bb2d40c390718c638d7b8b67 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:36:19.309596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:19.311196 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:19.326016 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55169a-ed8d-44d8-9406-818b1be2ba60 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:19.387380 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e25ee6-81e0-48ad-a75b-6f87565485c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:19.388355 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e25ee6-81e0-48ad-a75b-6f87565485c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:19.388703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e25ee6-81e0-48ad-a75b-6f87565485c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:19.389115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e25ee6-81e0-48ad-a75b-6f87565485c2 admin admin] PATH_INFO: `/v3/projects/57b9c7d2b555435f821067f3dec505a8` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:19.390937 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e25ee6-81e0-48ad-a75b-6f87565485c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b9c7d2b555435f821067f3dec505a8)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:19.393152 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e25ee6-81e0-48ad-a75b-6f87565485c2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:19.451793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-24e25ee6-81e0-48ad-a75b-6f87565485c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b9c7d2b555435f821067f3dec505a8', 'request_id': 'req-24e25ee6-81e0-48ad-a75b-6f87565485c2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:19.458301 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-24e25ee6-81e0-48ad-a75b-6f87565485c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b9c7d2b555435f821067f3dec505a8', 'request_id': 'req-24e25ee6-81e0-48ad-a75b-6f87565485c2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:19.464309 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-24e25ee6-81e0-48ad-a75b-6f87565485c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b9c7d2b555435f821067f3dec505a8', 'request_id': 'req-24e25ee6-81e0-48ad-a75b-6f87565485c2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:19.480192 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-24e25ee6-81e0-48ad-a75b-6f87565485c2 admin admin] The token cache is being invalidate because project 57b9c7d2b555435f821067f3dec505a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:36:19.480535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-24e25ee6-81e0-48ad-a75b-6f87565485c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:19.481190 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-24e25ee6-81e0-48ad-a75b-6f87565485c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:19.483021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1343/2667] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:36:19 2021] DELETE /identity/v3/projects/57b9c7d2b555435f821067f3dec505a8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:19.489692 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff22e07-7d04-4563-9bae-010b5e6f1da4 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:19.490680 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff22e07-7d04-4563-9bae-010b5e6f1da4 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:19.491428 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff22e07-7d04-4563-9bae-010b5e6f1da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:19.513957 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8ff22e07-7d04-4563-9bae-010b5e6f1da4 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:19.515236 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8ff22e07-7d04-4563-9bae-010b5e6f1da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:19.573917 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1325/2668] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:19.582532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223cf43-cae5-4ac3-9a60-f8db8d68aff5 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:19.582532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223cf43-cae5-4ac3-9a60-f8db8d68aff5 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:19.582532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223cf43-cae5-4ac3-9a60-f8db8d68aff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:19.605059 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-e223cf43-cae5-4ac3-9a60-f8db8d68aff5 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:19.606343 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e223cf43-cae5-4ac3-9a60-f8db8d68aff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:19.614789 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1344/2669] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:36:19.619356 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff22e07-7d04-4563-9bae-010b5e6f1da4 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:19.629870 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff22e07-7d04-4563-9bae-010b5e6f1da4 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:19.635285 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0c34a-6c7b-4538-a212-d4dd822ee13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:19.635963 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0c34a-6c7b-4538-a212-d4dd822ee13f admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:19.636235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0c34a-6c7b-4538-a212-d4dd822ee13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:19.636513 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0c34a-6c7b-4538-a212-d4dd822ee13f admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:19.637245 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0c34a-6c7b-4538-a212-d4dd822ee13f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:36:19.637548 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0c34a-6c7b-4538-a212-d4dd822ee13f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:19.639203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0c34a-6c7b-4538-a212-d4dd822ee13f admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:19.657439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223cf43-cae5-4ac3-9a60-f8db8d68aff5 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:19.663235 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1326/2670] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:36:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 11:36:19.680885 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223cf43-cae5-4ac3-9a60-f8db8d68aff5 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:19.685675 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa82c2-259a-4af2-b37a-6cc6d63ea485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:19.686341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa82c2-259a-4af2-b37a-6cc6d63ea485 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:19.686645 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa82c2-259a-4af2-b37a-6cc6d63ea485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:19.686919 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa82c2-259a-4af2-b37a-6cc6d63ea485 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:19.687665 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa82c2-259a-4af2-b37a-6cc6d63ea485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:19.689581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa82c2-259a-4af2-b37a-6cc6d63ea485 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:19.717973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1345/2671] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:36:19 2021] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:19.722159 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0c34a-6c7b-4538-a212-d4dd822ee13f admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:19.733749 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0c34a-6c7b-4538-a212-d4dd822ee13f admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:19.792204 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d22f4-0867-4688-9885-9edde0b08049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:19.792876 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d22f4-0867-4688-9885-9edde0b08049 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:19.793155 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d22f4-0867-4688-9885-9edde0b08049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:19.793427 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d22f4-0867-4688-9885-9edde0b08049 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:19.794136 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d22f4-0867-4688-9885-9edde0b08049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:19.796291 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d22f4-0867-4688-9885-9edde0b08049 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:19.820458 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1327/2672] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:36:19 2021] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:19.824708 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa82c2-259a-4af2-b37a-6cc6d63ea485 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:19.837551 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa82c2-259a-4af2-b37a-6cc6d63ea485 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:19.843464 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8020d13-a4f9-4fea-a2e7-22ae19bfc719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:19.844364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020d13-a4f9-4fea-a2e7-22ae19bfc719 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:19.844655 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020d13-a4f9-4fea-a2e7-22ae19bfc719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:19.844932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020d13-a4f9-4fea-a2e7-22ae19bfc719 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:19.845688 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8020d13-a4f9-4fea-a2e7-22ae19bfc719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:19.847340 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8020d13-a4f9-4fea-a2e7-22ae19bfc719 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:19.859250 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1346/2673] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:19 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:36:19.863956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d22f4-0867-4688-9885-9edde0b08049 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:19.874372 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d22f4-0867-4688-9885-9edde0b08049 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:19.879911 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75545bf1-3dad-4a75-8e03-b0d8397b41e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:19.880646 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75545bf1-3dad-4a75-8e03-b0d8397b41e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:19.881017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75545bf1-3dad-4a75-8e03-b0d8397b41e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:19.881360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75545bf1-3dad-4a75-8e03-b0d8397b41e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:19.882223 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75545bf1-3dad-4a75-8e03-b0d8397b41e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:19.883991 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75545bf1-3dad-4a75-8e03-b0d8397b41e0 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:19.896074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1328/2674] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:19 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:19.900059 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8020d13-a4f9-4fea-a2e7-22ae19bfc719 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:19.911216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8020d13-a4f9-4fea-a2e7-22ae19bfc719 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:19.916308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc380ecb-3b91-4156-8fe1-6d7bd72c8d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:19.917516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc380ecb-3b91-4156-8fe1-6d7bd72c8d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:19.917899 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc380ecb-3b91-4156-8fe1-6d7bd72c8d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:19.918274 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc380ecb-3b91-4156-8fe1-6d7bd72c8d55 admin admin] PATH_INFO: `/v3/projects/9eeacfe388874cdab83e964a41993512/users/b1395193c810447b9c1ac48f20e704e0/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:19.935336 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc380ecb-3b91-4156-8fe1-6d7bd72c8d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eeacfe388874cdab83e964a41993512, user_id=b1395193c810447b9c1ac48f20e704e0, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:19.938118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc380ecb-3b91-4156-8fe1-6d7bd72c8d55 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:19.951655 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1347/2675] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:19 2021] PUT /identity/v3/projects/9eeacfe388874cdab83e964a41993512/users/b1395193c810447b9c1ac48f20e704e0/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:19.963405 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314408c-9152-487f-a33a-77ff1938cda3 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:19.963693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314408c-9152-487f-a33a-77ff1938cda3 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:19.963968 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314408c-9152-487f-a33a-77ff1938cda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:19.995403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8314408c-9152-487f-a33a-77ff1938cda3 None None] MFA Rules not processed for user `b1395193c810447b9c1ac48f20e704e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:19.996956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8314408c-9152-487f-a33a-77ff1938cda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:20.067508 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1329/2676] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:19 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:36:20.071896 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc380ecb-3b91-4156-8fe1-6d7bd72c8d55 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:20.141296 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc380ecb-3b91-4156-8fe1-6d7bd72c8d55 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:20.146736 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a74de9-1e7f-4537-8a91-1571eacb90d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:20.147440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a74de9-1e7f-4537-8a91-1571eacb90d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:20.147729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a74de9-1e7f-4537-8a91-1571eacb90d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:20.148004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a74de9-1e7f-4537-8a91-1571eacb90d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:20.148726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a74de9-1e7f-4537-8a91-1571eacb90d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:20.150642 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a74de9-1e7f-4537-8a91-1571eacb90d2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:20.180124 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1348/2677] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:36:20 2021] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:36:20.184252 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314408c-9152-487f-a33a-77ff1938cda3 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:20.195426 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314408c-9152-487f-a33a-77ff1938cda3 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:20.254193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db81891-e689-4bee-b6b8-348c66d5532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:20.254954 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db81891-e689-4bee-b6b8-348c66d5532c admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:20.255277 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db81891-e689-4bee-b6b8-348c66d5532c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:20.255557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db81891-e689-4bee-b6b8-348c66d5532c admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:20.256286 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db81891-e689-4bee-b6b8-348c66d5532c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:20.258288 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db81891-e689-4bee-b6b8-348c66d5532c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:20.280886 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1330/2678] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:36:20 2021] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:20.285447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a74de9-1e7f-4537-8a91-1571eacb90d2 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:20.296683 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a74de9-1e7f-4537-8a91-1571eacb90d2 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:20.301862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c680fdc-8cfc-4eed-ab58-ff8df3312cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:20.307892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c680fdc-8cfc-4eed-ab58-ff8df3312cab admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:20.308299 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c680fdc-8cfc-4eed-ab58-ff8df3312cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:20.308676 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c680fdc-8cfc-4eed-ab58-ff8df3312cab admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:20.309868 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c680fdc-8cfc-4eed-ab58-ff8df3312cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:20.311985 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c680fdc-8cfc-4eed-ab58-ff8df3312cab admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:20.328118 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1349/2679] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:20 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:20.332390 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db81891-e689-4bee-b6b8-348c66d5532c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:20.345778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db81891-e689-4bee-b6b8-348c66d5532c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:20.358402 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c6205-d378-4984-ad69-dd5d38869b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:20.359377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c6205-d378-4984-ad69-dd5d38869b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:20.359668 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c6205-d378-4984-ad69-dd5d38869b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:20.359948 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c6205-d378-4984-ad69-dd5d38869b20 admin admin] PATH_INFO: `/v3/projects/5108f88581d14b52b91c8f31ab16317a/users/8d2f3d11bdd74850bf5d1eeac35d3c7a/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:20.377499 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c6205-d378-4984-ad69-dd5d38869b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5108f88581d14b52b91c8f31ab16317a, user_id=8d2f3d11bdd74850bf5d1eeac35d3c7a, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:20.390557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c6205-d378-4984-ad69-dd5d38869b20 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:20.418966 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1331/2680] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:20 2021] PUT /identity/v3/projects/5108f88581d14b52b91c8f31ab16317a/users/8d2f3d11bdd74850bf5d1eeac35d3c7a/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:20.423329 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c680fdc-8cfc-4eed-ab58-ff8df3312cab admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:20.443337 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c680fdc-8cfc-4eed-ab58-ff8df3312cab admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:20.537070 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07d967-82f3-460a-996f-ed929a2be283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:20.537743 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07d967-82f3-460a-996f-ed929a2be283 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:20.538033 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07d967-82f3-460a-996f-ed929a2be283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:20.538306 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07d967-82f3-460a-996f-ed929a2be283 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:20.539054 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07d967-82f3-460a-996f-ed929a2be283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:20.540837 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07d967-82f3-460a-996f-ed929a2be283 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:20.551229 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1350/2681] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:20 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:20.556921 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c6205-d378-4984-ad69-dd5d38869b20 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:20.568117 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c6205-d378-4984-ad69-dd5d38869b20 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:20.572956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa6812-2a38-4f09-a9a0-60e4dbbe10af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:20.573909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa6812-2a38-4f09-a9a0-60e4dbbe10af admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:20.574221 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa6812-2a38-4f09-a9a0-60e4dbbe10af admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:20.574505 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa6812-2a38-4f09-a9a0-60e4dbbe10af admin admin] PATH_INFO: `/v3/projects/5108f88581d14b52b91c8f31ab16317a/users/8d2f3d11bdd74850bf5d1eeac35d3c7a/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:20.576686 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa6812-2a38-4f09-a9a0-60e4dbbe10af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5108f88581d14b52b91c8f31ab16317a, user_id=8d2f3d11bdd74850bf5d1eeac35d3c7a, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:20.579569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa6812-2a38-4f09-a9a0-60e4dbbe10af admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:20.603847 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1332/2682] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:20 2021] PUT /identity/v3/projects/5108f88581d14b52b91c8f31ab16317a/users/8d2f3d11bdd74850bf5d1eeac35d3c7a/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:36:20.614168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c7519-f133-441f-a60b-c579a5f9b126 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:20.614420 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c7519-f133-441f-a60b-c579a5f9b126 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:20.614732 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c7519-f133-441f-a60b-c579a5f9b126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:20.642369 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-226c7519-f133-441f-a60b-c579a5f9b126 None None] MFA Rules not processed for user `8d2f3d11bdd74850bf5d1eeac35d3c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:20.643633 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-226c7519-f133-441f-a60b-c579a5f9b126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:20.721323 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1351/2683] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:20 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:20.731282 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa6812-2a38-4f09-a9a0-60e4dbbe10af admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:20.733166 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-63fa6812-2a38-4f09-a9a0-60e4dbbe10af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:20.798429 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa6812-2a38-4f09-a9a0-60e4dbbe10af admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:20.803093 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f07cb5-c0fa-4abe-aa0e-fa4a55ad7764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:20.803778 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07cb5-c0fa-4abe-aa0e-fa4a55ad7764 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:20.804060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07cb5-c0fa-4abe-aa0e-fa4a55ad7764 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:20.804338 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07cb5-c0fa-4abe-aa0e-fa4a55ad7764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:20.813884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f07cb5-c0fa-4abe-aa0e-fa4a55ad7764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:20.815354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f07cb5-c0fa-4abe-aa0e-fa4a55ad7764 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:20.824944 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1333/2684] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:20 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:21.190022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c7519-f133-441f-a60b-c579a5f9b126 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:21.255255 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c7519-f133-441f-a60b-c579a5f9b126 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:21.259721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeeb27d-8657-4978-bfa6-700d5e1f6385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:21.260591 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeb27d-8657-4978-bfa6-700d5e1f6385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:21.260875 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeb27d-8657-4978-bfa6-700d5e1f6385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:21.261150 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeb27d-8657-4978-bfa6-700d5e1f6385 admin admin] PATH_INFO: `/v3/users/b1395193c810447b9c1ac48f20e704e0` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:21.262390 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeeb27d-8657-4978-bfa6-700d5e1f6385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1395193c810447b9c1ac48f20e704e0)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:21.264315 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeeb27d-8657-4978-bfa6-700d5e1f6385 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:21.321322 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ffeeb27d-8657-4978-bfa6-700d5e1f6385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1395193c810447b9c1ac48f20e704e0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:21.322010 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ffeeb27d-8657-4978-bfa6-700d5e1f6385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1395193c810447b9c1ac48f20e704e0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:21.330207 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ffeeb27d-8657-4978-bfa6-700d5e1f6385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1395193c810447b9c1ac48f20e704e0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:21.330898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ffeeb27d-8657-4978-bfa6-700d5e1f6385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1395193c810447b9c1ac48f20e704e0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:21.343151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-ffeeb27d-8657-4978-bfa6-700d5e1f6385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1395193c810447b9c1ac48f20e704e0'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:21.356193 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1352/2685] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:36:21 2021] DELETE /identity/v3/users/b1395193c810447b9c1ac48f20e704e0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:21.360876 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b81c78-a462-4709-90fd-637915743998 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:21.361163 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b81c78-a462-4709-90fd-637915743998 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:21.361437 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b81c78-a462-4709-90fd-637915743998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:21.379937 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-23b81c78-a462-4709-90fd-637915743998 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:21.381139 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-23b81c78-a462-4709-90fd-637915743998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:21.456127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1334/2686] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:21.466401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeeb27d-8657-4978-bfa6-700d5e1f6385 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:21.467912 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-ffeeb27d-8657-4978-bfa6-700d5e1f6385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:21.523760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b81c78-a462-4709-90fd-637915743998 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:21.528168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeeb27d-8657-4978-bfa6-700d5e1f6385 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:21.533268 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0896bf-cf3f-42a1-916c-635e6fef02d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:21.533484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b81c78-a462-4709-90fd-637915743998 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:21.534152 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0896bf-cf3f-42a1-916c-635e6fef02d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:21.534508 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0896bf-cf3f-42a1-916c-635e6fef02d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:21.534822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0896bf-cf3f-42a1-916c-635e6fef02d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:21.537708 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77206a5-3f16-49a2-a155-f0ad95d07900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:21.539016 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77206a5-3f16-49a2-a155-f0ad95d07900 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:21.539016 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77206a5-3f16-49a2-a155-f0ad95d07900 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:21.539016 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77206a5-3f16-49a2-a155-f0ad95d07900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:21.541023 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-e77206a5-3f16-49a2-a155-f0ad95d07900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:21.546060 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0896bf-cf3f-42a1-916c-635e6fef02d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:21.547567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0896bf-cf3f-42a1-916c-635e6fef02d2 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:21.559177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1353/2687] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:21.562715 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77206a5-3f16-49a2-a155-f0ad95d07900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:21.564227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77206a5-3f16-49a2-a155-f0ad95d07900 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:21.573684 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1335/2688] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:21 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:36:22.030698 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0896bf-cf3f-42a1-916c-635e6fef02d2 service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:22.032316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1a0896bf-cf3f-42a1-916c-635e6fef02d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:22.046252 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0896bf-cf3f-42a1-916c-635e6fef02d2 service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:22.052144 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:22.053093 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:22.053377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:22.053658 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] PATH_INFO: `/v3/projects/9eeacfe388874cdab83e964a41993512` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:22.054920 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eeacfe388874cdab83e964a41993512)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:22.056892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:22.108405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eeacfe388874cdab83e964a41993512', 'request_id': 'req-f7d5c6e3-069f-4e35-9cee-25038de40440'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.116669 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eeacfe388874cdab83e964a41993512', 'request_id': 'req-f7d5c6e3-069f-4e35-9cee-25038de40440'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.125424 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eeacfe388874cdab83e964a41993512', 'request_id': 'req-f7d5c6e3-069f-4e35-9cee-25038de40440'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.143386 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] The token cache is being invalidate because project 9eeacfe388874cdab83e964a41993512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:36:22.143930 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.144892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.147774 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1354/2689] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:36:22 2021] DELETE /identity/v3/projects/9eeacfe388874cdab83e964a41993512 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:22.151845 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77206a5-3f16-49a2-a155-f0ad95d07900 service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:22.163879 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77206a5-3f16-49a2-a155-f0ad95d07900 service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:22.224901 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bac12-e853-4045-9a3d-7051df6efadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:22.225805 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bac12-e853-4045-9a3d-7051df6efadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:22.226096 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bac12-e853-4045-9a3d-7051df6efadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:22.226365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bac12-e853-4045-9a3d-7051df6efadf admin admin] PATH_INFO: `/v3/users/8d2f3d11bdd74850bf5d1eeac35d3c7a` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:22.227665 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bac12-e853-4045-9a3d-7051df6efadf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d2f3d11bdd74850bf5d1eeac35d3c7a)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:22.229603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bac12-e853-4045-9a3d-7051df6efadf admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:22.286887 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-086bac12-e853-4045-9a3d-7051df6efadf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d2f3d11bdd74850bf5d1eeac35d3c7a'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.287614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-086bac12-e853-4045-9a3d-7051df6efadf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d2f3d11bdd74850bf5d1eeac35d3c7a'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.297439 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-086bac12-e853-4045-9a3d-7051df6efadf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d2f3d11bdd74850bf5d1eeac35d3c7a'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.298195 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-086bac12-e853-4045-9a3d-7051df6efadf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d2f3d11bdd74850bf5d1eeac35d3c7a'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.305456 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-086bac12-e853-4045-9a3d-7051df6efadf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d2f3d11bdd74850bf5d1eeac35d3c7a'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.323976 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1336/2690] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:36:22 2021] DELETE /identity/v3/users/8d2f3d11bdd74850bf5d1eeac35d3c7a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:22.336338 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:22.338062 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:22.464978 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5c6e3-069f-4e35-9cee-25038de40440 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:22.545220 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5ca64-87f7-4446-8ce9-bcf0fb7b3cb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:22.546085 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5ca64-87f7-4446-8ce9-bcf0fb7b3cb0 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:22.546371 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5ca64-87f7-4446-8ce9-bcf0fb7b3cb0 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:22.546644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5ca64-87f7-4446-8ce9-bcf0fb7b3cb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:22.548548 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-cfe5ca64-87f7-4446-8ce9-bcf0fb7b3cb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:22.562360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5ca64-87f7-4446-8ce9-bcf0fb7b3cb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:22.564032 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5ca64-87f7-4446-8ce9-bcf0fb7b3cb0 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:22.576799 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1355/2691] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:22.682478 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bac12-e853-4045-9a3d-7051df6efadf admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:22.684120 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-086bac12-e853-4045-9a3d-7051df6efadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:22.764690 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bac12-e853-4045-9a3d-7051df6efadf admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:22.773251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4bbed-f029-400f-ab52-7764a661b2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:22.774135 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4bbed-f029-400f-ab52-7764a661b2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:22.774486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4bbed-f029-400f-ab52-7764a661b2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:22.774803 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4bbed-f029-400f-ab52-7764a661b2a9 admin admin] PATH_INFO: `/v3/projects/5108f88581d14b52b91c8f31ab16317a` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:22.776078 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4bbed-f029-400f-ab52-7764a661b2a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5108f88581d14b52b91c8f31ab16317a)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:22.778046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4bbed-f029-400f-ab52-7764a661b2a9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:22.829548 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f7f4bbed-f029-400f-ab52-7764a661b2a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5108f88581d14b52b91c8f31ab16317a', 'request_id': 'req-f7f4bbed-f029-400f-ab52-7764a661b2a9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.837028 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f7f4bbed-f029-400f-ab52-7764a661b2a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5108f88581d14b52b91c8f31ab16317a', 'request_id': 'req-f7f4bbed-f029-400f-ab52-7764a661b2a9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.843215 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f7f4bbed-f029-400f-ab52-7764a661b2a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5108f88581d14b52b91c8f31ab16317a', 'request_id': 'req-f7f4bbed-f029-400f-ab52-7764a661b2a9'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.857034 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f7f4bbed-f029-400f-ab52-7764a661b2a9 admin admin] The token cache is being invalidate because project 5108f88581d14b52b91c8f31ab16317a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:36:22.857422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f7f4bbed-f029-400f-ab52-7764a661b2a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.858270 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-f7f4bbed-f029-400f-ab52-7764a661b2a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:22.860148 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1337/2692] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:36:22 2021] DELETE /identity/v3/projects/5108f88581d14b52b91c8f31ab16317a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:22.869666 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d95d0-6399-4338-8c02-93f496cddb17 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:22.870089 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d95d0-6399-4338-8c02-93f496cddb17 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:22.870462 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d95d0-6399-4338-8c02-93f496cddb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:22.889408 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-b05d95d0-6399-4338-8c02-93f496cddb17 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:22.890783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b05d95d0-6399-4338-8c02-93f496cddb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:22.955630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1356/2693] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:22.964029 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bcaeb-606c-4e1b-8495-c4a396c178a5 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:22.964314 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bcaeb-606c-4e1b-8495-c4a396c178a5 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:22.964568 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bcaeb-606c-4e1b-8495-c4a396c178a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:22.983352 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-516bcaeb-606c-4e1b-8495-c4a396c178a5 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:22.985186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-516bcaeb-606c-4e1b-8495-c4a396c178a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:22.994608 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1338/2694] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:22.998716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d95d0-6399-4338-8c02-93f496cddb17 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:23.008891 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d95d0-6399-4338-8c02-93f496cddb17 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:23.013948 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384afc2-dbdc-4a4c-80d6-daafbea79275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:23.014624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384afc2-dbdc-4a4c-80d6-daafbea79275 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:23.014913 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384afc2-dbdc-4a4c-80d6-daafbea79275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:23.015234 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384afc2-dbdc-4a4c-80d6-daafbea79275 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:23.016021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384afc2-dbdc-4a4c-80d6-daafbea79275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:36:23.016769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384afc2-dbdc-4a4c-80d6-daafbea79275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:23.018476 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384afc2-dbdc-4a4c-80d6-daafbea79275 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:23.030284 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1357/2695] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:36:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 08 11:36:23.034737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bcaeb-606c-4e1b-8495-c4a396c178a5 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:23.043958 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bcaeb-606c-4e1b-8495-c4a396c178a5 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:23.048796 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a1045-f8e9-4e23-b798-dcb14ba932e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:23.049448 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a1045-f8e9-4e23-b798-dcb14ba932e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:23.049729 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a1045-f8e9-4e23-b798-dcb14ba932e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:23.050000 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a1045-f8e9-4e23-b798-dcb14ba932e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:23.050884 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a1045-f8e9-4e23-b798-dcb14ba932e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:23.052916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a1045-f8e9-4e23-b798-dcb14ba932e4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:23.082483 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1339/2696] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:36:23 2021] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:23.083693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384afc2-dbdc-4a4c-80d6-daafbea79275 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:23.094019 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384afc2-dbdc-4a4c-80d6-daafbea79275 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:23.152308 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c89af-fff8-453d-b604-9b366cfec787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:23.152983 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c89af-fff8-453d-b604-9b366cfec787 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:23.153267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c89af-fff8-453d-b604-9b366cfec787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:23.153538 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c89af-fff8-453d-b604-9b366cfec787 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:23.154249 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c89af-fff8-453d-b604-9b366cfec787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:23.156224 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c89af-fff8-453d-b604-9b366cfec787 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:23.179151 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1358/2697] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:36:23 2021] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:23.183413 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a1045-f8e9-4e23-b798-dcb14ba932e4 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:23.194356 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a1045-f8e9-4e23-b798-dcb14ba932e4 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:23.199579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cacc6-6190-4e79-a7be-d12d1cdbf9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:23.200282 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cacc6-6190-4e79-a7be-d12d1cdbf9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:23.200562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cacc6-6190-4e79-a7be-d12d1cdbf9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:23.200839 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cacc6-6190-4e79-a7be-d12d1cdbf9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:23.201584 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cacc6-6190-4e79-a7be-d12d1cdbf9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:23.203264 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cacc6-6190-4e79-a7be-d12d1cdbf9e4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:23.214168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1340/2698] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:23.218306 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c89af-fff8-453d-b604-9b366cfec787 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:23.228421 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c89af-fff8-453d-b604-9b366cfec787 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:23.233165 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c6ab4-9aa0-4c70-a101-2b441d157ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:23.233858 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6ab4-9aa0-4c70-a101-2b441d157ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:23.234152 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6ab4-9aa0-4c70-a101-2b441d157ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:23.234435 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6ab4-9aa0-4c70-a101-2b441d157ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:23.235257 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c6ab4-9aa0-4c70-a101-2b441d157ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:23.236880 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c6ab4-9aa0-4c70-a101-2b441d157ce3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:23.246912 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1359/2699] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:23.251117 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cacc6-6190-4e79-a7be-d12d1cdbf9e4 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:23.262812 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cacc6-6190-4e79-a7be-d12d1cdbf9e4 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:23.267650 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e2e1-37b5-47d5-8aff-40385cdb7915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:23.268544 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e2e1-37b5-47d5-8aff-40385cdb7915 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:23.268822 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e2e1-37b5-47d5-8aff-40385cdb7915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:23.269094 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e2e1-37b5-47d5-8aff-40385cdb7915 admin admin] PATH_INFO: `/v3/projects/e060fad626ea4e85afedfa912bb73d93/users/56f9bce7a9094a298b8203d0438f1cb5/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:23.283675 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493e2e1-37b5-47d5-8aff-40385cdb7915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e060fad626ea4e85afedfa912bb73d93, user_id=56f9bce7a9094a298b8203d0438f1cb5, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:23.286488 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493e2e1-37b5-47d5-8aff-40385cdb7915 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:23.300511 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1341/2700] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:23 2021] PUT /identity/v3/projects/e060fad626ea4e85afedfa912bb73d93/users/56f9bce7a9094a298b8203d0438f1cb5/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:23.312206 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a582c-3845-4b4e-9f9e-009473ced1c0 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:23.312497 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a582c-3845-4b4e-9f9e-009473ced1c0 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:23.312776 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a582c-3845-4b4e-9f9e-009473ced1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:23.339412 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-0e4a582c-3845-4b4e-9f9e-009473ced1c0 None None] MFA Rules not processed for user `56f9bce7a9094a298b8203d0438f1cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:23.340639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-0e4a582c-3845-4b4e-9f9e-009473ced1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:23.408234 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1360/2701] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:23 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:23.414473 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e2e1-37b5-47d5-8aff-40385cdb7915 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:23.492141 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e2e1-37b5-47d5-8aff-40385cdb7915 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:23.497854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bb937-9f2a-456b-ada8-15fe91c8de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:23.498523 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bb937-9f2a-456b-ada8-15fe91c8de57 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:23.498805 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bb937-9f2a-456b-ada8-15fe91c8de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:23.499082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bb937-9f2a-456b-ada8-15fe91c8de57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:23.499841 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bb937-9f2a-456b-ada8-15fe91c8de57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:23.502458 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bb937-9f2a-456b-ada8-15fe91c8de57 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:23.530766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1342/2702] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:36:23 2021] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:23.535651 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a582c-3845-4b4e-9f9e-009473ced1c0 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:23.547405 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a582c-3845-4b4e-9f9e-009473ced1c0 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:23.607894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac1743-f11d-40fc-9d20-e1b7cfc003fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:23.608547 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac1743-f11d-40fc-9d20-e1b7cfc003fd admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:23.608827 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac1743-f11d-40fc-9d20-e1b7cfc003fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:23.609096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac1743-f11d-40fc-9d20-e1b7cfc003fd admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:23.609801 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac1743-f11d-40fc-9d20-e1b7cfc003fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:23.611748 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac1743-f11d-40fc-9d20-e1b7cfc003fd admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:23.631878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1361/2703] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:36:23 2021] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:23.636083 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bb937-9f2a-456b-ada8-15fe91c8de57 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:23.646543 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bb937-9f2a-456b-ada8-15fe91c8de57 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:23.651082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b23e9a-e54c-4815-ac4d-58dc76ebb80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:23.651775 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23e9a-e54c-4815-ac4d-58dc76ebb80e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:23.652054 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23e9a-e54c-4815-ac4d-58dc76ebb80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:23.652325 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23e9a-e54c-4815-ac4d-58dc76ebb80e admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:23.653067 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b23e9a-e54c-4815-ac4d-58dc76ebb80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:23.654674 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b23e9a-e54c-4815-ac4d-58dc76ebb80e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:23.665269 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1343/2704] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:23.669516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac1743-f11d-40fc-9d20-e1b7cfc003fd admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:23.679956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac1743-f11d-40fc-9d20-e1b7cfc003fd admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:23.685877 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ce889-cc79-41cd-8a62-9c1540b0890c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:23.686782 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ce889-cc79-41cd-8a62-9c1540b0890c admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:23.687069 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ce889-cc79-41cd-8a62-9c1540b0890c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:23.687383 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ce889-cc79-41cd-8a62-9c1540b0890c admin admin] PATH_INFO: `/v3/projects/64b39ab1ff5e4ec5951fd71e47e74ff4/users/7c22aed60dfa4ea58b1da7ed422acea1/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:23.705659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ce889-cc79-41cd-8a62-9c1540b0890c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b39ab1ff5e4ec5951fd71e47e74ff4, user_id=7c22aed60dfa4ea58b1da7ed422acea1, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:23.709436 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ce889-cc79-41cd-8a62-9c1540b0890c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:23.726279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1362/2705] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:23 2021] PUT /identity/v3/projects/64b39ab1ff5e4ec5951fd71e47e74ff4/users/7c22aed60dfa4ea58b1da7ed422acea1/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:23.730556 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b23e9a-e54c-4815-ac4d-58dc76ebb80e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:23.741101 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b23e9a-e54c-4815-ac4d-58dc76ebb80e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:23.798542 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cba55-73a3-4ad1-b555-199a29659ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:23.799363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cba55-73a3-4ad1-b555-199a29659ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:23.799734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cba55-73a3-4ad1-b555-199a29659ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:23.800082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cba55-73a3-4ad1-b555-199a29659ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:23.801181 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cba55-73a3-4ad1-b555-199a29659ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:23.803382 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cba55-73a3-4ad1-b555-199a29659ae2 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:23.821205 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1344/2706] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:23 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:23.824046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ce889-cc79-41cd-8a62-9c1540b0890c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:23.835088 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ce889-cc79-41cd-8a62-9c1540b0890c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:23.840950 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eb90b-3bb8-448d-acb8-9a4d3780d3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:23.841858 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb90b-3bb8-448d-acb8-9a4d3780d3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:23.842137 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb90b-3bb8-448d-acb8-9a4d3780d3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:23.842422 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb90b-3bb8-448d-acb8-9a4d3780d3b2 admin admin] PATH_INFO: `/v3/projects/64b39ab1ff5e4ec5951fd71e47e74ff4/users/7c22aed60dfa4ea58b1da7ed422acea1/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:23.844643 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eb90b-3bb8-448d-acb8-9a4d3780d3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b39ab1ff5e4ec5951fd71e47e74ff4, user_id=7c22aed60dfa4ea58b1da7ed422acea1, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:23.847379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eb90b-3bb8-448d-acb8-9a4d3780d3b2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:23.859130 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1363/2707] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:23 2021] PUT /identity/v3/projects/64b39ab1ff5e4ec5951fd71e47e74ff4/users/7c22aed60dfa4ea58b1da7ed422acea1/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:23.869773 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348c55f-6f60-4204-b698-0b03120df6a0 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:23.870068 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348c55f-6f60-4204-b698-0b03120df6a0 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:23.870378 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348c55f-6f60-4204-b698-0b03120df6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:23.897415 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-8348c55f-6f60-4204-b698-0b03120df6a0 None None] MFA Rules not processed for user `7c22aed60dfa4ea58b1da7ed422acea1`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:23.898623 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8348c55f-6f60-4204-b698-0b03120df6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:23.966976 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1345/2708] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:23 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:23.977281 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eb90b-3bb8-448d-acb8-9a4d3780d3b2 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:23.979171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-d79eb90b-3bb8-448d-acb8-9a4d3780d3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:24.039393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eb90b-3bb8-448d-acb8-9a4d3780d3b2 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:24.043088 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83385a16-57ae-4070-a7d1-3820fb07c48e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:24.043769 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83385a16-57ae-4070-a7d1-3820fb07c48e service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:24.044048 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83385a16-57ae-4070-a7d1-3820fb07c48e service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:24.044342 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83385a16-57ae-4070-a7d1-3820fb07c48e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:24.103770 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83385a16-57ae-4070-a7d1-3820fb07c48e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:24.105561 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83385a16-57ae-4070-a7d1-3820fb07c48e service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:24.114993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1364/2709] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:23 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:25.813670 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348c55f-6f60-4204-b698-0b03120df6a0 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:25.815295 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-8348c55f-6f60-4204-b698-0b03120df6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:25.911493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348c55f-6f60-4204-b698-0b03120df6a0 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:25.917015 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572000da-3c70-4f88-a4e4-7cf5dc5f7a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:25.917806 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572000da-3c70-4f88-a4e4-7cf5dc5f7a40 service nova] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:25.918086 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572000da-3c70-4f88-a4e4-7cf5dc5f7a40 service nova] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:25.918361 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572000da-3c70-4f88-a4e4-7cf5dc5f7a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:25.920200 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-572000da-3c70-4f88-a4e4-7cf5dc5f7a40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:25.934985 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572000da-3c70-4f88-a4e4-7cf5dc5f7a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:25.936621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572000da-3c70-4f88-a4e4-7cf5dc5f7a40 service nova] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:25.948446 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1346/2710] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:25 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:28.294223 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83385a16-57ae-4070-a7d1-3820fb07c48e service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:28.295619 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-83385a16-57ae-4070-a7d1-3820fb07c48e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:28.306765 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83385a16-57ae-4070-a7d1-3820fb07c48e service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:28.310522 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8acda9-c54f-4ad0-8cfa-10196c90b20b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:28.311356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8acda9-c54f-4ad0-8cfa-10196c90b20b service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:28.311645 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8acda9-c54f-4ad0-8cfa-10196c90b20b service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:28.311917 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8acda9-c54f-4ad0-8cfa-10196c90b20b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:28.321101 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8acda9-c54f-4ad0-8cfa-10196c90b20b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:28.322534 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8acda9-c54f-4ad0-8cfa-10196c90b20b service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:28.332265 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1365/2711] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:28 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:33.205903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572000da-3c70-4f88-a4e4-7cf5dc5f7a40 service nova] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:33.277624 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572000da-3c70-4f88-a4e4-7cf5dc5f7a40 service nova] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:33.282271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec603da-86c0-4692-8c84-4306dc6d1276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:33.283168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec603da-86c0-4692-8c84-4306dc6d1276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:33.283461 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec603da-86c0-4692-8c84-4306dc6d1276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:33.283757 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec603da-86c0-4692-8c84-4306dc6d1276 admin admin] PATH_INFO: `/v3/users/56f9bce7a9094a298b8203d0438f1cb5` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:33.284986 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec603da-86c0-4692-8c84-4306dc6d1276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f9bce7a9094a298b8203d0438f1cb5)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:33.286934 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec603da-86c0-4692-8c84-4306dc6d1276 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:33.337905 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9ec603da-86c0-4692-8c84-4306dc6d1276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f9bce7a9094a298b8203d0438f1cb5'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:33.338629 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9ec603da-86c0-4692-8c84-4306dc6d1276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f9bce7a9094a298b8203d0438f1cb5'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:33.347229 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9ec603da-86c0-4692-8c84-4306dc6d1276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f9bce7a9094a298b8203d0438f1cb5'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:33.347946 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9ec603da-86c0-4692-8c84-4306dc6d1276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f9bce7a9094a298b8203d0438f1cb5'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:33.355349 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9ec603da-86c0-4692-8c84-4306dc6d1276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f9bce7a9094a298b8203d0438f1cb5'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:33.371728 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1347/2712] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:36:33 2021] DELETE /identity/v3/users/56f9bce7a9094a298b8203d0438f1cb5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:33.376448 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b2df-bfae-4c36-b3cf-37c19b956ed8 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:33.376958 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b2df-bfae-4c36-b3cf-37c19b956ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:33.377051 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b2df-bfae-4c36-b3cf-37c19b956ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:33.395220 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-7639b2df-bfae-4c36-b3cf-37c19b956ed8 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:33.396377 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7639b2df-bfae-4c36-b3cf-37c19b956ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:33.465353 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1366/2713] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:33.475634 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec603da-86c0-4692-8c84-4306dc6d1276 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:33.477285 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9ec603da-86c0-4692-8c84-4306dc6d1276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:33.542940 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec603da-86c0-4692-8c84-4306dc6d1276 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:33.547516 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680301f-2e81-4e34-98ba-782d10924718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:33.548166 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680301f-2e81-4e34-98ba-782d10924718 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:33.548446 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680301f-2e81-4e34-98ba-782d10924718 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:33.548715 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680301f-2e81-4e34-98ba-782d10924718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:33.558833 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680301f-2e81-4e34-98ba-782d10924718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:33.560392 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680301f-2e81-4e34-98ba-782d10924718 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:33.573754 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1348/2714] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:33.846001 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639b2df-bfae-4c36-b3cf-37c19b956ed8 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:33.847681 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7639b2df-bfae-4c36-b3cf-37c19b956ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:33.861385 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639b2df-bfae-4c36-b3cf-37c19b956ed8 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:33.869419 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:33.870941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:33.871256 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:33.871537 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] PATH_INFO: `/v3/projects/e060fad626ea4e85afedfa912bb73d93` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:33.872878 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e060fad626ea4e85afedfa912bb73d93)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:33.874808 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:33.928246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e060fad626ea4e85afedfa912bb73d93', 'request_id': 'req-9fa55d87-2c94-45d9-aea2-9f542db418bc'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:33.935084 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e060fad626ea4e85afedfa912bb73d93', 'request_id': 'req-9fa55d87-2c94-45d9-aea2-9f542db418bc'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:33.940593 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e060fad626ea4e85afedfa912bb73d93', 'request_id': 'req-9fa55d87-2c94-45d9-aea2-9f542db418bc'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:33.956098 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] The token cache is being invalidate because project e060fad626ea4e85afedfa912bb73d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:36:33.956393 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:33.957090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:33.959174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1367/2715] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:36:33 2021] DELETE /identity/v3/projects/e060fad626ea4e85afedfa912bb73d93 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:36:33.963350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680301f-2e81-4e34-98ba-782d10924718 service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:33.973404 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680301f-2e81-4e34-98ba-782d10924718 service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:34.039962 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411051ce-987b-4fb9-a53d-5d04ed48bf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:34.041199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411051ce-987b-4fb9-a53d-5d04ed48bf7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:34.041614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411051ce-987b-4fb9-a53d-5d04ed48bf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:34.043980 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411051ce-987b-4fb9-a53d-5d04ed48bf7a admin admin] PATH_INFO: `/v3/users/7c22aed60dfa4ea58b1da7ed422acea1` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:34.045309 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411051ce-987b-4fb9-a53d-5d04ed48bf7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c22aed60dfa4ea58b1da7ed422acea1)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:34.047276 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411051ce-987b-4fb9-a53d-5d04ed48bf7a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:34.112372 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-411051ce-987b-4fb9-a53d-5d04ed48bf7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c22aed60dfa4ea58b1da7ed422acea1'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:34.113041 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-411051ce-987b-4fb9-a53d-5d04ed48bf7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c22aed60dfa4ea58b1da7ed422acea1'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:34.121812 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-411051ce-987b-4fb9-a53d-5d04ed48bf7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c22aed60dfa4ea58b1da7ed422acea1'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:34.122538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-411051ce-987b-4fb9-a53d-5d04ed48bf7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c22aed60dfa4ea58b1da7ed422acea1'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:34.130108 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-411051ce-987b-4fb9-a53d-5d04ed48bf7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c22aed60dfa4ea58b1da7ed422acea1'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:34.146990 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1349/2716] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:36:33 2021] DELETE /identity/v3/users/7c22aed60dfa4ea58b1da7ed422acea1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:36:34.428825 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:34.430458 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:34.445090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa55d87-2c94-45d9-aea2-9f542db418bc admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:34.505189 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:34.506058 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:34.506339 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:34.506614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] PATH_INFO: `/v3/projects/64b39ab1ff5e4ec5951fd71e47e74ff4` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:34.507984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b39ab1ff5e4ec5951fd71e47e74ff4)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:34.509952 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:34.559837 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b39ab1ff5e4ec5951fd71e47e74ff4', 'request_id': 'req-1c9242fc-9c76-436e-bf20-33b8759a298e'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:34.565984 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b39ab1ff5e4ec5951fd71e47e74ff4', 'request_id': 'req-1c9242fc-9c76-436e-bf20-33b8759a298e'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:34.571634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b39ab1ff5e4ec5951fd71e47e74ff4', 'request_id': 'req-1c9242fc-9c76-436e-bf20-33b8759a298e'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:34.586577 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] The token cache is being invalidate because project 64b39ab1ff5e4ec5951fd71e47e74ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:36:34.586852 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:34.587532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:34.589494 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1368/2717] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:36:34 2021] DELETE /identity/v3/projects/64b39ab1ff5e4ec5951fd71e47e74ff4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:37.720422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411051ce-987b-4fb9-a53d-5d04ed48bf7a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:37.722060 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-411051ce-987b-4fb9-a53d-5d04ed48bf7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:37.780862 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411051ce-987b-4fb9-a53d-5d04ed48bf7a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:37.836601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42e8ec-33cb-4bb3-b74e-dbd369ff32de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:37.837234 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42e8ec-33cb-4bb3-b74e-dbd369ff32de service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:37.837513 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42e8ec-33cb-4bb3-b74e-dbd369ff32de service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:37.837780 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42e8ec-33cb-4bb3-b74e-dbd369ff32de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:37.839956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-7f42e8ec-33cb-4bb3-b74e-dbd369ff32de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:37.906335 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42e8ec-33cb-4bb3-b74e-dbd369ff32de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:37.907751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42e8ec-33cb-4bb3-b74e-dbd369ff32de service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:37.917353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1350/2718] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:37 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:39.562247 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:39.564731 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:39.646754 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9242fc-9c76-436e-bf20-33b8759a298e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:39.653515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf91a52-10f3-4a5b-a24f-ca90b0cf3b75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3421cf1bbb24423a2f24c4667adfdda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:39.654351 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf91a52-10f3-4a5b-a24f-ca90b0cf3b75 service nova] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:39.654976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf91a52-10f3-4a5b-a24f-ca90b0cf3b75 service nova] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:39.655235 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf91a52-10f3-4a5b-a24f-ca90b0cf3b75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:39.657703 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-4cf91a52-10f3-4a5b-a24f-ca90b0cf3b75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:39.690920 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf91a52-10f3-4a5b-a24f-ca90b0cf3b75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:39.693329 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf91a52-10f3-4a5b-a24f-ca90b0cf3b75 service nova] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:39.708434 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1369/2719] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:46.182765 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42e8ec-33cb-4bb3-b74e-dbd369ff32de service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:46.184950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-7f42e8ec-33cb-4bb3-b74e-dbd369ff32de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:46.257522 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42e8ec-33cb-4bb3-b74e-dbd369ff32de service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:46.263075 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef8479-bd2a-4225-b689-4af62334a8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:46.263992 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef8479-bd2a-4225-b689-4af62334a8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:46.264267 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef8479-bd2a-4225-b689-4af62334a8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:46.264533 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef8479-bd2a-4225-b689-4af62334a8ee admin admin] PATH_INFO: `/v3/users/9db81f69de554ed5994ee3f34484349e` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:46.278259 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef8479-bd2a-4225-b689-4af62334a8ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db81f69de554ed5994ee3f34484349e)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:46.280381 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef8479-bd2a-4225-b689-4af62334a8ee admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:46.333909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9fef8479-bd2a-4225-b689-4af62334a8ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db81f69de554ed5994ee3f34484349e'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:46.334603 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9fef8479-bd2a-4225-b689-4af62334a8ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db81f69de554ed5994ee3f34484349e'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:46.345649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9fef8479-bd2a-4225-b689-4af62334a8ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db81f69de554ed5994ee3f34484349e'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:46.346303 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9fef8479-bd2a-4225-b689-4af62334a8ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db81f69de554ed5994ee3f34484349e'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:46.353969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-9fef8479-bd2a-4225-b689-4af62334a8ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db81f69de554ed5994ee3f34484349e'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:46.372601 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1351/2720] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:36:46 2021] DELETE /identity/v3/users/9db81f69de554ed5994ee3f34484349e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:46.378901 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1db3d-b6ea-452e-9ae2-5b3c3508db33 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:46.379386 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1db3d-b6ea-452e-9ae2-5b3c3508db33 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:46.379499 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1db3d-b6ea-452e-9ae2-5b3c3508db33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:46.398558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-bad1db3d-b6ea-452e-9ae2-5b3c3508db33 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:46.399787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-bad1db3d-b6ea-452e-9ae2-5b3c3508db33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:46.471895 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1370/2721] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:36:46.485222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef8479-bd2a-4225-b689-4af62334a8ee admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:46.486964 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-9fef8479-bd2a-4225-b689-4af62334a8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:46.545983 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef8479-bd2a-4225-b689-4af62334a8ee admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:46.550362 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79204b7b-ca48-4938-9d5f-199bbd35e30f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:46.551009 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79204b7b-ca48-4938-9d5f-199bbd35e30f service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:46.551324 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79204b7b-ca48-4938-9d5f-199bbd35e30f service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:46.551591 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79204b7b-ca48-4938-9d5f-199bbd35e30f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:46.561227 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79204b7b-ca48-4938-9d5f-199bbd35e30f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:46.562684 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79204b7b-ca48-4938-9d5f-199bbd35e30f service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:46.572242 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1352/2722] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:46.851251 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1db3d-b6ea-452e-9ae2-5b3c3508db33 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:46.852844 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-bad1db3d-b6ea-452e-9ae2-5b3c3508db33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:46.865675 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1db3d-b6ea-452e-9ae2-5b3c3508db33 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:46.870431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86a89f-c1d5-4be9-8c11-878adb139c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:46.871368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86a89f-c1d5-4be9-8c11-878adb139c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:46.871678 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86a89f-c1d5-4be9-8c11-878adb139c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:46.872011 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86a89f-c1d5-4be9-8c11-878adb139c8d admin admin] PATH_INFO: `/v3/projects/586abeee12474f569b3056e97e1371db` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:46.883488 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86a89f-c1d5-4be9-8c11-878adb139c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=586abeee12474f569b3056e97e1371db)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:46.885429 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86a89f-c1d5-4be9-8c11-878adb139c8d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:46.933764 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-0c86a89f-c1d5-4be9-8c11-878adb139c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586abeee12474f569b3056e97e1371db', 'request_id': 'req-0c86a89f-c1d5-4be9-8c11-878adb139c8d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:46.940443 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-0c86a89f-c1d5-4be9-8c11-878adb139c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586abeee12474f569b3056e97e1371db', 'request_id': 'req-0c86a89f-c1d5-4be9-8c11-878adb139c8d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:46.945956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-0c86a89f-c1d5-4be9-8c11-878adb139c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586abeee12474f569b3056e97e1371db', 'request_id': 'req-0c86a89f-c1d5-4be9-8c11-878adb139c8d'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:46.960212 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-0c86a89f-c1d5-4be9-8c11-878adb139c8d admin admin] The token cache is being invalidate because project 586abeee12474f569b3056e97e1371db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:36:46.960496 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-0c86a89f-c1d5-4be9-8c11-878adb139c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:46.961131 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-0c86a89f-c1d5-4be9-8c11-878adb139c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:36:46.962729 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1371/2723] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:36:46 2021] DELETE /identity/v3/projects/586abeee12474f569b3056e97e1371db => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:46.969484 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7cd9-615b-4c41-9496-1762f22b7dbc None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:46.969859 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7cd9-615b-4c41-9496-1762f22b7dbc None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:46.970138 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7cd9-615b-4c41-9496-1762f22b7dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:46.989299 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-3d4d7cd9-615b-4c41-9496-1762f22b7dbc None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:46.990608 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3d4d7cd9-615b-4c41-9496-1762f22b7dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:47.059767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1353/2724] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:47.068109 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed06-7c20-4fa7-89d7-9bb4bc2ff770 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:47.068399 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed06-7c20-4fa7-89d7-9bb4bc2ff770 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:47.068681 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed06-7c20-4fa7-89d7-9bb4bc2ff770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:47.091721 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-e5a5ed06-7c20-4fa7-89d7-9bb4bc2ff770 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:47.092956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e5a5ed06-7c20-4fa7-89d7-9bb4bc2ff770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:47.101781 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1372/2725] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:47.106820 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7cd9-615b-4c41-9496-1762f22b7dbc None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:47.121611 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7cd9-615b-4c41-9496-1762f22b7dbc None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:47.127154 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e2c87-cada-4f34-b82d-f6c45d932b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:47.127807 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2c87-cada-4f34-b82d-f6c45d932b4e admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:47.128455 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2c87-cada-4f34-b82d-f6c45d932b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:47.128724 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2c87-cada-4f34-b82d-f6c45d932b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:47.129463 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e2c87-cada-4f34-b82d-f6c45d932b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:36:47.129766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e2c87-cada-4f34-b82d-f6c45d932b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:47.131388 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e2c87-cada-4f34-b82d-f6c45d932b4e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:47.144812 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1354/2726] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:36:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:36:47.151779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5ed06-7c20-4fa7-89d7-9bb4bc2ff770 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:47.161710 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5ed06-7c20-4fa7-89d7-9bb4bc2ff770 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:47.167069 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b087c-732f-4265-ad3f-9a4b906cf173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:47.167945 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b087c-732f-4265-ad3f-9a4b906cf173 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:47.168267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b087c-732f-4265-ad3f-9a4b906cf173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:47.168548 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b087c-732f-4265-ad3f-9a4b906cf173 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:47.169263 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b087c-732f-4265-ad3f-9a4b906cf173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:47.171211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b087c-732f-4265-ad3f-9a4b906cf173 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:47.202171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1373/2727] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:36:47 2021] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:47.208877 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e2c87-cada-4f34-b82d-f6c45d932b4e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:47.221464 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e2c87-cada-4f34-b82d-f6c45d932b4e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:47.298496 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526731c-90d5-405f-afb7-14fb99d921a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:47.299161 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526731c-90d5-405f-afb7-14fb99d921a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:47.299492 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526731c-90d5-405f-afb7-14fb99d921a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:47.299773 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526731c-90d5-405f-afb7-14fb99d921a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:47.300474 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526731c-90d5-405f-afb7-14fb99d921a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:47.302403 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526731c-90d5-405f-afb7-14fb99d921a5 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:47.325643 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1355/2728] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:36:47 2021] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:36:47.330133 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b087c-732f-4265-ad3f-9a4b906cf173 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:47.340822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b087c-732f-4265-ad3f-9a4b906cf173 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:47.346648 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bff6c6-5ebe-4206-8049-d4ba010aa9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:47.347341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bff6c6-5ebe-4206-8049-d4ba010aa9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:47.347622 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bff6c6-5ebe-4206-8049-d4ba010aa9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:47.347892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bff6c6-5ebe-4206-8049-d4ba010aa9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:47.348632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bff6c6-5ebe-4206-8049-d4ba010aa9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:47.350240 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bff6c6-5ebe-4206-8049-d4ba010aa9b6 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:47.361700 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1374/2729] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:47 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:47.365828 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526731c-90d5-405f-afb7-14fb99d921a5 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:47.376517 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526731c-90d5-405f-afb7-14fb99d921a5 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:47.382214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf9e4e-cd10-47ae-9adc-4c51fdde1bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:47.382869 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9e4e-cd10-47ae-9adc-4c51fdde1bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:47.383162 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9e4e-cd10-47ae-9adc-4c51fdde1bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:47.383454 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9e4e-cd10-47ae-9adc-4c51fdde1bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:47.384197 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf9e4e-cd10-47ae-9adc-4c51fdde1bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:47.385783 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf9e4e-cd10-47ae-9adc-4c51fdde1bd7 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:47.395908 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1356/2730] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:47.400093 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bff6c6-5ebe-4206-8049-d4ba010aa9b6 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:47.410612 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bff6c6-5ebe-4206-8049-d4ba010aa9b6 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:47.416248 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdea5fb-f137-4967-891b-381792c3a0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:47.417155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdea5fb-f137-4967-891b-381792c3a0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:47.417431 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdea5fb-f137-4967-891b-381792c3a0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:47.417818 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdea5fb-f137-4967-891b-381792c3a0a4 admin admin] PATH_INFO: `/v3/projects/0b221eab180b49639113b39ffc6c6aed/users/b2e6b279d41a4aff9f08276a884f194f/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:47.433782 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdea5fb-f137-4967-891b-381792c3a0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b221eab180b49639113b39ffc6c6aed, user_id=b2e6b279d41a4aff9f08276a884f194f, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:47.436966 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdea5fb-f137-4967-891b-381792c3a0a4 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:47.451603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1375/2731] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:47 2021] PUT /identity/v3/projects/0b221eab180b49639113b39ffc6c6aed/users/b2e6b279d41a4aff9f08276a884f194f/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:36:47.466532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356c57e-a9d6-48f1-a460-9695b98e0df3 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:47.466860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356c57e-a9d6-48f1-a460-9695b98e0df3 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:47.467213 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356c57e-a9d6-48f1-a460-9695b98e0df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:47.495366 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-5356c57e-a9d6-48f1-a460-9695b98e0df3 None None] MFA Rules not processed for user `b2e6b279d41a4aff9f08276a884f194f`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:47.496562 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-5356c57e-a9d6-48f1-a460-9695b98e0df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:47.561233 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1357/2732] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:47 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:47.566024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdea5fb-f137-4967-891b-381792c3a0a4 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:47.634910 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdea5fb-f137-4967-891b-381792c3a0a4 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:47.640799 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bc3b1-5de9-41a4-9b7d-f85181b4c8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:47.641456 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bc3b1-5de9-41a4-9b7d-f85181b4c8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:47.641737 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bc3b1-5de9-41a4-9b7d-f85181b4c8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:47.642007 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bc3b1-5de9-41a4-9b7d-f85181b4c8f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:47.642728 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34bc3b1-5de9-41a4-9b7d-f85181b4c8f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:47.644643 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34bc3b1-5de9-41a4-9b7d-f85181b4c8f5 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:47.675211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1376/2733] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:36:47 2021] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:47.680173 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356c57e-a9d6-48f1-a460-9695b98e0df3 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:47.691886 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356c57e-a9d6-48f1-a460-9695b98e0df3 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:47.750540 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bbd1a-1791-4d51-ba7c-9cc4f5333e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:47.751148 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bbd1a-1791-4d51-ba7c-9cc4f5333e83 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:47.751505 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bbd1a-1791-4d51-ba7c-9cc4f5333e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:47.751770 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bbd1a-1791-4d51-ba7c-9cc4f5333e83 admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:47.752498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bbd1a-1791-4d51-ba7c-9cc4f5333e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:47.754791 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bbd1a-1791-4d51-ba7c-9cc4f5333e83 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:47.776536 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1358/2734] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:36:47 2021] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:36:47.781122 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bc3b1-5de9-41a4-9b7d-f85181b4c8f5 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:47.791172 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bc3b1-5de9-41a4-9b7d-f85181b4c8f5 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:47.795892 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087b094-57ba-4ab9-98ed-cd51d2696b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:47.796542 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087b094-57ba-4ab9-98ed-cd51d2696b38 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:47.796823 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087b094-57ba-4ab9-98ed-cd51d2696b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:47.797097 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087b094-57ba-4ab9-98ed-cd51d2696b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:47.797831 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087b094-57ba-4ab9-98ed-cd51d2696b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:47.799466 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087b094-57ba-4ab9-98ed-cd51d2696b38 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:47.809967 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1377/2735] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:47.814085 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bbd1a-1791-4d51-ba7c-9cc4f5333e83 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:47.824369 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bbd1a-1791-4d51-ba7c-9cc4f5333e83 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:47.829540 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e3286-20ed-4b4b-a1ed-9e65da3a331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:47.830417 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3286-20ed-4b4b-a1ed-9e65da3a331d admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:47.830699 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3286-20ed-4b4b-a1ed-9e65da3a331d admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:47.830974 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3286-20ed-4b4b-a1ed-9e65da3a331d admin admin] PATH_INFO: `/v3/projects/22a91f7904ed47269faf4ae6190e197f/users/c7e80c5fae2c4a4789b5cc89d1974e52/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:47.846317 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e3286-20ed-4b4b-a1ed-9e65da3a331d admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a91f7904ed47269faf4ae6190e197f, user_id=c7e80c5fae2c4a4789b5cc89d1974e52, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:47.849026 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e3286-20ed-4b4b-a1ed-9e65da3a331d admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:47.867410 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1359/2736] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:47 2021] PUT /identity/v3/projects/22a91f7904ed47269faf4ae6190e197f/users/c7e80c5fae2c4a4789b5cc89d1974e52/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:47.871676 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087b094-57ba-4ab9-98ed-cd51d2696b38 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:47.881992 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087b094-57ba-4ab9-98ed-cd51d2696b38 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:47.940586 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f4fa6-614c-4312-b801-51d79053a30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:47.941254 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4fa6-614c-4312-b801-51d79053a30d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:47.941534 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4fa6-614c-4312-b801-51d79053a30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:47.941805 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4fa6-614c-4312-b801-51d79053a30d admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:47.942532 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f4fa6-614c-4312-b801-51d79053a30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:47.944202 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f4fa6-614c-4312-b801-51d79053a30d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:47.954619 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1378/2737] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:36:47 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:36:47.959538 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e3286-20ed-4b4b-a1ed-9e65da3a331d admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:47.972592 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e3286-20ed-4b4b-a1ed-9e65da3a331d admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:47.978393 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e83039-0c94-4dcb-b7ab-0d8b0a4d80fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:47.979331 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e83039-0c94-4dcb-b7ab-0d8b0a4d80fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:47.979615 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e83039-0c94-4dcb-b7ab-0d8b0a4d80fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:47.979889 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e83039-0c94-4dcb-b7ab-0d8b0a4d80fd admin admin] PATH_INFO: `/v3/projects/22a91f7904ed47269faf4ae6190e197f/users/c7e80c5fae2c4a4789b5cc89d1974e52/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:47.982353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e83039-0c94-4dcb-b7ab-0d8b0a4d80fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a91f7904ed47269faf4ae6190e197f, user_id=c7e80c5fae2c4a4789b5cc89d1974e52, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:47.985081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e83039-0c94-4dcb-b7ab-0d8b0a4d80fd admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:47.996587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1360/2738] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:36:47 2021] PUT /identity/v3/projects/22a91f7904ed47269faf4ae6190e197f/users/c7e80c5fae2c4a4789b5cc89d1974e52/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:36:48.007587 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ae3f9-ed16-4606-8772-485825a15e36 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:48.007876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ae3f9-ed16-4606-8772-485825a15e36 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:48.008213 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ae3f9-ed16-4606-8772-485825a15e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:48.037862 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-3a4ae3f9-ed16-4606-8772-485825a15e36 None None] MFA Rules not processed for user `c7e80c5fae2c4a4789b5cc89d1974e52`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:36:48.039209 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-3a4ae3f9-ed16-4606-8772-485825a15e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:48.117366 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1379/2739] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:36:48 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:36:48.129003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e83039-0c94-4dcb-b7ab-0d8b0a4d80fd admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:48.130786 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-f3e83039-0c94-4dcb-b7ab-0d8b0a4d80fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:36:48.193570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e83039-0c94-4dcb-b7ab-0d8b0a4d80fd admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:48.200631 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c15a8-eb86-4148-9ae2-787fc27a710d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:48.201284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c15a8-eb86-4148-9ae2-787fc27a710d service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:48.201564 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c15a8-eb86-4148-9ae2-787fc27a710d service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:48.201841 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c15a8-eb86-4148-9ae2-787fc27a710d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:48.213704 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c15a8-eb86-4148-9ae2-787fc27a710d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:48.216134 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c15a8-eb86-4148-9ae2-787fc27a710d service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:48.229180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1361/2740] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:48 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:36:48.313807 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ae3f9-ed16-4606-8772-485825a15e36 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:36:48.327174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ae3f9-ed16-4606-8772-485825a15e36 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:36:48.331856 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3887f-a79c-452a-aa58-e542095e51cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:36:48.332555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3887f-a79c-452a-aa58-e542095e51cf service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:36:48.332855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3887f-a79c-452a-aa58-e542095e51cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:36:48.333406 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3887f-a79c-452a-aa58-e542095e51cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:36:48.396421 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3887f-a79c-452a-aa58-e542095e51cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:36:48.397879 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3887f-a79c-452a-aa58-e542095e51cf service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:36:48.407443 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1380/2741] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:36:48 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:37:29.975970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c15a8-eb86-4148-9ae2-787fc27a710d service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:30.042002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c15a8-eb86-4148-9ae2-787fc27a710d service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:30.047561 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d52c0-8bf1-4592-8da3-1ad8aa58128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:30.048438 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d52c0-8bf1-4592-8da3-1ad8aa58128e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:30.048721 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d52c0-8bf1-4592-8da3-1ad8aa58128e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:30.048998 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d52c0-8bf1-4592-8da3-1ad8aa58128e admin admin] PATH_INFO: `/v3/users/b2e6b279d41a4aff9f08276a884f194f` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:30.050365 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d52c0-8bf1-4592-8da3-1ad8aa58128e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e6b279d41a4aff9f08276a884f194f)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:30.052412 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d52c0-8bf1-4592-8da3-1ad8aa58128e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:30.102646 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d35d52c0-8bf1-4592-8da3-1ad8aa58128e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e6b279d41a4aff9f08276a884f194f'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.103415 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d35d52c0-8bf1-4592-8da3-1ad8aa58128e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e6b279d41a4aff9f08276a884f194f'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.112604 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d35d52c0-8bf1-4592-8da3-1ad8aa58128e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e6b279d41a4aff9f08276a884f194f'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.113192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d35d52c0-8bf1-4592-8da3-1ad8aa58128e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e6b279d41a4aff9f08276a884f194f'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.120026 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d35d52c0-8bf1-4592-8da3-1ad8aa58128e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e6b279d41a4aff9f08276a884f194f'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.137246 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1362/2742] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:37:29 2021] DELETE /identity/v3/users/b2e6b279d41a4aff9f08276a884f194f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:30.142819 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f913bc-f4bc-4ee3-837c-3c6b1ffdf9dd None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:30.143348 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f913bc-f4bc-4ee3-837c-3c6b1ffdf9dd None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:30.143460 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f913bc-f4bc-4ee3-837c-3c6b1ffdf9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:30.165876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-00f913bc-f4bc-4ee3-837c-3c6b1ffdf9dd None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:30.167112 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-00f913bc-f4bc-4ee3-837c-3c6b1ffdf9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:30.232295 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1381/2743] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:30.245002 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d52c0-8bf1-4592-8da3-1ad8aa58128e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:30.246609 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d35d52c0-8bf1-4592-8da3-1ad8aa58128e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:30.318026 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d52c0-8bf1-4592-8da3-1ad8aa58128e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:30.322359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b198-4089-477a-8c09-d06afa7f120b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:30.323011 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b198-4089-477a-8c09-d06afa7f120b service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:30.323326 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b198-4089-477a-8c09-d06afa7f120b service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:30.323600 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b198-4089-477a-8c09-d06afa7f120b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:30.338380 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7b198-4089-477a-8c09-d06afa7f120b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:30.340569 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7b198-4089-477a-8c09-d06afa7f120b service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:30.352919 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1363/2744] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:37:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:37:30.630042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f913bc-f4bc-4ee3-837c-3c6b1ffdf9dd None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:30.631534 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-00f913bc-f4bc-4ee3-837c-3c6b1ffdf9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:30.643725 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f913bc-f4bc-4ee3-837c-3c6b1ffdf9dd None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:30.654631 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:30.655551 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:30.655834 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:30.656170 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] PATH_INFO: `/v3/projects/0b221eab180b49639113b39ffc6c6aed` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:30.657898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b221eab180b49639113b39ffc6c6aed)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:30.663523 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:30.710346 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b221eab180b49639113b39ffc6c6aed', 'request_id': 'req-7a24aec8-2eb1-412d-9225-78a7c757efc9'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.716390 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b221eab180b49639113b39ffc6c6aed', 'request_id': 'req-7a24aec8-2eb1-412d-9225-78a7c757efc9'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.722120 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b221eab180b49639113b39ffc6c6aed', 'request_id': 'req-7a24aec8-2eb1-412d-9225-78a7c757efc9'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.735056 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] The token cache is being invalidate because project 0b221eab180b49639113b39ffc6c6aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:37:30.735391 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.736013 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.737569 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1382/2745] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:37:30 2021] DELETE /identity/v3/projects/0b221eab180b49639113b39ffc6c6aed => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:30.741693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b198-4089-477a-8c09-d06afa7f120b service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:30.751363 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b198-4089-477a-8c09-d06afa7f120b service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:30.809361 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9383b-86b9-40b4-9d96-6a069680c1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:30.810223 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9383b-86b9-40b4-9d96-6a069680c1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:30.810502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9383b-86b9-40b4-9d96-6a069680c1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:30.810769 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9383b-86b9-40b4-9d96-6a069680c1cf admin admin] PATH_INFO: `/v3/users/c7e80c5fae2c4a4789b5cc89d1974e52` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:30.812095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9383b-86b9-40b4-9d96-6a069680c1cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e80c5fae2c4a4789b5cc89d1974e52)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:30.814605 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9383b-86b9-40b4-9d96-6a069680c1cf admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:30.870558 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-72d9383b-86b9-40b4-9d96-6a069680c1cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e80c5fae2c4a4789b5cc89d1974e52'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.871388 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-72d9383b-86b9-40b4-9d96-6a069680c1cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e80c5fae2c4a4789b5cc89d1974e52'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.883063 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-72d9383b-86b9-40b4-9d96-6a069680c1cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e80c5fae2c4a4789b5cc89d1974e52'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.883723 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-72d9383b-86b9-40b4-9d96-6a069680c1cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e80c5fae2c4a4789b5cc89d1974e52'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.891144 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-72d9383b-86b9-40b4-9d96-6a069680c1cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e80c5fae2c4a4789b5cc89d1974e52'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:30.909283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1364/2746] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:37:30 2021] DELETE /identity/v3/users/c7e80c5fae2c4a4789b5cc89d1974e52 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:31.197592 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:31.199414 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:31.214267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24aec8-2eb1-412d-9225-78a7c757efc9 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:31.276417 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeca0ae-91fb-410f-9342-8daa25a0dce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:31.277288 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca0ae-91fb-410f-9342-8daa25a0dce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:31.277567 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca0ae-91fb-410f-9342-8daa25a0dce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:31.277841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca0ae-91fb-410f-9342-8daa25a0dce8 admin admin] PATH_INFO: `/v3/projects/22a91f7904ed47269faf4ae6190e197f` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:31.279076 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeca0ae-91fb-410f-9342-8daa25a0dce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a91f7904ed47269faf4ae6190e197f)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:31.281168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeca0ae-91fb-410f-9342-8daa25a0dce8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:31.329518 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-aaeca0ae-91fb-410f-9342-8daa25a0dce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a91f7904ed47269faf4ae6190e197f', 'request_id': 'req-aaeca0ae-91fb-410f-9342-8daa25a0dce8'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:31.335499 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-aaeca0ae-91fb-410f-9342-8daa25a0dce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a91f7904ed47269faf4ae6190e197f', 'request_id': 'req-aaeca0ae-91fb-410f-9342-8daa25a0dce8'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:31.341102 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-aaeca0ae-91fb-410f-9342-8daa25a0dce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a91f7904ed47269faf4ae6190e197f', 'request_id': 'req-aaeca0ae-91fb-410f-9342-8daa25a0dce8'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:31.355718 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-aaeca0ae-91fb-410f-9342-8daa25a0dce8 admin admin] The token cache is being invalidate because project 22a91f7904ed47269faf4ae6190e197f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:37:31.356000 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-aaeca0ae-91fb-410f-9342-8daa25a0dce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:31.356623 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-aaeca0ae-91fb-410f-9342-8daa25a0dce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:31.358180 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1383/2747] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:37:31 2021] DELETE /identity/v3/projects/22a91f7904ed47269faf4ae6190e197f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:31.364079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd10fa-7c3c-4c12-971d-f1d62b44df47 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:31.364580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd10fa-7c3c-4c12-971d-f1d62b44df47 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:31.364674 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd10fa-7c3c-4c12-971d-f1d62b44df47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:31.383287 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-70cd10fa-7c3c-4c12-971d-f1d62b44df47 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:31.384502 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-70cd10fa-7c3c-4c12-971d-f1d62b44df47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:31.451341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1365/2748] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:31.464024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621a796-83fe-45e5-8723-8e85adf048d7 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:31.464340 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621a796-83fe-45e5-8723-8e85adf048d7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:31.464619 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621a796-83fe-45e5-8723-8e85adf048d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:31.484459 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-2621a796-83fe-45e5-8723-8e85adf048d7 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:31.485795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-2621a796-83fe-45e5-8723-8e85adf048d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:31.494132 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1384/2749] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:31.498799 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd10fa-7c3c-4c12-971d-f1d62b44df47 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:31.509718 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd10fa-7c3c-4c12-971d-f1d62b44df47 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:31.515595 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7493af-75c1-4759-bb01-38e164038844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:31.516652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7493af-75c1-4759-bb01-38e164038844 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:31.516926 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7493af-75c1-4759-bb01-38e164038844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:31.517199 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7493af-75c1-4759-bb01-38e164038844 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:31.517950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7493af-75c1-4759-bb01-38e164038844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:37:31.518262 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7493af-75c1-4759-bb01-38e164038844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:31.519916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7493af-75c1-4759-bb01-38e164038844 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:31.532540 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1366/2750] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:37:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:37:31.537637 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621a796-83fe-45e5-8723-8e85adf048d7 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:31.547709 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621a796-83fe-45e5-8723-8e85adf048d7 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:31.552500 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e799d-6e6c-40b3-9eae-cd64595944aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:31.553157 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e799d-6e6c-40b3-9eae-cd64595944aa admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:31.553439 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e799d-6e6c-40b3-9eae-cd64595944aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:31.553716 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e799d-6e6c-40b3-9eae-cd64595944aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:31.554415 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e799d-6e6c-40b3-9eae-cd64595944aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:31.556346 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e799d-6e6c-40b3-9eae-cd64595944aa admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:31.583427 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1385/2751] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:37:31 2021] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:37:31.587687 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7493af-75c1-4759-bb01-38e164038844 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:31.598508 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7493af-75c1-4759-bb01-38e164038844 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:31.660816 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ac873-f00d-4369-995a-751227e2d39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:31.661489 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ac873-f00d-4369-995a-751227e2d39e admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:31.661728 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ac873-f00d-4369-995a-751227e2d39e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:31.662022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ac873-f00d-4369-995a-751227e2d39e admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:31.662760 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ac873-f00d-4369-995a-751227e2d39e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:31.664751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ac873-f00d-4369-995a-751227e2d39e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:31.687066 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1367/2752] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:37:31 2021] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:37:31.692045 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e799d-6e6c-40b3-9eae-cd64595944aa admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:31.706943 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e799d-6e6c-40b3-9eae-cd64595944aa admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:31.712939 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b3eda-8741-4bc5-a4b4-3c06e064823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:31.713675 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b3eda-8741-4bc5-a4b4-3c06e064823b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:31.713949 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b3eda-8741-4bc5-a4b4-3c06e064823b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:31.714216 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b3eda-8741-4bc5-a4b4-3c06e064823b admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:31.714959 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b3eda-8741-4bc5-a4b4-3c06e064823b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:31.716634 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b3eda-8741-4bc5-a4b4-3c06e064823b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:31.727793 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1386/2753] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:37:31 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:37:31.732082 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ac873-f00d-4369-995a-751227e2d39e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:31.742784 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ac873-f00d-4369-995a-751227e2d39e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:31.748529 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76928f5-9578-4dec-a908-8aa6b15e7ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:31.749191 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76928f5-9578-4dec-a908-8aa6b15e7ffb admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:31.749469 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76928f5-9578-4dec-a908-8aa6b15e7ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:31.749767 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76928f5-9578-4dec-a908-8aa6b15e7ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:31.750506 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76928f5-9578-4dec-a908-8aa6b15e7ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:31.752108 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76928f5-9578-4dec-a908-8aa6b15e7ffb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:31.762773 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1368/2754] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:37:31 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:37:31.768206 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b3eda-8741-4bc5-a4b4-3c06e064823b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:31.778735 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b3eda-8741-4bc5-a4b4-3c06e064823b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:31.785154 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa244c55-8119-4302-b66f-06e8eeb0e53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:31.786038 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa244c55-8119-4302-b66f-06e8eeb0e53c admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:31.786313 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa244c55-8119-4302-b66f-06e8eeb0e53c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:31.786586 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa244c55-8119-4302-b66f-06e8eeb0e53c admin admin] PATH_INFO: `/v3/projects/cc3b9dcb4d4d461f8323388fd19ef9e9/users/a8b6fd29c3f64596a1a61f472a802673/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:31.802780 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa244c55-8119-4302-b66f-06e8eeb0e53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3b9dcb4d4d461f8323388fd19ef9e9, user_id=a8b6fd29c3f64596a1a61f472a802673, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:31.805450 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa244c55-8119-4302-b66f-06e8eeb0e53c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:31.821180 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1387/2755] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:37:31 2021] PUT /identity/v3/projects/cc3b9dcb4d4d461f8323388fd19ef9e9/users/a8b6fd29c3f64596a1a61f472a802673/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:31.832747 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb481e-558c-437c-82de-b88d7960add7 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:31.833131 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb481e-558c-437c-82de-b88d7960add7 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:31.833504 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb481e-558c-437c-82de-b88d7960add7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:31.863627 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-afdb481e-558c-437c-82de-b88d7960add7 None None] MFA Rules not processed for user `a8b6fd29c3f64596a1a61f472a802673`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:31.864846 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-afdb481e-558c-437c-82de-b88d7960add7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:31.934397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1369/2756] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:31 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:31.945812 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa244c55-8119-4302-b66f-06e8eeb0e53c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:31.947735 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-aa244c55-8119-4302-b66f-06e8eeb0e53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:32.007861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa244c55-8119-4302-b66f-06e8eeb0e53c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:32.011986 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934fd47-bd49-4db6-9c73-b43c2c8fa752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:32.012624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934fd47-bd49-4db6-9c73-b43c2c8fa752 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:32.012903 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934fd47-bd49-4db6-9c73-b43c2c8fa752 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:32.013178 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934fd47-bd49-4db6-9c73-b43c2c8fa752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:32.022440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934fd47-bd49-4db6-9c73-b43c2c8fa752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:32.023956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934fd47-bd49-4db6-9c73-b43c2c8fa752 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:32.033197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1388/2757] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:37:31 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:37:40.557860 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb481e-558c-437c-82de-b88d7960add7 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:40.626999 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb481e-558c-437c-82de-b88d7960add7 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:40.632642 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501750f-1c66-4e9b-957b-77213f18dca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:40.633580 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501750f-1c66-4e9b-957b-77213f18dca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:40.633858 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501750f-1c66-4e9b-957b-77213f18dca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:40.634128 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501750f-1c66-4e9b-957b-77213f18dca4 admin admin] PATH_INFO: `/v3/users/a8b6fd29c3f64596a1a61f472a802673` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:40.635438 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501750f-1c66-4e9b-957b-77213f18dca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b6fd29c3f64596a1a61f472a802673)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:40.637356 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501750f-1c66-4e9b-957b-77213f18dca4 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:40.682881 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3501750f-1c66-4e9b-957b-77213f18dca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b6fd29c3f64596a1a61f472a802673'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:40.683700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3501750f-1c66-4e9b-957b-77213f18dca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b6fd29c3f64596a1a61f472a802673'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:40.693582 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3501750f-1c66-4e9b-957b-77213f18dca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b6fd29c3f64596a1a61f472a802673'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:40.694292 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3501750f-1c66-4e9b-957b-77213f18dca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b6fd29c3f64596a1a61f472a802673'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:40.702350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3501750f-1c66-4e9b-957b-77213f18dca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b6fd29c3f64596a1a61f472a802673'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:40.720074 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1370/2758] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:37:40 2021] DELETE /identity/v3/users/a8b6fd29c3f64596a1a61f472a802673 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:40.724783 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803917e-71fd-45d0-bc4a-cd9db8187ef9 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:40.725287 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803917e-71fd-45d0-bc4a-cd9db8187ef9 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:40.725379 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803917e-71fd-45d0-bc4a-cd9db8187ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:40.742779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-b803917e-71fd-45d0-bc4a-cd9db8187ef9 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:40.744024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b803917e-71fd-45d0-bc4a-cd9db8187ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:40.805779 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1389/2759] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:40.816197 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501750f-1c66-4e9b-957b-77213f18dca4 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:40.817737 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3501750f-1c66-4e9b-957b-77213f18dca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:40.874828 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501750f-1c66-4e9b-957b-77213f18dca4 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:40.880026 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380703d8-194a-4b2f-992b-df162381599c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:40.880695 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380703d8-194a-4b2f-992b-df162381599c service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:40.881006 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380703d8-194a-4b2f-992b-df162381599c service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:40.881269 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380703d8-194a-4b2f-992b-df162381599c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:40.891173 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380703d8-194a-4b2f-992b-df162381599c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:40.892637 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380703d8-194a-4b2f-992b-df162381599c service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:40.902748 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1371/2760] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:37:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:37:41.175266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803917e-71fd-45d0-bc4a-cd9db8187ef9 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:41.176764 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b803917e-71fd-45d0-bc4a-cd9db8187ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:41.196096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803917e-71fd-45d0-bc4a-cd9db8187ef9 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:41.212155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c4446-d3d0-40f9-8749-33651aa69345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:41.213063 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c4446-d3d0-40f9-8749-33651aa69345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:41.213355 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c4446-d3d0-40f9-8749-33651aa69345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:41.213630 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c4446-d3d0-40f9-8749-33651aa69345 admin admin] PATH_INFO: `/v3/projects/cc3b9dcb4d4d461f8323388fd19ef9e9` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:41.215050 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c4446-d3d0-40f9-8749-33651aa69345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3b9dcb4d4d461f8323388fd19ef9e9)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:41.217125 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c4446-d3d0-40f9-8749-33651aa69345 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:41.266996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e62c4446-d3d0-40f9-8749-33651aa69345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3b9dcb4d4d461f8323388fd19ef9e9', 'request_id': 'req-e62c4446-d3d0-40f9-8749-33651aa69345'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:41.273410 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e62c4446-d3d0-40f9-8749-33651aa69345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3b9dcb4d4d461f8323388fd19ef9e9', 'request_id': 'req-e62c4446-d3d0-40f9-8749-33651aa69345'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:41.279172 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e62c4446-d3d0-40f9-8749-33651aa69345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3b9dcb4d4d461f8323388fd19ef9e9', 'request_id': 'req-e62c4446-d3d0-40f9-8749-33651aa69345'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:41.293246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e62c4446-d3d0-40f9-8749-33651aa69345 admin admin] The token cache is being invalidate because project cc3b9dcb4d4d461f8323388fd19ef9e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:37:41.293526 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e62c4446-d3d0-40f9-8749-33651aa69345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:41.294171 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-e62c4446-d3d0-40f9-8749-33651aa69345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:41.295757 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1390/2761] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:37:41 2021] DELETE /identity/v3/projects/cc3b9dcb4d4d461f8323388fd19ef9e9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:41.305152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f71b5c-13b9-44d4-a1c5-8d2f90de046b None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:41.305466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f71b5c-13b9-44d4-a1c5-8d2f90de046b None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:41.305684 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f71b5c-13b9-44d4-a1c5-8d2f90de046b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:41.324296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-15f71b5c-13b9-44d4-a1c5-8d2f90de046b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:41.325510 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-15f71b5c-13b9-44d4-a1c5-8d2f90de046b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:41.387960 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1372/2762] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:41.396728 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aeec59-dc93-4eb0-96b4-5003945fbce8 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:41.397017 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aeec59-dc93-4eb0-96b4-5003945fbce8 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:41.397310 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aeec59-dc93-4eb0-96b4-5003945fbce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:41.417885 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-61aeec59-dc93-4eb0-96b4-5003945fbce8 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:41.419083 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-61aeec59-dc93-4eb0-96b4-5003945fbce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:41.427904 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1391/2763] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:41.432369 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f71b5c-13b9-44d4-a1c5-8d2f90de046b None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:41.442173 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f71b5c-13b9-44d4-a1c5-8d2f90de046b None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:41.447394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242da9dd-5051-4f9c-b699-2afb889f506c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:41.448046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242da9dd-5051-4f9c-b699-2afb889f506c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:41.448330 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242da9dd-5051-4f9c-b699-2afb889f506c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:41.448594 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242da9dd-5051-4f9c-b699-2afb889f506c admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:41.449348 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242da9dd-5051-4f9c-b699-2afb889f506c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:37:41.449617 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242da9dd-5051-4f9c-b699-2afb889f506c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:41.451272 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242da9dd-5051-4f9c-b699-2afb889f506c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:41.463360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1373/2764] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:37:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:37:41.467956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aeec59-dc93-4eb0-96b4-5003945fbce8 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:41.477762 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aeec59-dc93-4eb0-96b4-5003945fbce8 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:41.483033 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31817976-c633-412a-a4fb-5effc2014166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:41.483760 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31817976-c633-412a-a4fb-5effc2014166 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:41.484040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31817976-c633-412a-a4fb-5effc2014166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:41.484310 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31817976-c633-412a-a4fb-5effc2014166 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:41.485015 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31817976-c633-412a-a4fb-5effc2014166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:41.486973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31817976-c633-412a-a4fb-5effc2014166 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:41.514368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1392/2765] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:37:41 2021] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:37:41.518717 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242da9dd-5051-4f9c-b699-2afb889f506c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:41.529766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242da9dd-5051-4f9c-b699-2afb889f506c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:41.599649 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dccb86-f450-4b2d-b354-ae5ecdf838ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:41.600652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dccb86-f450-4b2d-b354-ae5ecdf838ed admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:41.601355 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dccb86-f450-4b2d-b354-ae5ecdf838ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:41.601355 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dccb86-f450-4b2d-b354-ae5ecdf838ed admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:41.601998 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dccb86-f450-4b2d-b354-ae5ecdf838ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:41.603957 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dccb86-f450-4b2d-b354-ae5ecdf838ed admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:41.626822 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1374/2766] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:37:41 2021] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:37:41.629555 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31817976-c633-412a-a4fb-5effc2014166 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:41.640839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31817976-c633-412a-a4fb-5effc2014166 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:41.646329 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db81d80-8bec-4c79-bccc-463bc166ab7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:41.646981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db81d80-8bec-4c79-bccc-463bc166ab7d admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:41.647290 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db81d80-8bec-4c79-bccc-463bc166ab7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:41.647563 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db81d80-8bec-4c79-bccc-463bc166ab7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:41.648295 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db81d80-8bec-4c79-bccc-463bc166ab7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:41.649888 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db81d80-8bec-4c79-bccc-463bc166ab7d admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:41.661969 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1393/2767] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:37:41.666321 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dccb86-f450-4b2d-b354-ae5ecdf838ed admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:41.676399 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dccb86-f450-4b2d-b354-ae5ecdf838ed admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:41.681817 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe0903-6083-43fa-b72c-d5d29f445167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:41.682478 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe0903-6083-43fa-b72c-d5d29f445167 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:41.682763 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe0903-6083-43fa-b72c-d5d29f445167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:41.683037 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe0903-6083-43fa-b72c-d5d29f445167 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:41.683819 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe0903-6083-43fa-b72c-d5d29f445167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:41.685434 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe0903-6083-43fa-b72c-d5d29f445167 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:41.695408 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1375/2768] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:37:41.699562 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db81d80-8bec-4c79-bccc-463bc166ab7d admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:41.709479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db81d80-8bec-4c79-bccc-463bc166ab7d admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:41.715012 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a8a26-39df-4a7f-997b-93384c254d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:41.715938 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a8a26-39df-4a7f-997b-93384c254d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:41.716226 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a8a26-39df-4a7f-997b-93384c254d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:41.716504 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a8a26-39df-4a7f-997b-93384c254d65 admin admin] PATH_INFO: `/v3/projects/1a88f1ec517547428513189eeb07925a/users/9f447d276f53488a9b43ee1aaefcc27f/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:41.731976 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a8a26-39df-4a7f-997b-93384c254d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a88f1ec517547428513189eeb07925a, user_id=9f447d276f53488a9b43ee1aaefcc27f, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:41.734650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a8a26-39df-4a7f-997b-93384c254d65 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:41.748370 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1394/2769] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:37:41 2021] PUT /identity/v3/projects/1a88f1ec517547428513189eeb07925a/users/9f447d276f53488a9b43ee1aaefcc27f/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:37:41.759391 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4ba73-dd54-4a20-957c-276163736b53 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:41.759711 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4ba73-dd54-4a20-957c-276163736b53 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:41.759992 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4ba73-dd54-4a20-957c-276163736b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:41.786829 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-ecc4ba73-dd54-4a20-957c-276163736b53 None None] MFA Rules not processed for user `9f447d276f53488a9b43ee1aaefcc27f`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:41.788070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-ecc4ba73-dd54-4a20-957c-276163736b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:41.855980 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1376/2770] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:41 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:41.863581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a8a26-39df-4a7f-997b-93384c254d65 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:41.931894 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a8a26-39df-4a7f-997b-93384c254d65 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:41.936691 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6869d2-7986-46c5-8599-252feff83940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:41.937346 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6869d2-7986-46c5-8599-252feff83940 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:41.937628 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6869d2-7986-46c5-8599-252feff83940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:41.937900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6869d2-7986-46c5-8599-252feff83940 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:41.938602 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6869d2-7986-46c5-8599-252feff83940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:41.940535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6869d2-7986-46c5-8599-252feff83940 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:41.969126 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1395/2771] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:37:41 2021] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:37:41.973340 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4ba73-dd54-4a20-957c-276163736b53 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:41.984480 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4ba73-dd54-4a20-957c-276163736b53 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:42.045961 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98cc59-3ddc-4f4d-ba7e-595b1fe1939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:42.046633 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98cc59-3ddc-4f4d-ba7e-595b1fe1939c admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:42.046916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98cc59-3ddc-4f4d-ba7e-595b1fe1939c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:42.047250 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98cc59-3ddc-4f4d-ba7e-595b1fe1939c admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:42.047969 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98cc59-3ddc-4f4d-ba7e-595b1fe1939c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:42.049911 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98cc59-3ddc-4f4d-ba7e-595b1fe1939c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:42.072266 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1377/2772] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:37:41 2021] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:37:42.076552 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6869d2-7986-46c5-8599-252feff83940 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:42.087767 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6869d2-7986-46c5-8599-252feff83940 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:42.093356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed3d1b-8257-43de-a374-0d16876adc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:42.094021 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed3d1b-8257-43de-a374-0d16876adc6b admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:42.094303 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed3d1b-8257-43de-a374-0d16876adc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:42.094577 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed3d1b-8257-43de-a374-0d16876adc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:42.095381 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed3d1b-8257-43de-a374-0d16876adc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:42.096986 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed3d1b-8257-43de-a374-0d16876adc6b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:42.108856 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1396/2773] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:37:42 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:37:42.113233 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98cc59-3ddc-4f4d-ba7e-595b1fe1939c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:42.124474 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98cc59-3ddc-4f4d-ba7e-595b1fe1939c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:42.130004 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7970f1-0142-4338-86d2-36bfc9b2abd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:42.130886 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7970f1-0142-4338-86d2-36bfc9b2abd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:42.131194 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7970f1-0142-4338-86d2-36bfc9b2abd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:42.131474 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7970f1-0142-4338-86d2-36bfc9b2abd1 admin admin] PATH_INFO: `/v3/projects/dd23231a00f642d8b997f72ff37f6e0a/users/33bfb6be514a4999872eb0583f3bf675/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:42.147866 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7970f1-0142-4338-86d2-36bfc9b2abd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd23231a00f642d8b997f72ff37f6e0a, user_id=33bfb6be514a4999872eb0583f3bf675, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:42.150564 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7970f1-0142-4338-86d2-36bfc9b2abd1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:42.167203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1378/2774] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:37:42 2021] PUT /identity/v3/projects/dd23231a00f642d8b997f72ff37f6e0a/users/33bfb6be514a4999872eb0583f3bf675/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:42.171957 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed3d1b-8257-43de-a374-0d16876adc6b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:42.184558 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed3d1b-8257-43de-a374-0d16876adc6b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:42.242341 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef522db-a9d7-4fca-97f1-f1c502209231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:42.243029 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef522db-a9d7-4fca-97f1-f1c502209231 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:42.243350 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef522db-a9d7-4fca-97f1-f1c502209231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:42.243625 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef522db-a9d7-4fca-97f1-f1c502209231 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:42.244360 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef522db-a9d7-4fca-97f1-f1c502209231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:42.245979 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef522db-a9d7-4fca-97f1-f1c502209231 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:42.258974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1397/2775] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:37:42 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:37:42.264501 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7970f1-0142-4338-86d2-36bfc9b2abd1 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:42.276079 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7970f1-0142-4338-86d2-36bfc9b2abd1 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:42.281632 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad5ccf-0c67-4a38-9fdb-ea8038fe74ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:42.282519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad5ccf-0c67-4a38-9fdb-ea8038fe74ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:42.282799 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad5ccf-0c67-4a38-9fdb-ea8038fe74ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:42.283070 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad5ccf-0c67-4a38-9fdb-ea8038fe74ab admin admin] PATH_INFO: `/v3/projects/dd23231a00f642d8b997f72ff37f6e0a/users/33bfb6be514a4999872eb0583f3bf675/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:42.285296 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad5ccf-0c67-4a38-9fdb-ea8038fe74ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd23231a00f642d8b997f72ff37f6e0a, user_id=33bfb6be514a4999872eb0583f3bf675, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:42.288017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad5ccf-0c67-4a38-9fdb-ea8038fe74ab admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:42.301493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1379/2776] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:37:42 2021] PUT /identity/v3/projects/dd23231a00f642d8b997f72ff37f6e0a/users/33bfb6be514a4999872eb0583f3bf675/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:42.313197 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc9f4a-c790-4ba7-8106-1f9a34c064f7 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:42.313515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc9f4a-c790-4ba7-8106-1f9a34c064f7 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:42.313775 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc9f4a-c790-4ba7-8106-1f9a34c064f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:42.343692 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-8ebc9f4a-c790-4ba7-8106-1f9a34c064f7 None None] MFA Rules not processed for user `33bfb6be514a4999872eb0583f3bf675`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:42.344886 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-8ebc9f4a-c790-4ba7-8106-1f9a34c064f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:42.412147 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1398/2777] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:42 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:42.425466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad5ccf-0c67-4a38-9fdb-ea8038fe74ab admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:42.428639 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-13ad5ccf-0c67-4a38-9fdb-ea8038fe74ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:42.499472 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad5ccf-0c67-4a38-9fdb-ea8038fe74ab admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:42.503892 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea07e40-8166-4743-8635-b52fd26fbbdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:42.504551 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea07e40-8166-4743-8635-b52fd26fbbdd service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:42.504844 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea07e40-8166-4743-8635-b52fd26fbbdd service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:42.505117 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea07e40-8166-4743-8635-b52fd26fbbdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:42.568091 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea07e40-8166-4743-8635-b52fd26fbbdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:42.569578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea07e40-8166-4743-8635-b52fd26fbbdd service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:42.579214 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1380/2778] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:37:42 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:37:45.136135 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc9f4a-c790-4ba7-8106-1f9a34c064f7 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:45.206366 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc9f4a-c790-4ba7-8106-1f9a34c064f7 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:45.211741 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca30530-e8c8-46d0-aa90-888aa91bb1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:45.212672 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca30530-e8c8-46d0-aa90-888aa91bb1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:45.212941 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca30530-e8c8-46d0-aa90-888aa91bb1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:45.213215 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca30530-e8c8-46d0-aa90-888aa91bb1a8 admin admin] PATH_INFO: `/v3/users/9f447d276f53488a9b43ee1aaefcc27f` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:45.214516 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca30530-e8c8-46d0-aa90-888aa91bb1a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f447d276f53488a9b43ee1aaefcc27f)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:45.216499 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca30530-e8c8-46d0-aa90-888aa91bb1a8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:45.266042 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dca30530-e8c8-46d0-aa90-888aa91bb1a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f447d276f53488a9b43ee1aaefcc27f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:45.266714 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dca30530-e8c8-46d0-aa90-888aa91bb1a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f447d276f53488a9b43ee1aaefcc27f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:45.274675 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dca30530-e8c8-46d0-aa90-888aa91bb1a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f447d276f53488a9b43ee1aaefcc27f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:45.275378 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dca30530-e8c8-46d0-aa90-888aa91bb1a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f447d276f53488a9b43ee1aaefcc27f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:45.287914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-dca30530-e8c8-46d0-aa90-888aa91bb1a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f447d276f53488a9b43ee1aaefcc27f'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:45.300297 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1399/2779] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:37:45 2021] DELETE /identity/v3/users/9f447d276f53488a9b43ee1aaefcc27f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:45.305769 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d88f4-7ab0-4bef-ab11-043ebb3b8296 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:45.306265 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d88f4-7ab0-4bef-ab11-043ebb3b8296 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:45.306383 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d88f4-7ab0-4bef-ab11-043ebb3b8296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:45.330646 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-fd3d88f4-7ab0-4bef-ab11-043ebb3b8296 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:45.331899 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-fd3d88f4-7ab0-4bef-ab11-043ebb3b8296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:45.400374 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1381/2780] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:45.412406 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca30530-e8c8-46d0-aa90-888aa91bb1a8 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:45.414705 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-dca30530-e8c8-46d0-aa90-888aa91bb1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:45.480024 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca30530-e8c8-46d0-aa90-888aa91bb1a8 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:45.485357 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e36c02-8a2b-40aa-9910-e1ff2a808d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:45.486263 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e36c02-8a2b-40aa-9910-e1ff2a808d86 service neutron] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:45.486543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e36c02-8a2b-40aa-9910-e1ff2a808d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:45.486839 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e36c02-8a2b-40aa-9910-e1ff2a808d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:45.501720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e36c02-8a2b-40aa-9910-e1ff2a808d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:45.504633 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e36c02-8a2b-40aa-9910-e1ff2a808d86 service neutron] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:45.515394 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1400/2781] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:37:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:37:45.793647 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d88f4-7ab0-4bef-ab11-043ebb3b8296 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:45.795765 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-fd3d88f4-7ab0-4bef-ab11-043ebb3b8296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:45.810486 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d88f4-7ab0-4bef-ab11-043ebb3b8296 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:45.815587 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:45.816498 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:45.816773 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:45.817042 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] PATH_INFO: `/v3/projects/1a88f1ec517547428513189eeb07925a` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:45.818357 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a88f1ec517547428513189eeb07925a)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:45.820367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:45.879684 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a88f1ec517547428513189eeb07925a', 'request_id': 'req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:45.887061 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a88f1ec517547428513189eeb07925a', 'request_id': 'req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:45.893869 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a88f1ec517547428513189eeb07925a', 'request_id': 'req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:45.908519 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] The token cache is being invalidate because project 1a88f1ec517547428513189eeb07925a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:37:45.908735 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:45.909360 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:45.910970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1382/2782] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:37:45 2021] DELETE /identity/v3/projects/1a88f1ec517547428513189eeb07925a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:45.915234 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e36c02-8a2b-40aa-9910-e1ff2a808d86 service neutron] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:45.925727 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e36c02-8a2b-40aa-9910-e1ff2a808d86 service neutron] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:45.984807 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fb68a-d104-4d10-86d3-b329838f7663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:45.985766 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fb68a-d104-4d10-86d3-b329838f7663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:45.986044 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fb68a-d104-4d10-86d3-b329838f7663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:45.986325 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fb68a-d104-4d10-86d3-b329838f7663 admin admin] PATH_INFO: `/v3/users/33bfb6be514a4999872eb0583f3bf675` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:45.987677 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fb68a-d104-4d10-86d3-b329838f7663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33bfb6be514a4999872eb0583f3bf675)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:45.989644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fb68a-d104-4d10-86d3-b329838f7663 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:46.040316 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1d8fb68a-d104-4d10-86d3-b329838f7663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33bfb6be514a4999872eb0583f3bf675'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:46.041026 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1d8fb68a-d104-4d10-86d3-b329838f7663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33bfb6be514a4999872eb0583f3bf675'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:46.050543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1d8fb68a-d104-4d10-86d3-b329838f7663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33bfb6be514a4999872eb0583f3bf675'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:46.051175 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1d8fb68a-d104-4d10-86d3-b329838f7663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33bfb6be514a4999872eb0583f3bf675'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:46.065046 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1d8fb68a-d104-4d10-86d3-b329838f7663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33bfb6be514a4999872eb0583f3bf675'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:46.077922 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1401/2783] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:37:45 2021] DELETE /identity/v3/users/33bfb6be514a4999872eb0583f3bf675 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:46.364653 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:46.366397 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:46.382808 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2ebe8-38fa-45fb-b521-3cd286557eeb admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:46.457003 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c943f-7b4b-4765-834a-c8609dcce7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:46.457901 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c943f-7b4b-4765-834a-c8609dcce7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:46.458181 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c943f-7b4b-4765-834a-c8609dcce7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:46.458456 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c943f-7b4b-4765-834a-c8609dcce7c3 admin admin] PATH_INFO: `/v3/projects/dd23231a00f642d8b997f72ff37f6e0a` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:46.459878 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c943f-7b4b-4765-834a-c8609dcce7c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd23231a00f642d8b997f72ff37f6e0a)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:46.461854 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c943f-7b4b-4765-834a-c8609dcce7c3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:46.509909 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5e8c943f-7b4b-4765-834a-c8609dcce7c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd23231a00f642d8b997f72ff37f6e0a', 'request_id': 'req-5e8c943f-7b4b-4765-834a-c8609dcce7c3'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:46.516367 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5e8c943f-7b4b-4765-834a-c8609dcce7c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd23231a00f642d8b997f72ff37f6e0a', 'request_id': 'req-5e8c943f-7b4b-4765-834a-c8609dcce7c3'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:46.521658 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5e8c943f-7b4b-4765-834a-c8609dcce7c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd23231a00f642d8b997f72ff37f6e0a', 'request_id': 'req-5e8c943f-7b4b-4765-834a-c8609dcce7c3'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:46.534377 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5e8c943f-7b4b-4765-834a-c8609dcce7c3 admin admin] The token cache is being invalidate because project dd23231a00f642d8b997f72ff37f6e0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79201) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:37:46.534664 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5e8c943f-7b4b-4765-834a-c8609dcce7c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:46.535320 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-5e8c943f-7b4b-4765-834a-c8609dcce7c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:46.536862 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1383/2784] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:37:46 2021] DELETE /identity/v3/projects/dd23231a00f642d8b997f72ff37f6e0a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:46.542617 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e9501-cbd1-4988-b181-3cd5eac5d790 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:46.543101 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e9501-cbd1-4988-b181-3cd5eac5d790 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:46.543221 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e9501-cbd1-4988-b181-3cd5eac5d790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:46.562726 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-641e9501-cbd1-4988-b181-3cd5eac5d790 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:46.563967 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-641e9501-cbd1-4988-b181-3cd5eac5d790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:46.624973 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1402/2785] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:46.677350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acd560-3f42-4af7-b9a8-a3ed569fb726 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:46.677805 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acd560-3f42-4af7-b9a8-a3ed569fb726 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:46.678208 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acd560-3f42-4af7-b9a8-a3ed569fb726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:46.706262 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-18acd560-3f42-4af7-b9a8-a3ed569fb726 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:46.707570 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-18acd560-3f42-4af7-b9a8-a3ed569fb726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:46.716274 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1384/2786] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:46.720648 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e9501-cbd1-4988-b181-3cd5eac5d790 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:46.730879 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e9501-cbd1-4988-b181-3cd5eac5d790 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:46.735949 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a19dcb-b877-4fab-86cf-1a43c5841290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:46.736597 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19dcb-b877-4fab-86cf-1a43c5841290 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:46.736872 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19dcb-b877-4fab-86cf-1a43c5841290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:46.737124 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19dcb-b877-4fab-86cf-1a43c5841290 admin admin] PATH_INFO: `/v3/domains` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:46.737882 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a19dcb-b877-4fab-86cf-1a43c5841290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79200) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:37:46.738189 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a19dcb-b877-4fab-86cf-1a43c5841290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:46.739847 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a19dcb-b877-4fab-86cf-1a43c5841290 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:46.751515 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1403/2787] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:37:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:37:46.756388 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acd560-3f42-4af7-b9a8-a3ed569fb726 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:46.766725 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acd560-3f42-4af7-b9a8-a3ed569fb726 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:46.773359 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c6090-4d23-48b9-9b09-02664de07987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:46.774009 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c6090-4d23-48b9-9b09-02664de07987 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:46.774285 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c6090-4d23-48b9-9b09-02664de07987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:46.774557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c6090-4d23-48b9-9b09-02664de07987 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:46.775295 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c6090-4d23-48b9-9b09-02664de07987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:46.777327 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c6090-4d23-48b9-9b09-02664de07987 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:46.809251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1385/2788] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:37:46 2021] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:37:46.816193 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a19dcb-b877-4fab-86cf-1a43c5841290 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:46.828967 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a19dcb-b877-4fab-86cf-1a43c5841290 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:46.890998 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a7d3a-f6eb-45e7-8fda-a0443ee943f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:46.891693 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a7d3a-f6eb-45e7-8fda-a0443ee943f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:46.891996 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a7d3a-f6eb-45e7-8fda-a0443ee943f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:46.892269 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a7d3a-f6eb-45e7-8fda-a0443ee943f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:46.892990 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a7d3a-f6eb-45e7-8fda-a0443ee943f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:46.894915 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a7d3a-f6eb-45e7-8fda-a0443ee943f2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:46.915522 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1404/2789] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:37:46 2021] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:37:46.919977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c6090-4d23-48b9-9b09-02664de07987 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:46.930681 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c6090-4d23-48b9-9b09-02664de07987 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:46.936611 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a62a7-b6b3-46cf-b4e3-f97a44d9aa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:46.937280 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a62a7-b6b3-46cf-b4e3-f97a44d9aa00 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:46.937691 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a62a7-b6b3-46cf-b4e3-f97a44d9aa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:46.937950 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a62a7-b6b3-46cf-b4e3-f97a44d9aa00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:46.938731 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a62a7-b6b3-46cf-b4e3-f97a44d9aa00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:46.940399 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a62a7-b6b3-46cf-b4e3-f97a44d9aa00 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:46.951881 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1386/2790] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:37:46 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:37:46.956177 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a7d3a-f6eb-45e7-8fda-a0443ee943f2 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:46.966386 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a7d3a-f6eb-45e7-8fda-a0443ee943f2 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:46.971664 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111c36-3f06-4d5b-9fd8-5de00cca2573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:46.972325 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111c36-3f06-4d5b-9fd8-5de00cca2573 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:46.972614 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111c36-3f06-4d5b-9fd8-5de00cca2573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:46.972895 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111c36-3f06-4d5b-9fd8-5de00cca2573 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:46.973645 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53111c36-3f06-4d5b-9fd8-5de00cca2573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:46.975279 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53111c36-3f06-4d5b-9fd8-5de00cca2573 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:46.985659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1405/2791] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:37:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:37:46.989992 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a62a7-b6b3-46cf-b4e3-f97a44d9aa00 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:47.000917 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a62a7-b6b3-46cf-b4e3-f97a44d9aa00 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:47.006092 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af223b0-90f8-453d-889e-d5293f90a57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:47.006970 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af223b0-90f8-453d-889e-d5293f90a57b admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:47.007311 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af223b0-90f8-453d-889e-d5293f90a57b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:47.007586 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af223b0-90f8-453d-889e-d5293f90a57b admin admin] PATH_INFO: `/v3/projects/770a7aebaf39409394573639efaef981/users/db910081109c4a7db21d481ff8c1e14e/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:47.022823 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af223b0-90f8-453d-889e-d5293f90a57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=770a7aebaf39409394573639efaef981, user_id=db910081109c4a7db21d481ff8c1e14e, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:47.025571 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af223b0-90f8-453d-889e-d5293f90a57b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:47.043911 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1387/2792] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:37:46 2021] PUT /identity/v3/projects/770a7aebaf39409394573639efaef981/users/db910081109c4a7db21d481ff8c1e14e/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:47.059228 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cdfa3-2d9f-44bd-b6db-d3788140093b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:47.059528 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cdfa3-2d9f-44bd-b6db-d3788140093b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:47.059828 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cdfa3-2d9f-44bd-b6db-d3788140093b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:47.087766 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-1d5cdfa3-2d9f-44bd-b6db-d3788140093b None None] MFA Rules not processed for user `db910081109c4a7db21d481ff8c1e14e`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:47.089127 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-1d5cdfa3-2d9f-44bd-b6db-d3788140093b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:47.158220 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1406/2793] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:47 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:47.165532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af223b0-90f8-453d-889e-d5293f90a57b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:47.240354 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af223b0-90f8-453d-889e-d5293f90a57b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:47.245928 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903961f-d00f-4d78-a39e-3d4d8e79ae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:47.246593 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903961f-d00f-4d78-a39e-3d4d8e79ae2b admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:47.246866 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903961f-d00f-4d78-a39e-3d4d8e79ae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:47.247156 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903961f-d00f-4d78-a39e-3d4d8e79ae2b admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:47.247861 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903961f-d00f-4d78-a39e-3d4d8e79ae2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:47.249766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903961f-d00f-4d78-a39e-3d4d8e79ae2b admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:47.278288 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1388/2794] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:37:47 2021] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:37:47.282624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cdfa3-2d9f-44bd-b6db-d3788140093b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:47.294041 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cdfa3-2d9f-44bd-b6db-d3788140093b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:47.349635 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f198f1-9f69-47f7-b8dc-89bc09870f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:47.350305 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f198f1-9f69-47f7-b8dc-89bc09870f0e admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:47.350571 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f198f1-9f69-47f7-b8dc-89bc09870f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:47.350841 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f198f1-9f69-47f7-b8dc-89bc09870f0e admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:47.351581 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f198f1-9f69-47f7-b8dc-89bc09870f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:47.353483 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f198f1-9f69-47f7-b8dc-89bc09870f0e admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:47.374424 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1407/2795] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:37:47 2021] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:37:47.378912 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903961f-d00f-4d78-a39e-3d4d8e79ae2b admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:47.389701 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903961f-d00f-4d78-a39e-3d4d8e79ae2b admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:47.395394 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da657689-f3b8-43f3-8345-ff736a112d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:47.396056 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da657689-f3b8-43f3-8345-ff736a112d65 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:47.396339 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da657689-f3b8-43f3-8345-ff736a112d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:47.396610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da657689-f3b8-43f3-8345-ff736a112d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:47.397358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da657689-f3b8-43f3-8345-ff736a112d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:47.398965 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da657689-f3b8-43f3-8345-ff736a112d65 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:47.410121 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1389/2796] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:37:47 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:37:47.415435 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f198f1-9f69-47f7-b8dc-89bc09870f0e admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:47.426091 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f198f1-9f69-47f7-b8dc-89bc09870f0e admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:47.431556 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda61de-2611-4128-9f60-16cf9dbb8157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:47.432284 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda61de-2611-4128-9f60-16cf9dbb8157 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:47.432561 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda61de-2611-4128-9f60-16cf9dbb8157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:47.432833 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda61de-2611-4128-9f60-16cf9dbb8157 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:47.433571 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda61de-2611-4128-9f60-16cf9dbb8157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:47.435196 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda61de-2611-4128-9f60-16cf9dbb8157 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:47.445625 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1408/2797] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:37:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:37:47.450031 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da657689-f3b8-43f3-8345-ff736a112d65 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:47.460305 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da657689-f3b8-43f3-8345-ff736a112d65 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:47.466210 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd52344-59d6-4fb7-8499-f833bad10db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:47.467108 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd52344-59d6-4fb7-8499-f833bad10db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:47.467420 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd52344-59d6-4fb7-8499-f833bad10db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:47.467692 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd52344-59d6-4fb7-8499-f833bad10db8 admin admin] PATH_INFO: `/v3/projects/32a77453c0ee43cd91a7a97dbc888a43/users/0ba7482da527424ebddd24538df39648/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:47.483701 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd52344-59d6-4fb7-8499-f833bad10db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a77453c0ee43cd91a7a97dbc888a43, user_id=0ba7482da527424ebddd24538df39648, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:47.486373 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd52344-59d6-4fb7-8499-f833bad10db8 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:47.501133 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1390/2798] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:37:47 2021] PUT /identity/v3/projects/32a77453c0ee43cd91a7a97dbc888a43/users/0ba7482da527424ebddd24538df39648/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:47.512111 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1ead3-a103-4485-b742-5da612a795cf None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:47.512388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1ead3-a103-4485-b742-5da612a795cf None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:47.512683 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1ead3-a103-4485-b742-5da612a795cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:47.538753 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-35b1ead3-a103-4485-b742-5da612a795cf None None] MFA Rules not processed for user `0ba7482da527424ebddd24538df39648`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:47.540065 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-35b1ead3-a103-4485-b742-5da612a795cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:47.605506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1409/2799] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:47 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:47.610180 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd52344-59d6-4fb7-8499-f833bad10db8 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:47.674713 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd52344-59d6-4fb7-8499-f833bad10db8 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:47.679463 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca333432-9cb2-4ae6-b8b1-f96b0532a3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:47.680118 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca333432-9cb2-4ae6-b8b1-f96b0532a3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:47.680399 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca333432-9cb2-4ae6-b8b1-f96b0532a3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:47.680675 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca333432-9cb2-4ae6-b8b1-f96b0532a3b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:47.681376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca333432-9cb2-4ae6-b8b1-f96b0532a3b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:47.683532 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca333432-9cb2-4ae6-b8b1-f96b0532a3b3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:47.711700 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1391/2800] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:37:47 2021] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:37:47.716635 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1ead3-a103-4485-b742-5da612a795cf None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:47.732133 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1ead3-a103-4485-b742-5da612a795cf None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:47.793735 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5494d-a173-472c-ba5e-b054378d7df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:47.794311 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5494d-a173-472c-ba5e-b054378d7df8 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:47.794596 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5494d-a173-472c-ba5e-b054378d7df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:47.794872 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5494d-a173-472c-ba5e-b054378d7df8 admin admin] PATH_INFO: `/v3/users` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:47.795624 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5494d-a173-472c-ba5e-b054378d7df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:47.797547 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5494d-a173-472c-ba5e-b054378d7df8 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:47.822517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1410/2801] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:37:47 2021] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:37:47.827200 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca333432-9cb2-4ae6-b8b1-f96b0532a3b3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:47.842081 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca333432-9cb2-4ae6-b8b1-f96b0532a3b3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:47.847407 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc415b-a3e0-4409-b446-54ea4fd7574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:47.848046 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc415b-a3e0-4409-b446-54ea4fd7574c admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:47.848333 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc415b-a3e0-4409-b446-54ea4fd7574c admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:47.848610 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc415b-a3e0-4409-b446-54ea4fd7574c admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:47.849353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc415b-a3e0-4409-b446-54ea4fd7574c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:47.851022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc415b-a3e0-4409-b446-54ea4fd7574c admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:47.860984 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1392/2802] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:37:47 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:37:47.865198 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5494d-a173-472c-ba5e-b054378d7df8 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:47.875684 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5494d-a173-472c-ba5e-b054378d7df8 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:47.881206 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d0802-c50f-4a8a-9ccc-243230384b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:47.882083 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0802-c50f-4a8a-9ccc-243230384b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:47.882364 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0802-c50f-4a8a-9ccc-243230384b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:47.882644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0802-c50f-4a8a-9ccc-243230384b3b admin admin] PATH_INFO: `/v3/projects/93f633f0a3d044b88ec4193f4b2a14ca/users/b1d1f06971754e0d9e40366ff87b5d21/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:47.897430 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d0802-c50f-4a8a-9ccc-243230384b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f633f0a3d044b88ec4193f4b2a14ca, user_id=b1d1f06971754e0d9e40366ff87b5d21, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:47.900139 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d0802-c50f-4a8a-9ccc-243230384b3b admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:47.915536 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1411/2803] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:37:47 2021] PUT /identity/v3/projects/93f633f0a3d044b88ec4193f4b2a14ca/users/b1d1f06971754e0d9e40366ff87b5d21/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:47.922163 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc415b-a3e0-4409-b446-54ea4fd7574c admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:47.936186 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc415b-a3e0-4409-b446-54ea4fd7574c admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:47.993671 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f7530-d688-4f4d-b981-5f399fb6001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:47.994715 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f7530-d688-4f4d-b981-5f399fb6001a admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:47.995014 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f7530-d688-4f4d-b981-5f399fb6001a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:47.995311 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f7530-d688-4f4d-b981-5f399fb6001a admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:47.996165 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f7530-d688-4f4d-b981-5f399fb6001a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:47.997800 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f7530-d688-4f4d-b981-5f399fb6001a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:48.008525 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1393/2804] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:37:47 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:37:48.013286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d0802-c50f-4a8a-9ccc-243230384b3b admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:48.024132 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d0802-c50f-4a8a-9ccc-243230384b3b admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:48.029748 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7ce4f-1564-4312-8c49-ba7982d1f7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:48.030639 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7ce4f-1564-4312-8c49-ba7982d1f7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:48.030953 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7ce4f-1564-4312-8c49-ba7982d1f7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:48.031259 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7ce4f-1564-4312-8c49-ba7982d1f7c3 admin admin] PATH_INFO: `/v3/projects/93f633f0a3d044b88ec4193f4b2a14ca/users/b1d1f06971754e0d9e40366ff87b5d21/roles/c3d6b512a6934e798c32e75657cf3060` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:48.033264 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7ce4f-1564-4312-8c49-ba7982d1f7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f633f0a3d044b88ec4193f4b2a14ca, user_id=b1d1f06971754e0d9e40366ff87b5d21, role_id=c3d6b512a6934e798c32e75657cf3060)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:48.035947 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7ce4f-1564-4312-8c49-ba7982d1f7c3 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:48.047560 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1412/2805] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:37:48 2021] PUT /identity/v3/projects/93f633f0a3d044b88ec4193f4b2a14ca/users/b1d1f06971754e0d9e40366ff87b5d21/roles/c3d6b512a6934e798c32e75657cf3060 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:48.059388 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2a984-4c56-4255-b841-ced06710f44c None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:48.059681 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2a984-4c56-4255-b841-ced06710f44c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:48.059962 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2a984-4c56-4255-b841-ced06710f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:48.089201 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-44f2a984-4c56-4255-b841-ced06710f44c None None] MFA Rules not processed for user `b1d1f06971754e0d9e40366ff87b5d21`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:48.090442 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-44f2a984-4c56-4255-b841-ced06710f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:48.168446 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1394/2806] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:48 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:48.182181 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7ce4f-1564-4312-8c49-ba7982d1f7c3 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:48.184719 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-b6b7ce4f-1564-4312-8c49-ba7982d1f7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:48.245910 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7ce4f-1564-4312-8c49-ba7982d1f7c3 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:48.250535 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e609fe-8db8-4f65-aad7-2eefa8c4a681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:48.251229 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e609fe-8db8-4f65-aad7-2eefa8c4a681 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:48.251511 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e609fe-8db8-4f65-aad7-2eefa8c4a681 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:48.251788 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e609fe-8db8-4f65-aad7-2eefa8c4a681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:48.309745 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e609fe-8db8-4f65-aad7-2eefa8c4a681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:48.311900 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e609fe-8db8-4f65-aad7-2eefa8c4a681 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:48.324924 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1413/2807] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:37:48 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:37:49.827551 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2a984-4c56-4255-b841-ced06710f44c None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:49.829192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-44f2a984-4c56-4255-b841-ced06710f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:49.842168 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2a984-4c56-4255-b841-ced06710f44c None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:49.846511 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cb28b-c21f-43d4-b31e-89ca0454fc48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:49.847178 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb28b-c21f-43d4-b31e-89ca0454fc48 service cinder] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:49.847449 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb28b-c21f-43d4-b31e-89ca0454fc48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:49.847725 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb28b-c21f-43d4-b31e-89ca0454fc48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:49.903421 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cb28b-c21f-43d4-b31e-89ca0454fc48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:49.905790 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cb28b-c21f-43d4-b31e-89ca0454fc48 service cinder] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:49.919270 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1395/2808] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:37:49 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:37:50.475090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e609fe-8db8-4f65-aad7-2eefa8c4a681 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:50.486119 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e609fe-8db8-4f65-aad7-2eefa8c4a681 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:50.490711 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4825c4a-1b49-4770-8f1d-f88eb7e179e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:50.491400 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4825c4a-1b49-4770-8f1d-f88eb7e179e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:50.491683 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4825c4a-1b49-4770-8f1d-f88eb7e179e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:50.491957 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4825c4a-1b49-4770-8f1d-f88eb7e179e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:50.502179 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4825c4a-1b49-4770-8f1d-f88eb7e179e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:50.504174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4825c4a-1b49-4770-8f1d-f88eb7e179e1 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:50.514268 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1414/2809] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:37:50 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:37:54.354432 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cb28b-c21f-43d4-b31e-89ca0454fc48 service cinder] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:54.415112 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cb28b-c21f-43d4-b31e-89ca0454fc48 service cinder] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:54.420322 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29aa5e-660a-4445-b8b7-c473bff45edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:54.421203 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29aa5e-660a-4445-b8b7-c473bff45edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:54.421473 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29aa5e-660a-4445-b8b7-c473bff45edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:54.421963 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29aa5e-660a-4445-b8b7-c473bff45edb admin admin] PATH_INFO: `/v3/users/db910081109c4a7db21d481ff8c1e14e` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:54.423222 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29aa5e-660a-4445-b8b7-c473bff45edb admin admin] RBAC: Authorizing `identity:delete_user(user_id=db910081109c4a7db21d481ff8c1e14e)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:54.425200 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29aa5e-660a-4445-b8b7-c473bff45edb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:54.477157 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cb29aa5e-660a-4445-b8b7-c473bff45edb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db910081109c4a7db21d481ff8c1e14e'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:54.477889 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cb29aa5e-660a-4445-b8b7-c473bff45edb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db910081109c4a7db21d481ff8c1e14e'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:54.488313 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cb29aa5e-660a-4445-b8b7-c473bff45edb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db910081109c4a7db21d481ff8c1e14e'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:54.488977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cb29aa5e-660a-4445-b8b7-c473bff45edb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db910081109c4a7db21d481ff8c1e14e'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:54.496255 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-cb29aa5e-660a-4445-b8b7-c473bff45edb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db910081109c4a7db21d481ff8c1e14e'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:54.514775 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1396/2810] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:37:54 2021] DELETE /identity/v3/users/db910081109c4a7db21d481ff8c1e14e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:54.519388 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847ced6-d69e-45df-ae16-b63278d88701 None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:54.519911 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847ced6-d69e-45df-ae16-b63278d88701 None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:54.520211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847ced6-d69e-45df-ae16-b63278d88701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:54.539678 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-5847ced6-d69e-45df-ae16-b63278d88701 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:54.540795 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-5847ced6-d69e-45df-ae16-b63278d88701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:54.598211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1415/2811] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 08 11:37:54.608751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29aa5e-660a-4445-b8b7-c473bff45edb admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:54.610283 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-cb29aa5e-660a-4445-b8b7-c473bff45edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:54.667522 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29aa5e-660a-4445-b8b7-c473bff45edb admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:54.671419 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b083a74-a329-4423-9b35-efe0d3e087da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:54.672063 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083a74-a329-4423-9b35-efe0d3e087da service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:54.672341 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083a74-a329-4423-9b35-efe0d3e087da service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:54.672613 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083a74-a329-4423-9b35-efe0d3e087da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:54.681766 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b083a74-a329-4423-9b35-efe0d3e087da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:54.683232 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b083a74-a329-4423-9b35-efe0d3e087da service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:54.694402 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1397/2812] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:37:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 08 11:37:54.991529 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847ced6-d69e-45df-ae16-b63278d88701 None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:54.997335 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-5847ced6-d69e-45df-ae16-b63278d88701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:55.010303 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847ced6-d69e-45df-ae16-b63278d88701 None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:55.016956 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:55.017853 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:55.018133 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:55.018575 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] PATH_INFO: `/v3/projects/770a7aebaf39409394573639efaef981` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:55.020036 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=770a7aebaf39409394573639efaef981)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:55.022543 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:55.085328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770a7aebaf39409394573639efaef981', 'request_id': 'req-467211be-b006-4402-8196-6f14d7ce99a2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.092271 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770a7aebaf39409394573639efaef981', 'request_id': 'req-467211be-b006-4402-8196-6f14d7ce99a2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.098981 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770a7aebaf39409394573639efaef981', 'request_id': 'req-467211be-b006-4402-8196-6f14d7ce99a2'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.112603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] The token cache is being invalidate because project 770a7aebaf39409394573639efaef981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:37:55.113116 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.113898 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.115549 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1416/2813] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:37:54 2021] DELETE /identity/v3/projects/770a7aebaf39409394573639efaef981 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:55.119557 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b083a74-a329-4423-9b35-efe0d3e087da service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:55.130668 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b083a74-a329-4423-9b35-efe0d3e087da service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:55.188017 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df83d5b-3006-40ac-b379-61c363013b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:55.189059 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df83d5b-3006-40ac-b379-61c363013b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:55.189492 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df83d5b-3006-40ac-b379-61c363013b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:55.189821 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df83d5b-3006-40ac-b379-61c363013b3e admin admin] PATH_INFO: `/v3/users/0ba7482da527424ebddd24538df39648` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:55.191327 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df83d5b-3006-40ac-b379-61c363013b3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba7482da527424ebddd24538df39648)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:55.193261 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df83d5b-3006-40ac-b379-61c363013b3e admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:55.242578 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3df83d5b-3006-40ac-b379-61c363013b3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba7482da527424ebddd24538df39648'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.243284 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3df83d5b-3006-40ac-b379-61c363013b3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba7482da527424ebddd24538df39648'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.252111 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3df83d5b-3006-40ac-b379-61c363013b3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba7482da527424ebddd24538df39648'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.253251 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3df83d5b-3006-40ac-b379-61c363013b3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba7482da527424ebddd24538df39648'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.260779 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-3df83d5b-3006-40ac-b379-61c363013b3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba7482da527424ebddd24538df39648'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.281734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1398/2814] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:37:55 2021] DELETE /identity/v3/users/0ba7482da527424ebddd24538df39648 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:37:55.565139 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:55.566954 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:55.580673 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467211be-b006-4402-8196-6f14d7ce99a2 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:55.641068 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:55.642045 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:55.642328 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:55.642604 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] PATH_INFO: `/v3/projects/32a77453c0ee43cd91a7a97dbc888a43` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:55.643855 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a77453c0ee43cd91a7a97dbc888a43)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:55.645776 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:55.697270 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a77453c0ee43cd91a7a97dbc888a43', 'request_id': 'req-2b1af813-b134-4511-8277-e28641d01d6c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.704174 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a77453c0ee43cd91a7a97dbc888a43', 'request_id': 'req-2b1af813-b134-4511-8277-e28641d01d6c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.710375 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a77453c0ee43cd91a7a97dbc888a43', 'request_id': 'req-2b1af813-b134-4511-8277-e28641d01d6c'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.728246 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] The token cache is being invalidate because project 32a77453c0ee43cd91a7a97dbc888a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:37:55.728755 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.729847 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.737121 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df83d5b-3006-40ac-b379-61c363013b3e admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:55.738283 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1417/2815] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:37:55 2021] DELETE /identity/v3/projects/32a77453c0ee43cd91a7a97dbc888a43 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:55.739466 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3df83d5b-3006-40ac-b379-61c363013b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:55.755866 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df83d5b-3006-40ac-b379-61c363013b3e admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:55.817273 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df34c7-e18c-4003-833d-7b722dd6dabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:55.818391 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df34c7-e18c-4003-833d-7b722dd6dabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:55.818680 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df34c7-e18c-4003-833d-7b722dd6dabb admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:55.819022 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df34c7-e18c-4003-833d-7b722dd6dabb admin admin] PATH_INFO: `/v3/users/b1d1f06971754e0d9e40366ff87b5d21` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:55.820370 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df34c7-e18c-4003-833d-7b722dd6dabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d1f06971754e0d9e40366ff87b5d21)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:55.823152 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df34c7-e18c-4003-833d-7b722dd6dabb admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:55.878868 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e4df34c7-e18c-4003-833d-7b722dd6dabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d1f06971754e0d9e40366ff87b5d21'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.879714 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e4df34c7-e18c-4003-833d-7b722dd6dabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d1f06971754e0d9e40366ff87b5d21'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.891282 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e4df34c7-e18c-4003-833d-7b722dd6dabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d1f06971754e0d9e40366ff87b5d21'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.893373 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e4df34c7-e18c-4003-833d-7b722dd6dabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d1f06971754e0d9e40366ff87b5d21'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.902990 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-e4df34c7-e18c-4003-833d-7b722dd6dabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d1f06971754e0d9e40366ff87b5d21'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:55.924127 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1399/2816] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:37:55 2021] DELETE /identity/v3/users/b1d1f06971754e0d9e40366ff87b5d21 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:56.222585 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:56.224644 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:56.238861 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1af813-b134-4511-8277-e28641d01d6c admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:56.309657 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256990a4-8bdc-460f-b45f-199b218b7bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:56.311625 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256990a4-8bdc-460f-b45f-199b218b7bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:56.312008 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256990a4-8bdc-460f-b45f-199b218b7bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:56.312526 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256990a4-8bdc-460f-b45f-199b218b7bad admin admin] PATH_INFO: `/v3/projects/93f633f0a3d044b88ec4193f4b2a14ca` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:56.314384 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256990a4-8bdc-460f-b45f-199b218b7bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f633f0a3d044b88ec4193f4b2a14ca)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:56.317440 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256990a4-8bdc-460f-b45f-199b218b7bad admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:56.369749 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-256990a4-8bdc-460f-b45f-199b218b7bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f633f0a3d044b88ec4193f4b2a14ca', 'request_id': 'req-256990a4-8bdc-460f-b45f-199b218b7bad'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:56.375888 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-256990a4-8bdc-460f-b45f-199b218b7bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f633f0a3d044b88ec4193f4b2a14ca', 'request_id': 'req-256990a4-8bdc-460f-b45f-199b218b7bad'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:56.381463 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-256990a4-8bdc-460f-b45f-199b218b7bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f633f0a3d044b88ec4193f4b2a14ca', 'request_id': 'req-256990a4-8bdc-460f-b45f-199b218b7bad'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:56.397974 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-256990a4-8bdc-460f-b45f-199b218b7bad admin admin] The token cache is being invalidate because project 93f633f0a3d044b88ec4193f4b2a14ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:37:56.398267 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-256990a4-8bdc-460f-b45f-199b218b7bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:56.399222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-256990a4-8bdc-460f-b45f-199b218b7bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:37:56.401821 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1418/2817] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:37:56 2021] DELETE /identity/v3/projects/93f633f0a3d044b88ec4193f4b2a14ca => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:56.411358 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c4af0-2181-4916-bd08-5dbbf5771649 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:56.411652 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c4af0-2181-4916-bd08-5dbbf5771649 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:56.411931 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c4af0-2181-4916-bd08-5dbbf5771649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:56.432956 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-3c8c4af0-2181-4916-bd08-5dbbf5771649 None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:56.434202 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-3c8c4af0-2181-4916-bd08-5dbbf5771649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:56.498422 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1400/2818] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:56.506993 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3812d-c0e7-47f7-b69d-3de3372a8c8b None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:56.507363 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3812d-c0e7-47f7-b69d-3de3372a8c8b None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:56.507647 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3812d-c0e7-47f7-b69d-3de3372a8c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:56.527159 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-c6a3812d-c0e7-47f7-b69d-3de3372a8c8b None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:56.528447 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-c6a3812d-c0e7-47f7-b69d-3de3372a8c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:56.538096 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1419/2819] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:56.542875 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c4af0-2181-4916-bd08-5dbbf5771649 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:56.553726 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c4af0-2181-4916-bd08-5dbbf5771649 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:56.559025 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016e10a-9412-4231-9e14-0357aba196c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:56.559290 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016e10a-9412-4231-9e14-0357aba196c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:56.559662 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016e10a-9412-4231-9e14-0357aba196c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:56.560475 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016e10a-9412-4231-9e14-0357aba196c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:56.561238 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016e10a-9412-4231-9e14-0357aba196c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79201) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 08 11:37:56.561544 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016e10a-9412-4231-9e14-0357aba196c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:56.563193 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016e10a-9412-4231-9e14-0357aba196c3 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:56.575071 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1401/2820] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Nov 8 11:37:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 08 11:37:56.579607 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3812d-c0e7-47f7-b69d-3de3372a8c8b None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:56.589090 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3812d-c0e7-47f7-b69d-3de3372a8c8b None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:56.594301 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75181474-532d-4df1-9af9-f741071d9f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:56.594951 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75181474-532d-4df1-9af9-f741071d9f22 admin admin] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:56.595271 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75181474-532d-4df1-9af9-f741071d9f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:56.595549 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75181474-532d-4df1-9af9-f741071d9f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:56.596260 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75181474-532d-4df1-9af9-f741071d9f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:56.598168 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75181474-532d-4df1-9af9-f741071d9f22 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:56.628441 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1420/2821] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Nov 8 11:37:56 2021] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 08 11:37:56.632794 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016e10a-9412-4231-9e14-0357aba196c3 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:56.643493 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016e10a-9412-4231-9e14-0357aba196c3 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:56.698825 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf5d84-988d-4466-a33a-a47fa3057d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:56.699523 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf5d84-988d-4466-a33a-a47fa3057d6a admin admin] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:56.699800 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf5d84-988d-4466-a33a-a47fa3057d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:56.700141 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf5d84-988d-4466-a33a-a47fa3057d6a admin admin] PATH_INFO: `/v3/users` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:56.700994 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf5d84-988d-4466-a33a-a47fa3057d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:56.702916 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf5d84-988d-4466-a33a-a47fa3057d6a admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:56.724949 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1402/2822] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Nov 8 11:37:56 2021] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 08 11:37:56.730602 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75181474-532d-4df1-9af9-f741071d9f22 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:56.741115 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75181474-532d-4df1-9af9-f741071d9f22 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:56.745594 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20520c22-b319-49e3-ac11-a84904605474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:56.746236 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20520c22-b319-49e3-ac11-a84904605474 admin admin] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:56.746513 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20520c22-b319-49e3-ac11-a84904605474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:56.746787 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20520c22-b319-49e3-ac11-a84904605474 admin admin] PATH_INFO: `/v3/roles` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:56.747712 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20520c22-b319-49e3-ac11-a84904605474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:56.749302 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20520c22-b319-49e3-ac11-a84904605474 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:56.759764 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1421/2823] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:37:56 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 08 11:37:56.764248 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf5d84-988d-4466-a33a-a47fa3057d6a admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:56.779395 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf5d84-988d-4466-a33a-a47fa3057d6a admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:56.785598 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac23320-cf7f-4c51-b4f2-7451576ddde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:56.786621 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac23320-cf7f-4c51-b4f2-7451576ddde1 admin admin] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:56.786977 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac23320-cf7f-4c51-b4f2-7451576ddde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:56.787384 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac23320-cf7f-4c51-b4f2-7451576ddde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:56.788451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac23320-cf7f-4c51-b4f2-7451576ddde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:56.790960 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac23320-cf7f-4c51-b4f2-7451576ddde1 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:56.804637 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1403/2824] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Nov 8 11:37:56 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 08 11:37:56.808822 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20520c22-b319-49e3-ac11-a84904605474 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:56.819921 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20520c22-b319-49e3-ac11-a84904605474 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:56.826040 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e868e6-9b68-4436-809c-9ea34a9daf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:56.826828 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e868e6-9b68-4436-809c-9ea34a9daf95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:56.827114 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e868e6-9b68-4436-809c-9ea34a9daf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:56.827426 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e868e6-9b68-4436-809c-9ea34a9daf95 admin admin] PATH_INFO: `/v3/projects/e30bd196077043eda712abdb3676ef37/users/665923dbec4240ea8d41b4f59c46e9bd/roles/2dce671f5a1a43da869724374e62098b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:56.843801 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e868e6-9b68-4436-809c-9ea34a9daf95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e30bd196077043eda712abdb3676ef37, user_id=665923dbec4240ea8d41b4f59c46e9bd, role_id=2dce671f5a1a43da869724374e62098b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:56.846479 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e868e6-9b68-4436-809c-9ea34a9daf95 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:56.863876 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1422/2825] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Nov 8 11:37:56 2021] PUT /identity/v3/projects/e30bd196077043eda712abdb3676ef37/users/665923dbec4240ea8d41b4f59c46e9bd/roles/2dce671f5a1a43da869724374e62098b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:37:56.878118 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef8221-e8fa-4ce4-9a41-24ca25e2ed8c None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:56.878409 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef8221-e8fa-4ce4-9a41-24ca25e2ed8c None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:56.878689 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef8221-e8fa-4ce4-9a41-24ca25e2ed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:56.905751 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-1eef8221-e8fa-4ce4-9a41-24ca25e2ed8c None None] MFA Rules not processed for user `665923dbec4240ea8d41b4f59c46e9bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:37:56.906959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1eef8221-e8fa-4ce4-9a41-24ca25e2ed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:56.971917 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1404/2826] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:37:56 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:37:56.984632 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e868e6-9b68-4436-809c-9ea34a9daf95 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:37:56.986500 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-e9e868e6-9b68-4436-809c-9ea34a9daf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:37:57.049130 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e868e6-9b68-4436-809c-9ea34a9daf95 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:37:57.053986 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432ebe1-5427-4256-83de-4ad3d56de116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b0a2df68bfc41ada3b2135fc2e1930f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:37:57.054633 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432ebe1-5427-4256-83de-4ad3d56de116 service cinder] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:37:57.054914 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432ebe1-5427-4256-83de-4ad3d56de116 service cinder] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:37:57.055222 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432ebe1-5427-4256-83de-4ad3d56de116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:37:57.065022 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432ebe1-5427-4256-83de-4ad3d56de116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:37:57.066474 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432ebe1-5427-4256-83de-4ad3d56de116 service cinder] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:37:57.075897 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1423/2827] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:37:56 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:38:01.109280 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2086b8-e71a-47a8-b387-a16178ba06d4 None None] REQUEST_METHOD: `POST` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:38:01.109728 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2086b8-e71a-47a8-b387-a16178ba06d4 None None] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:38:01.109959 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2086b8-e71a-47a8-b387-a16178ba06d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:38:01.129431 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.auth.core [None req-1e2086b8-e71a-47a8-b387-a16178ba06d4 None None] MFA Rules not processed for user `f9fc539f38364a648b9a4c25d3dbea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79201) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:38:01.130994 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1e2086b8-e71a-47a8-b387-a16178ba06d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:38:01.187989 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1405/2828] 10.222.0.20 () {58 vars in 967 bytes} [Mon Nov 8 11:38:01 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:38:01.232201 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432ebe1-5427-4256-83de-4ad3d56de116 service cinder] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:38:01.233638 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-a432ebe1-5427-4256-83de-4ad3d56de116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:38:01.308266 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432ebe1-5427-4256-83de-4ad3d56de116 service cinder] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:38:01.314161 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deae4f7-785a-4d4c-8e52-52cafb6690c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '029506cc966a44c9bbe83eb084ac6feb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:38:01.314817 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deae4f7-785a-4d4c-8e52-52cafb6690c9 service swift] REQUEST_METHOD: `GET` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:38:01.315065 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deae4f7-785a-4d4c-8e52-52cafb6690c9 service swift] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:38:01.315401 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deae4f7-785a-4d4c-8e52-52cafb6690c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:38:01.323730 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deae4f7-785a-4d4c-8e52-52cafb6690c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:38:01.325449 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deae4f7-785a-4d4c-8e52-52cafb6690c9 service swift] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:38:01.334980 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1424/2829] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Nov 8 11:38:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 08 11:38:08.307153 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2086b8-e71a-47a8-b387-a16178ba06d4 None None] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:38:08.309185 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-1e2086b8-e71a-47a8-b387-a16178ba06d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:38:08.408319 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2086b8-e71a-47a8-b387-a16178ba06d4 None None] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:38:08.413683 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9f721-bb77-498f-b2d8-7d7171f0acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:38:08.414663 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9f721-bb77-498f-b2d8-7d7171f0acac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:38:08.415145 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9f721-bb77-498f-b2d8-7d7171f0acac admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:38:08.415497 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9f721-bb77-498f-b2d8-7d7171f0acac admin admin] PATH_INFO: `/v3/users/53a58fd5d15c43a188c03cbad34d9e79` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:38:08.416759 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9f721-bb77-498f-b2d8-7d7171f0acac admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a58fd5d15c43a188c03cbad34d9e79)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:38:08.418847 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9f721-bb77-498f-b2d8-7d7171f0acac admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:38:08.487531 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d8f9f721-bb77-498f-b2d8-7d7171f0acac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a58fd5d15c43a188c03cbad34d9e79'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:08.488257 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d8f9f721-bb77-498f-b2d8-7d7171f0acac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a58fd5d15c43a188c03cbad34d9e79'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:08.503708 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d8f9f721-bb77-498f-b2d8-7d7171f0acac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a58fd5d15c43a188c03cbad34d9e79'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:08.504669 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d8f9f721-bb77-498f-b2d8-7d7171f0acac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a58fd5d15c43a188c03cbad34d9e79'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:08.512911 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-d8f9f721-bb77-498f-b2d8-7d7171f0acac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a58fd5d15c43a188c03cbad34d9e79'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:08.535693 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1406/2830] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:38:08 2021] DELETE /identity/v3/users/53a58fd5d15c43a188c03cbad34d9e79 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:38:08.741315 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deae4f7-785a-4d4c-8e52-52cafb6690c9 service swift] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:38:08.753720 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deae4f7-785a-4d4c-8e52-52cafb6690c9 service swift] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:38:08.817489 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:38:08.818368 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:38:08.818646 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:38:08.818921 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] PATH_INFO: `/v3/projects/6da9f81f345a4196815339ba37ecaa76` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:38:08.820155 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da9f81f345a4196815339ba37ecaa76)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:38:08.822066 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:38:08.870286 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da9f81f345a4196815339ba37ecaa76', 'request_id': 'req-eda831f5-a065-4c86-a91e-300bf319dd36'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:08.876556 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da9f81f345a4196815339ba37ecaa76', 'request_id': 'req-eda831f5-a065-4c86-a91e-300bf319dd36'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:08.883217 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da9f81f345a4196815339ba37ecaa76', 'request_id': 'req-eda831f5-a065-4c86-a91e-300bf319dd36'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:08.897626 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] The token cache is being invalidate because project 6da9f81f345a4196815339ba37ecaa76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:38:08.897949 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:08.898654 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:08.900569 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1425/2831] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:38:08 2021] DELETE /identity/v3/projects/6da9f81f345a4196815339ba37ecaa76 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:38:08.905095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9f721-bb77-498f-b2d8-7d7171f0acac admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:38:08.906554 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d8f9f721-bb77-498f-b2d8-7d7171f0acac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:38:08.919271 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9f721-bb77-498f-b2d8-7d7171f0acac admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:38:08.975579 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54f545-43b8-4785-9385-1d12ece88755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:38:08.976448 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54f545-43b8-4785-9385-1d12ece88755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:38:08.976729 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54f545-43b8-4785-9385-1d12ece88755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:38:08.976998 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54f545-43b8-4785-9385-1d12ece88755 admin admin] PATH_INFO: `/v3/users/35fe6260bdc24eb996a5f52f8a7b61d6` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:38:08.978223 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54f545-43b8-4785-9385-1d12ece88755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35fe6260bdc24eb996a5f52f8a7b61d6)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:38:08.980184 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54f545-43b8-4785-9385-1d12ece88755 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:38:09.028531 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0f54f545-43b8-4785-9385-1d12ece88755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35fe6260bdc24eb996a5f52f8a7b61d6'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:09.029247 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0f54f545-43b8-4785-9385-1d12ece88755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35fe6260bdc24eb996a5f52f8a7b61d6'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:09.036560 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0f54f545-43b8-4785-9385-1d12ece88755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35fe6260bdc24eb996a5f52f8a7b61d6'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:09.037192 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0f54f545-43b8-4785-9385-1d12ece88755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35fe6260bdc24eb996a5f52f8a7b61d6'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:09.044095 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-0f54f545-43b8-4785-9385-1d12ece88755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35fe6260bdc24eb996a5f52f8a7b61d6'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:09.060900 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1407/2832] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:38:08 2021] DELETE /identity/v3/users/35fe6260bdc24eb996a5f52f8a7b61d6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 08 11:38:09.236931 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:38:09.238506 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:38:09.252963 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda831f5-a065-4c86-a91e-300bf319dd36 admin admin] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:38:09.327592 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:38:09.328381 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:38:09.328659 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:38:09.328930 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a admin admin] PATH_INFO: `/v3/projects/b002430895784ad2b2e15396765a5a0b` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:38:09.330250 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b002430895784ad2b2e15396765a5a0b)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:38:09.332217 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:38:09.391154 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b002430895784ad2b2e15396765a5a0b', 'request_id': 'req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:09.397386 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b002430895784ad2b2e15396765a5a0b', 'request_id': 'req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:09.403449 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b002430895784ad2b2e15396765a5a0b', 'request_id': 'req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:09.418356 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a admin admin] The token cache is being invalidate because project b002430895784ad2b2e15396765a5a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:38:09.418667 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:09.419517 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1b85db35-f1be-4ddf-b6ba-7b2fd963362a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:09.421454 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1426/2833] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:38:09 2021] DELETE /identity/v3/projects/b002430895784ad2b2e15396765a5a0b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:38:32.288834 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54f545-43b8-4785-9385-1d12ece88755 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:38:32.290641 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-0f54f545-43b8-4785-9385-1d12ece88755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:38:32.311660 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54f545-43b8-4785-9385-1d12ece88755 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:38:32.370846 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc692fa-a5b9-40f3-aa33-6761d6abd5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:38:32.371852 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc692fa-a5b9-40f3-aa33-6761d6abd5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:38:32.372137 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc692fa-a5b9-40f3-aa33-6761d6abd5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:38:32.372417 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc692fa-a5b9-40f3-aa33-6761d6abd5f9 admin admin] PATH_INFO: `/v3/users/665923dbec4240ea8d41b4f59c46e9bd` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:38:32.373664 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc692fa-a5b9-40f3-aa33-6761d6abd5f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665923dbec4240ea8d41b4f59c46e9bd)` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:38:32.375646 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc692fa-a5b9-40f3-aa33-6761d6abd5f9 admin admin] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:38:32.432062 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6fc692fa-a5b9-40f3-aa33-6761d6abd5f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665923dbec4240ea8d41b4f59c46e9bd'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:32.432716 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6fc692fa-a5b9-40f3-aa33-6761d6abd5f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665923dbec4240ea8d41b4f59c46e9bd'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:32.441732 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6fc692fa-a5b9-40f3-aa33-6761d6abd5f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665923dbec4240ea8d41b4f59c46e9bd'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:32.442353 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6fc692fa-a5b9-40f3-aa33-6761d6abd5f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665923dbec4240ea8d41b4f59c46e9bd'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:32.449651 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.notifications [None req-6fc692fa-a5b9-40f3-aa33-6761d6abd5f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665923dbec4240ea8d41b4f59c46e9bd'} {{(pid=79201) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:32.470903 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1408/2834] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Nov 8 11:38:32 2021] DELETE /identity/v3/users/665923dbec4240ea8d41b4f59c46e9bd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:38:32.475608 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e87e30-c8d6-470e-959a-87fe0e602d8f None None] REQUEST_METHOD: `POST` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:38:32.476087 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e87e30-c8d6-470e-959a-87fe0e602d8f None None] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:38:32.476180 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e87e30-c8d6-470e-959a-87fe0e602d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:38:32.495603 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.auth.core [None req-97e87e30-c8d6-470e-959a-87fe0e602d8f None None] MFA Rules not processed for user `23015594a30b49b885e3a6236f3a6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79200) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 08 11:38:32.496980 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-97e87e30-c8d6-470e-959a-87fe0e602d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:38:32.556650 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1427/2835] 10.222.0.20 () {58 vars in 957 bytes} [Mon Nov 8 11:38:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 08 11:38:32.570753 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc692fa-a5b9-40f3-aa33-6761d6abd5f9 admin admin] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:38:32.572614 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-6fc692fa-a5b9-40f3-aa33-6761d6abd5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:38:32.646734 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc692fa-a5b9-40f3-aa33-6761d6abd5f9 admin admin] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:38:32.651167 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a90d-51d4-4904-96b2-2c3065115859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e134083351e4493b2a05bea95233f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:38:32.651815 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a90d-51d4-4904-96b2-2c3065115859 service neutron] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:38:32.652104 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a90d-51d4-4904-96b2-2c3065115859 service neutron] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:38:32.652372 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a90d-51d4-4904-96b2-2c3065115859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:38:32.662857 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286a90d-51d4-4904-96b2-2c3065115859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:38:32.664372 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286a90d-51d4-4904-96b2-2c3065115859 service neutron] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:38:32.674699 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1409/2836] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:38:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 08 11:38:32.953367 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e87e30-c8d6-470e-959a-87fe0e602d8f None None] Authenticating user token {{(pid=79200) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:38:32.954932 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.fernet_utils [None req-97e87e30-c8d6-470e-959a-87fe0e602d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79200) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:38:32.967064 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e87e30-c8d6-470e-959a-87fe0e602d8f None None] Validating token access rules against request {{(pid=79200) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:38:32.972004 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654fee9-66cd-4a64-b1d2-6d65e91d946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23015594a30b49b885e3a6236f3a6f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27515e2cec514f3da80e13fa65b719ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79200) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:38:32.972873 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654fee9-66cd-4a64-b1d2-6d65e91d946a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:38:32.973157 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654fee9-66cd-4a64-b1d2-6d65e91d946a admin admin] SCRIPT_NAME: `/identity` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:38:32.973435 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654fee9-66cd-4a64-b1d2-6d65e91d946a admin admin] PATH_INFO: `/v3/projects/e30bd196077043eda712abdb3676ef37` {{(pid=79200) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:38:32.974944 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654fee9-66cd-4a64-b1d2-6d65e91d946a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e30bd196077043eda712abdb3676ef37)` {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:38:32.976946 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654fee9-66cd-4a64-b1d2-6d65e91d946a admin admin] RBAC: Authorization granted {{(pid=79200) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:38:33.025559 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1654fee9-66cd-4a64-b1d2-6d65e91d946a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e30bd196077043eda712abdb3676ef37', 'request_id': 'req-1654fee9-66cd-4a64-b1d2-6d65e91d946a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:33.031971 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1654fee9-66cd-4a64-b1d2-6d65e91d946a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e30bd196077043eda712abdb3676ef37', 'request_id': 'req-1654fee9-66cd-4a64-b1d2-6d65e91d946a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:33.037211 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1654fee9-66cd-4a64-b1d2-6d65e91d946a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e30bd196077043eda712abdb3676ef37', 'request_id': 'req-1654fee9-66cd-4a64-b1d2-6d65e91d946a'} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:33.050231 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1654fee9-66cd-4a64-b1d2-6d65e91d946a admin admin] The token cache is being invalidate because project e30bd196077043eda712abdb3676ef37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79200) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 08 11:38:33.050519 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1654fee9-66cd-4a64-b1d2-6d65e91d946a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:33.051149 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: DEBUG keystone.notifications [None req-1654fee9-66cd-4a64-b1d2-6d65e91d946a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79200) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 08 11:38:33.052709 dv-cinder-816184-2-iscsi devstack@keystone.service[79200]: [pid: 79200|app: 0|req: 1428/2837] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Nov 8 11:38:32 2021] DELETE /identity/v3/projects/e30bd196077043eda712abdb3676ef37 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 08 11:40:37.893099 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a90d-51d4-4904-96b2-2c3065115859 service neutron] Authenticating user token {{(pid=79201) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 08 11:40:37.894698 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-d286a90d-51d4-4904-96b2-2c3065115859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:40:37.970451 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a90d-51d4-4904-96b2-2c3065115859 service neutron] Validating token access rules against request {{(pid=79201) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 08 11:40:38.039678 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e79004-ecbb-4203-82c3-48c4135ff816 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '642c2b97ece34d69bacd821b108bd210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41ae5e80b1f745dfaedd81a2c0ded718', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79201) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 08 11:40:38.040396 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e79004-ecbb-4203-82c3-48c4135ff816 service placement] REQUEST_METHOD: `GET` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 08 11:40:38.040679 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e79004-ecbb-4203-82c3-48c4135ff816 service placement] SCRIPT_NAME: `/identity` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 08 11:40:38.040953 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e79004-ecbb-4203-82c3-48c4135ff816 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79201) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 08 11:40:38.042887 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.fernet_utils [None req-36e79004-ecbb-4203-82c3-48c4135ff816 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79201) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 08 11:40:38.054515 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e79004-ecbb-4203-82c3-48c4135ff816 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 08 11:40:38.056350 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e79004-ecbb-4203-82c3-48c4135ff816 service placement] RBAC: Authorization granted {{(pid=79201) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 08 11:40:38.066376 dv-cinder-816184-2-iscsi devstack@keystone.service[79201]: [pid: 79201|app: 0|req: 1410/2838] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Nov 8 11:40:37 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)